msb-public
/
PaddleSpeech
mirror of https://github.com/PaddlePaddle/PaddleSpeech
1
0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '188444f778'
${ noResults }
PaddleSpeech/examples/aishell/asr1/RESULTS.md

3.5 KiB
Raw Blame History

Aishell

RoFormer Streaming

paddle version: 2.5.0
paddlespeech version: 1.5.0

Tesla V100-SXM2-32GB: 1 node, 4 card Global BachSize: 32 * 4 Training Done: 1 day, 12:56:39.639646

decoding.decoding_chunk_size=16

chunk_size=16, ((16 - 1) * 4 + 7) * 10ms = (16 * 4 + 3) * 10ms = 670ms

Model Params Config Augmentation Test set Decode method Chunk Size & Left Chunks Loss CER
roformer 44.80M conf/chunk_roformer.yaml spec_aug test attention 16, -1 - 5.63
roformer 44.80M conf/chunk_roformer.yaml spec_aug test ctc_greedy_search 16, -1 - 6.13
roformer 44.80M conf/chunk_roformer.yaml spec_aug test ctc_prefix_beam_search 16, -1 - 6.13
roformer 44.80M conf/chunk_roformer.yaml spec_aug test attention_rescoring 16, -1 - 5.44

decoding.decoding_chunk_size=-1

Model Params Config Augmentation Test set Decode method Chunk Size & Left Chunks Loss CER
roformer 44.80M conf/chunk_roformer.yaml spec_aug test attention -1, -1 - 5.39
roformer 44.80M conf/chunk_roformer.yaml spec_aug test ctc_greedy_search -1, -1 - 5.51
roformer 44.80M conf/chunk_roformer.yaml spec_aug test ctc_prefix_beam_search -1, -1 - 5.51
roformer 44.80M conf/chunk_roformer.yaml spec_aug test attention_rescoring -1, -1 - 4.99

Conformer Streaming

paddle version: 2.2.2
paddlespeech version: 1.4.1
Need set decoding.decoding_chunk_size=16 when decoding.

Model Params Config Augmentation Test set Decode method Chunk Size & Left Chunks Loss CER
conformer 47.06M conf/chunk_conformer.yaml spec_aug test attention 16, -1 - 0.056102
conformer 47.06M conf/chunk_conformer.yaml spec_aug test ctc_greedy_search 16, -1 - 0.058160
conformer 47.06M conf/chunk_conformer.yaml spec_aug test ctc_prefix_beam_search 16, -1 - 0.058160
conformer 47.06M conf/chunk_conformer.yaml spec_aug test attention_rescoring 16, -1 - 0.051968

Conformer

paddle version: 2.2.2
paddlespeech version: 1.0.1

Model Params Config Augmentation Test set Decode method Loss CER
conformer 47.07M conf/conformer.yaml spec_aug test attention - 0.0522
conformer 47.07M conf/conformer.yaml spec_aug test ctc_greedy_search - 0.0481
conformer 47.07M conf/conformer.yaml spec_aug test ctc_prefix_beam_search - 0.0480
conformer 47.07M conf/conformer.yaml spec_aug test attention_rescoring - 0.0460

Transformer

Model Params Config Augmentation Test set Decode method Loss CER
transformer 31.95M conf/transformer.yaml spec_aug test attention 3.8103787302970886 0.056588
transformer 31.95M conf/transformer.yaml spec_aug test ctc_greedy_search 3.8103787302970886 0.059932
transformer 31.95M conf/transformer.yaml spec_aug test ctc_prefix_beam_search 3.8103787302970886 0.059989
transformer 31.95M conf/transformer.yaml spec_aug test attention_rescoring 3.8103787302970886 0.052273