|
|
|
|
# Aishell
|
|
|
|
|
|
|
|
|
|
## RoFormer Streaming
|
|
|
|
|
paddle version: 2.5.0
|
|
|
|
|
paddlespeech version: 1.5.0
|
|
|
|
|
|
|
|
|
|
Tesla V100-SXM2-32GB: 1 node, 4 card
|
|
|
|
|
Global BachSize: 32 * 4
|
|
|
|
|
Training Done: 1 day, 12:56:39.639646
|
|
|
|
|
### `decoding.decoding_chunk_size=16`
|
|
|
|
|
|
|
|
|
|
> chunk_size=16, ((16 - 1) * 4 + 7) * 10ms = (16 * 4 + 3) * 10ms = 670ms
|
|
|
|
|
|
|
|
|
|
| Model | Params | Config | Augmentation| Test set | Decode method | Chunk Size & Left Chunks | Loss | CER |
|
|
|
|
|
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
|
|
|
|
|
| roformer | 44.80M | conf/chunk_roformer.yaml | spec_aug | test | attention | 16, -1 | - | |
|
|
|
|
|
| roformer | 44.80M | conf/chunk_roformer.yaml | spec_aug | test | ctc_greedy_search | 16, -1 | - | |
|
|
|
|
|
| roformer | 44.80M | conf/chunk_roformer.yaml | spec_aug | test | ctc_prefix_beam_search | 16, -1 | - | |
|
|
|
|
|
| roformer | 44.80M | conf/chunk_roformer.yaml | spec_aug | test | attention_rescoring | 16, -1 | - | |
|
|
|
|
|
|
|
|
|
|
### `decoding.decoding_chunk_size=-1`
|
|
|
|
|
|
|
|
|
|
| Model | Params | Config | Augmentation| Test set | Decode method | Chunk Size & Left Chunks | Loss | CER |
|
|
|
|
|
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
|
|
|
|
|
| roformer | 44.80M | conf/chunk_roformer.yaml | spec_aug | test | attention | -1, -1 | - | 5.39 |
|
|
|
|
|
| roformer | 44.80M | conf/chunk_roformer.yaml | spec_aug | test | ctc_greedy_search | -1, -1 | - | 5.51 |
|
|
|
|
|
| roformer | 44.80M | conf/chunk_roformer.yaml | spec_aug | test | ctc_prefix_beam_search | -1, -1 | - | 5.51 |
|
|
|
|
|
| roformer | 44.80M | conf/chunk_roformer.yaml | spec_aug | test | attention_rescoring | -1, -1 | - | 4.99 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Conformer Streaming
|
|
|
|
|
paddle version: 2.2.2
|
|
|
|
|
paddlespeech version: 1.4.1
|
|
|
|
|
Need set `decoding.decoding_chunk_size=16` when decoding.
|
|
|
|
|
|
|
|
|
|
| Model | Params | Config | Augmentation| Test set | Decode method | Chunk Size & Left Chunks | Loss | CER |
|
|
|
|
|
| --- | --- | --- | --- | --- | --- | --- | --- | --- |
|
|
|
|
|
| conformer | 47.06M | conf/chunk_conformer.yaml | spec_aug | test | attention | 16, -1 | - | 0.056102 |
|
|
|
|
|
| conformer | 47.06M | conf/chunk_conformer.yaml | spec_aug | test | ctc_greedy_search | 16, -1 | - | 0.058160 |
|
|
|
|
|
| conformer | 47.06M | conf/chunk_conformer.yaml | spec_aug | test | ctc_prefix_beam_search | 16, -1 | - | 0.058160 |
|
|
|
|
|
| conformer | 47.06M | conf/chunk_conformer.yaml | spec_aug | test | attention_rescoring | 16, -1 | - | 0.051968 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Conformer
|
|
|
|
|
paddle version: 2.2.2
|
|
|
|
|
paddlespeech version: 1.0.1
|
|
|
|
|
| Model | Params | Config | Augmentation| Test set | Decode method | Loss | CER |
|
|
|
|
|
| --- | --- | --- | --- | --- | --- | --- | --- |
|
|
|
|
|
| conformer | 47.07M | conf/conformer.yaml | spec_aug | test | attention | - | 0.0522 |
|
|
|
|
|
| conformer | 47.07M | conf/conformer.yaml | spec_aug | test | ctc_greedy_search | - | 0.0481 |
|
|
|
|
|
| conformer | 47.07M | conf/conformer.yaml | spec_aug | test | ctc_prefix_beam_search | - | 0.0480 |
|
|
|
|
|
| conformer | 47.07M | conf/conformer.yaml | spec_aug | test | attention_rescoring | - | 0.0460 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Transformer
|
|
|
|
|
|
|
|
|
|
| Model | Params | Config | Augmentation| Test set | Decode method | Loss | CER |
|
|
|
|
|
| --- | --- | --- | --- | --- | --- | --- | --- |
|
|
|
|
|
| transformer | 31.95M | conf/transformer.yaml | spec_aug | test | attention | 3.8103787302970886 | 0.056588 |
|
|
|
|
|
| transformer | 31.95M | conf/transformer.yaml | spec_aug | test | ctc_greedy_search | 3.8103787302970886 | 0.059932 |
|
|
|
|
|
| transformer | 31.95M | conf/transformer.yaml | spec_aug | test | ctc_prefix_beam_search | 3.8103787302970886 | 0.059989 |
|
|
|
|
|
| transformer | 31.95M | conf/transformer.yaml | spec_aug | test | attention_rescoring | 3.8103787302970886 | 0.052273 |
|
