msb-public
/
PaddleSpeech
mirror of https://github.com/PaddlePaddle/PaddleSpeech
1
0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'f08b7fc205'
${ noResults }
PaddleSpeech/docs/source/released_model.md

16 KiB
Raw Blame History

Released Models

Speech-to-Text Models

Speech Recognition Model

Acoustic Model Training Data Token-based Size Descriptions CER WER Hours of speech Example Link
Ds2 Online Wenetspeech ASR0 Model Wenetspeech Dataset Char-based 1.2 GB 2 Conv + 5 LSTM layers 0.152 (test_net, w/o LM)
0.2417 (test_meeting, w/o LM)
0.053 (aishell, w/ LM)		 - 10000 h -
Ds2 Online Aishell ASR0 Model Aishell Dataset Char-based 491 MB 2 Conv + 5 LSTM layers 0.0666 - 151 h D2 Online Aishell ASR0
Ds2 Offline Aishell ASR0 Model Aishell Dataset Char-based 306 MB 2 Conv + 3 bidirectional GRU layers 0.064 - 151 h Ds2 Offline Aishell ASR0
Conformer Online Wenetspeech ASR1 Model WenetSpeech Dataset Char-based 457 MB Encoder:Conformer, Decoder:Transformer, Decoding method: Attention rescoring 0.11 (test_net) 0.1879 (test_meeting) - 10000 h -
Conformer Online Aishell ASR1 Model Aishell Dataset Char-based 189 MB Encoder:Conformer, Decoder:Transformer, Decoding method: Attention rescoring 0.0544 - 151 h Conformer Online Aishell ASR1
Conformer Offline Aishell ASR1 Model Aishell Dataset Char-based 189 MB Encoder:Conformer, Decoder:Transformer, Decoding method: Attention rescoring 0.0464 - 151 h Conformer Offline Aishell ASR1
Transformer Aishell ASR1 Model Aishell Dataset Char-based 128 MB Encoder:Transformer, Decoder:Transformer, Decoding method: Attention rescoring 0.0523 151 h Transformer Aishell ASR1
Ds2 Offline Librispeech ASR0 Model Librispeech Dataset Char-based 518 MB 2 Conv + 3 bidirectional LSTM layers - 0.0725 960 h Ds2 Offline Librispeech ASR0
Conformer Librispeech ASR1 Model Librispeech Dataset subword-based 191 MB Encoder:Conformer, Decoder:Transformer, Decoding method: Attention rescoring - 0.0337 960 h Conformer Librispeech ASR1
Transformer Librispeech ASR1 Model Librispeech Dataset subword-based 131 MB Encoder:Transformer, Decoder:Transformer, Decoding method: Attention rescoring - 0.0381 960 h Transformer Librispeech ASR1
Transformer Librispeech ASR2 Model Librispeech Dataset subword-based 131 MB Encoder:Transformer, Decoder:Transformer, Decoding method: JoinCTC w/ LM - 0.0240 960 h Transformer Librispeech ASR2

Language Model based on NGram

Language Model Training Data Token-based Size Descriptions
English LM CommonCrawl(en.00) Word-based 8.3 GB Pruned with 0 1 1 1 1;
About 1.85 billion n-grams;
'trie' binary with '-a 22 -q 8 -b 8'
Mandarin LM Small Baidu Internal Corpus Char-based 2.8 GB Pruned with 0 1 2 4 4;
About 0.13 billion n-grams;
'probing' binary with default settings
Mandarin LM Large Baidu Internal Corpus Char-based 70.4 GB No Pruning;
About 3.7 billion n-grams;
'probing' binary with default settings

Speech Translation Models

Model Training Data Token-based Size Descriptions BLEU Example Link
(only for CLI)Transformer FAT-ST MTL En-Zh Ted-En-Zh Spm Encoder:Transformer, Decoder:Transformer,
Decoding method: Attention		 20.80 Transformer Ted-En-Zh ST1

Text-to-Speech Models

Acoustic Models

Model Type Dataset Example Link Pretrained Models Static Models Size (static)
Tacotron2 LJSpeech tacotron2-ljspeech tacotron2_ljspeech_ckpt_0.2.0.zip
Tacotron2 CSMSC tacotron2-csmsc tacotron2_csmsc_ckpt_0.2.0.zip tacotron2_csmsc_static_0.2.0.zip 103MB
TransformerTTS LJSpeech transformer-ljspeech transformer_tts_ljspeech_ckpt_0.4.zip
SpeedySpeech CSMSC speedyspeech-csmsc speedyspeech_csmsc_ckpt_0.2.0.zip speedyspeech_csmsc_static_0.2.0.zip 12MB
FastSpeech2 CSMSC fastspeech2-csmsc fastspeech2_nosil_baker_ckpt_0.4.zip fastspeech2_csmsc_static_0.2.0.zip 157MB
FastSpeech2-Conformer CSMSC fastspeech2-csmsc fastspeech2_conformer_baker_ckpt_0.5.zip
FastSpeech2 AISHELL-3 fastspeech2-aishell3 fastspeech2_nosil_aishell3_ckpt_0.4.zip
FastSpeech2 LJSpeech fastspeech2-ljspeech fastspeech2_nosil_ljspeech_ckpt_0.5.zip
FastSpeech2 VCTK fastspeech2-vctk fastspeech2_nosil_vctk_ckpt_0.5.zip

Vocoders

Model Type Dataset Example Link Pretrained Models Static Models Size (static)
WaveFlow LJSpeech waveflow-ljspeech waveflow_ljspeech_ckpt_0.3.zip
Parallel WaveGAN CSMSC PWGAN-csmsc pwg_baker_ckpt_0.4.zip pwg_baker_static_0.4.zip 5.1MB
Parallel WaveGAN LJSpeech PWGAN-ljspeech pwg_ljspeech_ckpt_0.5.zip
Parallel WaveGAN AISHELL-3 PWGAN-aishell3 pwg_aishell3_ckpt_0.5.zip
Parallel WaveGAN VCTK PWGAN-vctk pwg_vctk_ckpt_0.5.zip
Multi Band MelGAN CSMSC MB MelGAN-csmsc mb_melgan_csmsc_ckpt_0.1.1.zip
mb_melgan_baker_finetune_ckpt_0.5.zip		 mb_melgan_csmsc_static_0.1.1.zip 8.2MB
Style MelGAN CSMSC Style MelGAN-csmsc style_melgan_csmsc_ckpt_0.1.1.zip
HiFiGAN CSMSC HiFiGAN-csmsc hifigan_csmsc_ckpt_0.1.1.zip hifigan_csmsc_static_0.1.1.zip 50MB
HiFiGAN LJSpeech HiFiGAN-ljspeech hifigan_ljspeech_ckpt_0.2.0.zip
HiFiGAN AISHELL-3 HiFiGAN-aishell3 hifigan_aishell3_ckpt_0.2.0.zip
HiFiGAN VCTK HiFiGAN-vctk hifigan_vctk_ckpt_0.2.0.zip
WaveRNN CSMSC WaveRNN-csmsc wavernn_csmsc_ckpt_0.2.0.zip wavernn_csmsc_static_0.2.0.zip 18MB

Voice Cloning

Model Type Dataset Example Link Pretrained Models
GE2E AISHELL-3, etc. ge2e ge2e_ckpt_0.3.zip
GE2E + Tactron2 AISHELL-3 ge2e-tactron2-aishell3 tacotron2_aishell3_ckpt_vc0_0.2.0.zip
GE2E + FastSpeech2 AISHELL-3 ge2e-fastspeech2-aishell3 fastspeech2_nosil_aishell3_vc1_ckpt_0.5.zip

Audio Classification Models

Model Type Dataset Example Link Pretrained Models Static Models
PANN Audioset audioset_tagging_cnn panns_cnn6.pdparams, panns_cnn10.pdparams, panns_cnn14.pdparams panns_cnn6_static.tar.gz(18M), panns_cnn10_static.tar.gz(19M), panns_cnn14_static.tar.gz(289M)
PANN ESC-50 pann-esc50 esc50_cnn6.tar.gz, esc50_cnn10.tar.gz, esc50_cnn14.tar.gz

Speaker Verification Models

Model Type Dataset Example Link Pretrained Models Static Models
PANN VoxCeleb voxceleb_ecapatdnn ecapatdnn.tar.gz -

Punctuation Restoration Models

Model Type Dataset Example Link Pretrained Models
Ernie Linear IWLST2012_zh iwslt2012_punc0 ernie_linear_p3_iwslt2012_zh_ckpt_0.1.1.zip

Speech Recognition Model from paddle 1.8

Acoustic Model Training Data Token-based Size Descriptions CER WER Hours of speech
Ds2 Offline Aishell model Aishell Dataset Char-based 234 MB 2 Conv + 3 bidirectional GRU layers 0.0804 — 151 h
Ds2 Offline Librispeech model Librispeech Dataset Word-based 307 MB 2 Conv + 3 bidirectional sharing weight RNN layers — 0.0685 960 h
Ds2 Offline Baidu en8k model Baidu Internal English Dataset Word-based 273 MB 2 Conv + 3 bidirectional GRU layers — 0.0541 8628 h