Easy-to-use Speech Toolkit including SOTA/Streaming ASR with punctuation, influential TTS with text frontend, Speaker Verification System and End-to-End Speech Simultaneous Translation.

punctuation-restoration streaming-tts speech-recognition vocoder kws streaming-asr speech-alignment tts conformer speech-translation voice-recognition sound-classification transformer asr speech-synthesis voice-cloning

Go to file

chrisxu2016 d1ee10be10 modify audio and speech		8 years ago
data_utils	modify audio and speech	8 years ago
datasets	Add function, class and module docs for data parts in DS2.	8 years ago
README.md	Update README.md for DS2.	8 years ago
compute_mean_std.py	Add function, class and module docs for data parts in DS2.	8 years ago
decoder.py	Add function, class and module docs for data parts in DS2.	8 years ago
infer.py	Add function, class and module docs for data parts in DS2.	8 years ago
model.py	Add function, class and module docs for data parts in DS2.	8 years ago
requirements.txt	add audio part	8 years ago
train.py	Add function, class and module docs for data parts in DS2.	8 years ago

README.md

Deep Speech 2 on PaddlePaddle

Installation

Please replace $PADDLE_INSTALL_DIR with your own paddle installation directory.

pip install -r requirements.txt
export LD_LIBRARY_PATH=$PADDLE_INSTALL_DIR/Paddle/third_party/install/warpctc/lib:$LD_LIBRARY_PATH

For some machines, we also need to install libsndfile1. Details to be added.

Usage

Preparing Data

cd datasets
sh run_all.sh
cd ..

sh run_all.sh prepares all ASR datasets (currently, only LibriSpeech available). After running, we have several summarization manifest files in json-format.

A manifest file summarizes a speech data set, with each line containing the meta data (i.e. audio filepath, transcript text, audio duration) of each audio file within the data set, in json format. Manifest file serves as an interface informing our system of where and what to read the speech samples.

More help for arguments:

python datasets/librispeech/librispeech.py --help

Preparing for Training

python compute_mean_std.py

python compute_mean_std.py computes mean and stdandard deviation for audio features, and save them to a file with a default name ./mean_std.npz. This file will be used in both training and inferencing.

More help for arguments:

python compute_mean_std.py --help

Training

For GPU Training:

CUDA_VISIBLE_DEVICES=0,1,2,3 python train.py --trainer_count 4

For CPU Training:

python train.py --trainer_count 8 --use_gpu False

More help for arguments:

python train.py --help

Inferencing

CUDA_VISIBLE_DEVICES=0 python infer.py

More help for arguments:

python infer.py --help