You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
PaddleSpeech/deploy
Yibing Liu eef364d17c
adapt to the last three commits
7 years ago
..
README.md adapt to the last three commits 7 years ago
__init__.py change probs' computation into log scale & add best path decoder 7 years ago
ctc_decoders.cpp Merge branch 'ctc_decoder_deploy' of https://github.com/kuke/models into ctc_decoder_deploy 7 years ago
ctc_decoders.h add the support of parallel beam search decoding in deployment 7 years ago
decoder_utils.cpp Refactor scorer and move utility functions to decoder_util.h 7 years ago
decoder_utils.h Refactor scorer and move utility functions to decoder_util.h 7 years ago
decoders.i Merge branch 'ctc_decoder_deploy' of https://github.com/kuke/models into ctc_decoder_deploy 7 years ago
scorer.cpp adapt to the last three commits 7 years ago
scorer.h adapt to the last three commits 7 years ago
setup.py Make setup.py to support parallel processing. 7 years ago
swig_decoders_wrapper.py add the support of parallel beam search decoding in deployment 7 years ago

README.md

Installation

The build of the decoder for deployment depends on several open-sourced projects, first clone or download them to current directory (i.e., deep_speech_2/deploy)

  • KenLM: Faster and Smaller Language Model Queries
git clone https://github.com/kpu/kenlm.git
  • OpenFst: A library for finite-state transducers
wget http://www.openfst.org/twiki/pub/FST/FstDownload/openfst-1.6.3.tar.gz
tar -xzvf openfst-1.6.3.tar.gz
  • SWIG: Compiling for python interface requires swig, please make sure swig being installed.

  • ThreadPool: A library for C++ thread pool

git clone https://github.com/progschj/ThreadPool.git

Then run the setup

python setup.py install --num_processes 4
cd ..

Deployment

For GPU deployment

CUDA_VISIBLE_DEVICES=0 python deploy.py

For CPU deployment

python deploy.py --use_gpu=False

More help for arguments

python deploy.py --help