Merge pull request #2167 from Doubledongli/develop

[s2t] install ctc_decoder for windows

third_party/README.md

@@ -1,27 +1,26 @@
-* [python_kaldi_features](https://github.com/ZitengWang/python_kaldi_features)  
+# python_kaldi_features
+
+[python_kaldi_features](https://github.com/ZitengWang/python_kaldi_features)  
 commit: fc1bd6240c2008412ab64dc25045cd872f5e126c  
 ref: https://zhuanlan.zhihu.com/p/55371926  
 license: MIT
 
-* [python-pinyin](https://github.com/mozillazg/python-pinyin.git)
+# Install ctc_decoder for Windows
-commit: 55e524aa1b7b8eec3d15c5306043c6cdd5938b03
-license: MIT
 
-* [zhon](https://github.com/tsroten/zhon)
+`install_win_ctc.bat` is bat script to install paddlespeech_ctc_decoders for windows
-commit: 09bf543696277f71de502506984661a60d24494c
-license: MIT
 
-* [pymmseg-cpp](https://github.com/pluskid/pymmseg-cpp.git)
+## Prepare your environment
-commit: b76465045717fbb4f118c4fbdd24ce93bab10a6d
-license: MIT
 
-* [chinese_text_normalization](https://github.com/speechio/chinese_text_normalization.git)
+insure your environment like this:
-commit: 9e92c7bf2d6b5a7974305406d8e240045beac51c
-license: MIT
 
-* [phkit](https://github.com/KuangDD/phkit.git)
+* gcc: version >= 12.1.0
-commit: b2100293c1e36da531d7f30bd52c9b955a649522
+* cmake: version >= 3.24.0
-license: None
+* make: version >= 3.82.90
+* visual studio: version >= 2019
 
-* [nnAudio](https://github.com/KinWaiCheuk/nnAudio.git)
+## Start your bat script
-license: MIT
+
+```shell
+start install_win_ctc.bat
+
+```

third_party/ctc_decoders/scorer.cpp

@@ -13,7 +13,8 @@
 #include "decoder_utils.h"
 
 using namespace lm::ngram;
-
+// if your platform is windows ,you need add the define
+#define    F_OK    0
 Scorer::Scorer(double alpha,
                double beta,
                const std::string& lm_path,

third_party/ctc_decoders/setup.py

@@ -89,10 +89,11 @@ FILES = [
                                or fn.endswith('unittest.cc'))
 ]
 # yapf: enable
-
 LIBS = ['stdc++']
 if platform.system() != 'Darwin':
     LIBS.append('rt')
+if platform.system() == 'Windows':
+    LIBS = ['-static-libstdc++']
 
 ARGS = ['-O3', '-DNDEBUG', '-DKENLM_MAX_ORDER=6', '-std=c++11']
 

third_party/install_win_ctc.bat

@@ -0,0 +1,21 @@
+@echo off
+
+cd ctc_decoders
+if not exist kenlm (
+    git clone https://github.com/Doubledongli/kenlm.git
+    @echo.
+)
+
+if not exist openfst-1.6.3 (
+    echo "Download and extract openfst ..."
+    git clone https://gitee.com/koala999/openfst.git
+    ren openfst openfst-1.6.3
+    @echo.
+)
+
+if not exist ThreadPool (
+    git clone https://github.com/progschj/ThreadPool.git
+    @echo.
+)
+echo "Install decoders ..."
+python setup.py install --num_processes 4