diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/README.md b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/README.md new file mode 100644 index 0000000..4677ea7 --- /dev/null +++ b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/README.md @@ -0,0 +1,131 @@ +# README + +[BERT开源框架地址](),最好读下README,以下是预训练好的BERT模型,这里用到两个 + +![1609825905750](C:\Users\Administrator\AppData\Roaming\Typora\typora-user-images\1609825905750.png) + +> 点击即可下载,里面内容如下 + +![1609826152438](assets/1609826152438.png) + +![1609826160982](assets/1609826160982.png) + +> json:相关的参数 +> +> vocab:语料库 +> +> 其它:使用时的是加载文件,如训练好的权重等 + +![1609826290795](assets/1609826290795.png) + +> 下载一个数据集,使用脚本命令下载,可能需要翻墙,可以访问我的百度云盘进行下载(待补充)。这里只用到MRPC + + + +#### MRPC + +内容如下: + +![1609827571649](assets/1609827571649.png) + +train.csv: + +![1609827493014](assets/1609827493014.png) + +> 二分类任务:判断两句话是否说的是同一意思 +> +> Quality:是否相同,相同为1 + +test.csv + +![1609827666717](assets/1609827666717.png) + +> 没有了Quality,需要进行预测 + + + +#### download BERT + +把bert的code全部下载下来,并解压到指定目录 + +![1609827887131](assets/1609827887131.png) + + + +#### 创建环境 + +~~~ +# python3.7,我的是window +pip install tensorflow==1.13.2 -i https://pypi.douban.com/simple + +pip install numpy==1.16 -i https://pypi.douban.com/simple +~~~ + + + +#### 参数 + +![1609999902323](assets/1609999902323.png) + +注意:是run_classifier.py文件 + +![1609999954700](assets/1609999954700.png) + +~~~ +-task_name=MRPC +-do_train=true +-do_eval=true +-data_dir=../GLUE/glue_data/MRPC +-vocab_file=../GLUE/BERT_BASE_DIR/uncased_L-12_H-768_A-12/vocab.txt +-bert_config_file=../GLUE/BERT_BASE_DIR/uncased_L-12_H-768_A-12/bert_config.json +-init_checkpoint=../GLUE/BERT_BASE_DIR/uncased_L-12_H-768_A-12/bert_model.ckpt +-max_seq_length=128 +-train_batch_size=8 +-learning_rate=2e-5 +--num_train_epochs=3.0 +-output_dir=../GLUE/output/ +~~~ + +> 配置完成后,run该文件即可 + +![1610000183063](assets/1610000183063.png) + + + +Google原版的 + +![1610000131364](assets/1610000131364.png) + + + +#### 报错及解决办法 + +class AdamWeightDecayOptimizer(tf.optimizers.Optimizer): AttributeError: module 'tensorflow' has no attribute 'optimizers' + +> 如下内容 + +~~~ +tf.optimizers.Optimizer改为tf.keras.optimizers.Optimizer +~~~ + + + +super(AdamWeightDecayOptimizer, self).__init__(False, name) TypeError: __ini + +~~~ +super(AdamWeightDecayOptimizer, self).__init__(False, name) + 改成 +super(AdamWeightDecayOptimizer, self).__init__() +~~~ + + + +tensorflow/core/framework/op_kernel.cc:1401] OP_REQUIRES failed at save_restore_v2_ops.cc:109 : Not found: Failed to create a NewWriteableFile: + +> 路径过长,需要将整个项目移动到某盘下。要求满足:1.段路径,2.全英文 + + + +#### 备选方案 + +一直起不来的,可以直接使用我改好的代码文件(待补充) \ No newline at end of file diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826152438.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826152438.png new file mode 100644 index 0000000..5f2592f Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826152438.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826160982.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826160982.png new file mode 100644 index 0000000..a155c72 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826160982.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826290795.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826290795.png new file mode 100644 index 0000000..4f872c1 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609826290795.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827493014.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827493014.png new file mode 100644 index 0000000..44cc377 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827493014.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827571649.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827571649.png new file mode 100644 index 0000000..153dc5d Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827571649.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827666717.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827666717.png new file mode 100644 index 0000000..ef3f5e2 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827666717.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827674985.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827674985.png new file mode 100644 index 0000000..ef3f5e2 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827674985.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827887131.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827887131.png new file mode 100644 index 0000000..7e5f7ae Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609827887131.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609999902323.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609999902323.png new file mode 100644 index 0000000..fbb1978 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609999902323.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609999954700.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609999954700.png new file mode 100644 index 0000000..3f9d9be Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1609999954700.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000124999.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000124999.png new file mode 100644 index 0000000..4f5df34 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000124999.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000131364.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000131364.png new file mode 100644 index 0000000..4f5df34 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000131364.png differ diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000183063.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000183063.png new file mode 100644 index 0000000..78e0428 Binary files /dev/null and b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610000183063.png differ