From ae96b519eeb8beba471ed9dd71e71613f885a024 Mon Sep 17 00:00:00 2001 From: benjas <909336740@qq.com> Date: Sat, 9 Jan 2021 11:53:18 +0800 Subject: [PATCH] Add. Download address --- .../assets/1610161435131.png | Bin 0 -> 17229 bytes .../assets/1610161444607.png | Bin 0 -> 4747 bytes .../assets/1610161459549.png | Bin 0 -> 7187 bytes .../assets/1610161474977.png | Bin 0 -> 10919 bytes .../assets/1610161499158.png | Bin 0 -> 12287 bytes 5 files changed, 0 insertions(+), 0 deletions(-) create mode 100644 NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161435131.png create mode 100644 NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161444607.png create mode 100644 NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161459549.png create mode 100644 NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161474977.png create mode 100644 NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161499158.png diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161435131.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161435131.png new file mode 100644 index 0000000000000000000000000000000000000000..f782e8369ea2bfc67f548f374d937e79076d2e29 GIT binary patch literal 17229 zcmd^nWmp|+mn;dkaR}}j+#P}h2_(3?6WrY)cyM=z;O_1koDkd{0vmU|%{epkd^2~x zxijRyp$4db3K6FQ`Ayr6HNNp90o6u;GDtv?;sG+KP=n;cz+bk|a?qi=&%RH> z`K`N(?n4RL@{u|Ek#G~C@d}|5ME%3zY*sm~FV7FnhZU_&u4kK;^R;?S3imW1)whwC z`vUj-8PCwF8*UiQ56%Fburla2>Q!RNCm?7Dev zYr#Fge!V;rb^{^!l^y$&_M6Qs_b>Sh2s%elLdjlQY?!_-t8T%VbSl~L!ZiI)H*0IB z>BBsgJ$&^YA00cjn*20wp_H^uWh2nE70uJ!DUh8O=`dm=b zI_u_)OvI-~uZTKQY*}QqwR5eBx{H^z1kP;0ZgRUYPGr>9XgCSNw_bm|yLh~A?0lah zWxqWXvuRsc<+aO}wc(E&Vlt#=>Ih_tiKzIN$0wk z;SxH?Wxf2_#Kc7VgH6jpL5cfG=gYG}hRd3li(Ti$-j+kw1HtPL(;_2x&)(4bEu-el zo9o^Frsbs#<(iG-#OxR`rK2= zWbg*gruxI8sMOzFFWES351|2{VzF+0Z0?2*G;Jg%d~@>he4^E4n`5~q>wS(caML`o zadFpl+;XVaV2KOdbvlya>5PqQ-XFMD9H))KmW5AD*xJqp@Y4l-GP9nJOg#T6X1y&k zI~n6z8(pY1;c-1B5q!Cu;PJdYjdx-U@<#B>z=c~8C-&-V?6@l5+!F~#KKmufbT($= z9XCEMBXCtLdsc4a6=vgok!CcZ+kP?rA)t4oU@7GwqRx7S_xYUZ<-CT!IdFBt_zt+G zLwkR|-u5r|x-S-I^B+#ydM7947Vbupm`s4{thhK|;*HRg&a(2Qy+`z>Lc5h+ZrNPg zSny($&1mm;>gO!;Uyr~#_S;{7U)QQeeQ5T2xGn)1m$ziO?WWXtIX@f&ck|PY&&!RG zke{$426fmE&YCm(dj^n0$hH$EPzt!u$3Q};P#^wD8TfBkjX^dR7M3+mkRQn?ZH;@# zYuO2^_)ja#KR%@^txGz;M?*eRnOgPRZ<0xj)n9+cCeAW|{3a1Mr{H?nT@T9}n}8bh z`gL~+Lmv+)UBYo~SF@UJm%k(l1U!?Iblku6S)-8x`lj_kU=CqL~~cj*T3wX%$QY z>M3Kf%Axz7{v9ZvVS#3F+WAc(^KgDuIHnr=N4Z!bqUOiCYEtKMgPpzDd0W%8PMhlv zo@dV|r~MCETU4Ep-ZxB$7|#r#p4=bBdZKJ(CTlh(-hOCtkK1RUUgF<^hvTqW+ntXo zG}b;(C{$w^_|JYX7oAT$Sq6O6u!0dpPy}Sq+!5J3e_1^tI{iC9bpy znE|dPYouG`abNe|?O~&JLr_Lw&f(aR=Na8Hd?Khru@|9~ZL}WAa4p z+%@3k=0YDP4OLPIb(eS$q|LAj{8c-U)TDn|lVP~OriD>)UvwEtzj|X`wQB&^i%^f@ zY0W2A74JKN)cJrW)rP;%ZYA*xwv5_?_xY`h>$T}Y8CTwP)Hb{ybEgy?PBjj7SoT}n z*bN(>;EfWtxnD0&!4eK`;wWjob4Whj;}e~|nf_d?P0v+4k56ptNxNo^s~6ah2aP^` zwT+)igi)~&BGFoUn6G3z9f_atz58tL|G-UgPprQ9ED6Y-$3dRh?t!^3F3@dPR&=*~ zLWp)38do=DJ27@uvTql!>wU(3I-ar?oYr;cuT3J_M1@eX-bUiKtm1jbs_J;!i#eE5 zAs-ticj_%M1oD^Om1?f<5igJWRLHNDcRw^;`1=@do6e8|XOUEdguuZsB@EjL20Xuv z9cQEvt!8;2FtQnF_G2}8nK1~yaYfcMDKo^mQerN!DP<-7|{{zPGkNf(+ zK`{Q=;gQlVpy(IdWQUiv&YYnw`{uE+EwSe1re&h|5&w}LF}Dg~ZR|`N2WX+>_XOan z=A}x5yTTU&)g}8n&Pg28UWjrb{Mmx;ChoNY;EoC7*4Xd*NYk%8_rzm0@{D6;S~qLj z`_Tf)lsysH(d%jijE;Dh?}v2tewIw+A`lT^5@m4iE=@v<^Zk&^x%EsV1u<;EqwXF?(RNaUo7N=MLp0?EExa;sJ_Y0$o=gTUQlA zM!oz!jf11#x@9_(J-f(c)#r9Oc2>cA&XIhTWQ3^#p#%U;YnQY1nzlemdd50tO zagM496-i4>mj5I)n&Tc7>xvr*n*SyRT}0FdR_u@AW?vY+EesP1aXa0Ar|H3Nx@?;!)mPIw#8nZ+zA@aJKk?mM6X0P{ zaGJwmeRKJ?@trsqRw}CaMxX2%irhIrjF?0sx(}n za2w(gqOd_a#aIGt7qNbmYgvouD9Zyk;qP?6rzxmH)Nm(AmbFTCYzuqyHmg74AVw9J`?(Su-g6wub3 za6I#I5VyNkCG#eMf40J?A8k#rnmy%kG7S)2sAg>Otq!3X2tI=pJwyM3EI*m{yHD-F zHSc_EGL#oeKN48ho$|5u(VsW8e#jShk6Q8Hp341QzklPOguvLHc}MOs&lX$6Z9Jaz zzDHnKN9TL6WtLU%;BS(rjR0_;@i3P`D6fM5|AGT?Or-Li3*q2|5=7p29Md6x(fq}nT9v4FMfa361;i)$0hlgO)Zt07C zFR7v8qL_Z?v%cK=k%-gN!Fnmv&-F7JPFQrExOO2$zg|?7tqUSUoQ@x}VLHEK`#pl~ znC`cjEE`GVAk2X8eDq{gpd|m=;0lNl>wrkviAGE|vJNUKG91IY1-()d5QklZxN28z zZvIR{JE!vXy`t>hp&XkhN6G1;vL3y#{S>nLR;_miRE~N&|7*X~l>l%BKig0Ltfc(S zZNvqcAJ0da^6CdB7l#kb;{`My5G~e#Pt$aD(OBblfplTjKmuYIm=Z3m->qQs^sTp; zP0k8~Ez5#u)M@IXt8D85H?EC$J|9x!jrq*Cxe1J7Lg^>kUQW(boeOOv`FpOCWKCc< zreD>bwq4d3jWlgV5_zA6=`!>1@Ju8k_)SWrgQsv44^^5GwUN9}{fQwaXIEu-Gg7pB zffh&+C}w6>@y}L@+}eBSL))8s;| zk_hAzEyd_mEwuy95nZb8vzs3YyMJDAg&0e{zL{={Zeb}ThQ^_~<9-`rxH-)5bw6A& zM0`23)*+t|s&Qyu;5ehk&Z2Vh*Y`~0Rf#&-P~AM-9{c9Wy|bxgs=aBDMQZit?tLOg z7Nu8+1Gq=>)S5Lo56fxI$6DX0^B;@&{fkR3QY!_OAGOq`$Crhb@=L!Usg%R1rc4*; ziL}Wjtz-_Lvu07#>k%+G2658<9>uFj4AE*vP2J@7Qt;<5`dCLlaWH-cVf3?+_7pih z*D0I?c-lP3`XuyBm8U6)Cq&J?e$ea?Z-J+N3z$be4sGD=`y7T?5IWA9S*GHU0~$(> zC%L60)-Y8F>Hw7i6}=qrO8pcw&_<={-lZ7L!Ul(C9!_@G0qD2nKWn6P+C{#QJ*Q~+ z;9fnDBVt2OOG$pd{I)aG4+ovA?6g6s$Gu5~wyL=C1Rau)k!)bA8n0&=A4}T{!48`wRrv zHr=W!^ZpXU_`7Sm*e(GSL;^kwWCCUIMOcuKLjsk4%%7o+7w(SMJM(18#z#8I@7 zmL_M?B}_1dLbwDT{Vr;x&>l_Hm7!{<`+(vt2A%McXM4L@=@5f1Y1K=C{a~2}LGCL8H!3e(Q(? zgyGDHW6w_y<^7xyn+9q5{ai>EXVPhfbHiNZWgsKlJ^GMI%Q+?xa`%)lHj%68_@V^T zH2`E_-!*Ph-Q)nl9$N%Q(}qKAD5@>foHWTc$h;#&n)n(pVuST(o~0`Uzc{-~0)X1T z<>q^3{t&PALF>&w<1FM^c@G1cXye-xaWjlEhsfg=DArwpzP@Q?*5ZfAO82r&d#PN_ z9a|#aXTf6x0uOfvgpHMI1072?$(=GlBg0BSCR5&^vWHnb$;`hYZUQI%S72n3mFrc2^%UXAyeE)jFxFJ{5{jWErZlZbQ4=& z8rN@}i?)ZzoQ)ZVy)`J@<>xrmzZUz6y|~AlBeYE$$(h1Pw5qw!Bc1ciRAIoyab@>u zbHkD4Ropp`TXw5Y*B4(^E7K6z018D8yg94kY$Qk*Mt^-AzWe>WGWFUZPl1UT za`E|2A3=+`ik*&!V?%%(O3BF7*sKXe5`KWWL#Q>^akTc2|*6k))_A1(YXIT4cSVD~QE&hPjHvZ4~`RBM2?Zakf*_iSr0 z%m{(Z1gF-{?61nk*eaDC4gZaz2rZz%cH6;`NGiwSkZ-{ftDNJ5^U-=vFwy4eMlZ!X zI6fj2pvQclHnwTsEGH2&W~?rO9D#2;;lc&1H5#zie&VV)E#~D5?H*jOXNFK^uJ2Ff zz3KyePnXktx9k3*WN3ieBg2@qb><`p-5WkV4s#YQjLEiGh;zgeck~0sL*fow>H95) z(dfnK5AMKpB*mSSCQE!^lTmBxfHcq3&b_5(1clUaUKecJY}$>FSDZ6#XGT@`Re$;O zo95R6dx})hAdyEnAavBYUzr0dJ}|=6DFqz08@Xj^`oNDj)0Crv_DbIB<2}MjKdAqr6-5=Qb~G%k zNDN-C$s9x#hZslRF-2Ma{=Pn_1ILyoX&IUGWrqngvdHyRCh)mf(?if#I3Yn^DPIH&PHPpTj!n?Uwg0F>L)IrL|SDKjdU8TDw})>ySL2+ zb%pjcOI88b7bcNv654f6hE_RRxn<0TsU7XI5KK>wQs)Hd@ybXI&chv8=K4Bbg)+3NT}~p3;2Pk9ta&tz6S`@s7K#l zDc(O5t~2Qr_ThbvA7p!(RmriSy4|?XeK+1}Sj4lc!gC@*X5aE8jcnLAGb83TVMYS| z9z9U+5^|Lf%FTL7Y=CYt`xZ54){$Oafie>4+aL$w2|scgG6q-BMXK_VBh60E?6i=H zp95k!ftyL|ib_cjOs2Zfaoucod_sDG0v5E8+7a*}hviCWvs4#M%ESDUMs|k2);Jg@ zt=mcz(+A!SRtuZpz-0Ew)d?RRIoK{}AzL9i)z^pLUlw`ibnKou^C?{^c$IsW^*>f{ z(9v|d4LfwJ*aY5NWX*{fT_o_RZ{-vp($h@~YtmUIk6#t-OJ51YlJTn2M`H5kV=y-2 zCn>ltTQ6I4NzjaEd>Cv!>9BCK!S%k(BaU%@dCI+&rb3nfOc{}&TVHiWSQYl&i4A7p zI|X>Je;@gwKu3rIuZSU;bCjS`#jBcRoyj84b7q5tB`xA7D8OsRKs8WM_*ddmLY0je zTy3F=1yX7g5p==5j^o-Jv{pI{ad>U{GWzPU!L7FYKc!!5)sc_ZCOW(xxE*#88I!`K zc*lTJ&ExajhH2--!6l20vVkB%q2Au+dNN5J_`u0AFUyTaQ6TwHR*UnC#V>@pV>oSs zm|{QJl!V=)S-Tzb1DrxkQoS9iGYlz9X8QZm0zKZjyzv|1ljt%(&%n*kIkj8Pt#|u* zQLfW$p+lDB`E+@2j%;qA}17FQ%+(=kgX#@;L+bT^E>_&YMPpS2>^>?aj#? zP48hqwLyk~<3vL3*NYbF_2!roG=M~HT+wlFE|bX@Qdt^ySlO8=TdwiR#f59ZvY}aA zN+B5M%SRVg|5h4~Zk#KJ4EILsUR^18D?#Qi+djc^(j~|5!J`439}4q8XZ!^&yu>>4 zY=6B0qE`xx9sK866emmJcEAOzkiaj&4<9Axt-N1Dj(s@uM&IZdszw;_ezsVM(by6F z>*sVN1+w-mbRY2A+uO@Jk9mKkAgXFRVcslzFzMb6tM2bJ*ZOb>itm|78qq#T#BQT_gV(Y+3>|2w3L zd;kE19?Nrh=lk1}I!Kr~^~cHw022MmvUBWDGt*hlYG;3{NxYf-*o&_N- zyDwQeIy=|=sEzCB5O@`);}x1#tP>eDRURdmUFUg`JT*;^UA$YGGw#a_B#jdog>?h7b}9u z{AvzfZ)E{9x=I{QPMPGV6Jz8e7yi^Iod7yyaRhClw)0uZhfj5k0;+|Udo=l}p3Q3n z9TYttc&?u!#w{?)m}!s}?s3iZ)E$!Hsx(P6I~cq_hb!`*%dlpC)6+eKZBf)kVQZSc z^)Sn4(RPG1RE{e%ehCcp1-dY>b6Pj_(h`c2057Zm-d;8{Ec$!7t97f;?#y2uzuXc; z`ngFlNzAj*Q)7Fg8H93`xnxgz3)GHM$C-bJn{TcS%x<#J%1nQt#~&{MNXWzWX_?f% zv=_e=TG>_m#~LZOvgXzi=QsqP(fg4_Hh=yeVSqTRe$Sruq#frJ0^2v+Hfy=^5%Kc! zhGuGe0gMWZsI6Ys`KGt(DW$o`&Csa(+a_dr9^{OJFh^Q#kR?O!yD*K3vxRC{@_3-p zFYDRW337}D0n5OmsDpCheyHZsf0GLm_3sOPgF~#T;mG3=%wDaRTh;TY@e{H4|vIRwI6%>C{2({#tOv4Nq+PnD5 zii?rGNhYqa}j8UibC_&5G{6E?ZKMT$T$k12ebEHu@26&wm&A_zHuUI zEs`XSR0F1>j_27Yz;QKn1}}c1P1y8>CDOCB3>PPI3(&M~21q|6&>c+TIYgJfCuu)T z`I5PCH!MvzN(Im=PNT^R#5&F)<64M*MBO`2qO6I*;RLz`z^gGCPv5vb+v=}@j$sQA z^fVhanh%*766;(y%Lnh8_dwR_80SeZe)0-Pl7ZKC|EP$WVxjF{sl+LEEw7S$94kBl|Zo)+p@ekwM zv~^F*3XTB|=x2&|`VZIO?J8K|=6}rs*z*wS-Y7DUa$6bF#*#0+>+2KQ-MiJ3onZkK zIw|>aUf=G_#V<*U{`}NNlsX|Wqg(vfW%Njg71Q`5yGllcm^|-|7aQFhWVQEx&*hF9 zKQ!kw&8Qp>t3i+0%UvQ4gc+q3MP|mZw;LlP8XbjPL z-2op_206fJ|CCn7N>TDS{lPeJOqHVSHH_jP097pm>L7-Y;+k62N(unBHxA<^4Q@9vlG55J+rFmuQejc;YJGC7={N77 za#rcxDl0ikj(LB0(J*I=@&z6u626Qw%QHD;LY5w7r_sxYtf_kQQ?HxrnV~JobVzy7 zu@}%Y#8XHj_@7rTJ_V)mgyt)78x-|H~ZLrPG|Ys>@Q9zR1Gf zS@nyu;O(mHm5--Yt_;E#!m~WMfdW2qEKw1;q%8f!Qrg6DQ$cUSFEZ-tpR`#Bf7E2+ z&aO-vm&c*`EIf}KYBDSpTDJzp%rxAR^P1J>TsB8OP171K9#yt{kMKdU44P<*Ea-SK z9#$r@-hJQ%)77>LwIiU3yE}pz{VlX`d6goiC>32=9S;;1OzOHJExg5ATezJdi$%iO z-qd14+g0E&{(q>n$fj^Agn%qOix1I^sFWju>|>%^-!#C+6L;-g9O&=)=tA zwp!e0inX&A!wq~pt{6GhEl?k7yibmj61pHf@b6yTnTCG>RK zxHUmSycx#8hAz|X?68z9oaW$)D6sem*Yd&VgT?hiFyr-Dcy`K#w=uH9p&I>sZi`9Q zY=e*6oPizdw7|q_{kio@P$#pe^uH+LpV&;H31}TNhDl0EElg_`=$YD1-;$G)8)bWW#AYxc-4@dqpzz>GV*m0Dm)MDubih*Lsj!oFy^)<1T zHLyy(?&|4i#i!Dg8k;WzX&HGI4Us9=ZUsB3cOC7T3%jz+_SB#LOoBqhIuQ_10ct5D zg7tTw;Be5UZ;Zn zX6?xh`6i6?^dp0u&gr=Xh@rYSk z8Y4qgX-zp#Z#%9Xni85pg>NPIKjwrzXnpiBnQOZiQiH*-Ez?xO(*)GqY{n4A^wVSKA5PU*F;daZ0j0xWZvZg>0%B} z2vsA9Jn)#SnZ8rAJ-xPN#WPAdxr5_J)W%=S#%+U9J}V|F z*&Kyzg?o+Yek65>;_xeGc@YkEQ+6!UgCT6m#n$YMAMvf4oM6+I#;f%gVAECH5HZZa zn^6J;d&>iibxScxpHM5*2;9V5r|RhZuYZ40c^b1Y8dOmeoPexUioZDHKJk8Vt0|ou z3rqpL`&U7W(u8U^tb-0$@@=aSeESxT$ppYaF+p2yj|0_HA!d006f& zUu_uO$-K79#0P-bZ4ZTMm3KM`psE94lO3U;GdGsTb+H-7bpD$3vY2C3D8@kHJB2Vb zG~_!UB44&2VE~dh-NSFfc!r#eSF>^TDt-x3gkbriW6?ymr6ItTtt>KMe1y=j03^MC z2k?VY#Cycg8^o>;;KuU&-_iigH{asxRk*U0Cyej4v;*XRRE#yg`MA~gJs=TY$f35h z(dcNr!ZnfmJ}EM>fD~Cw*Vb7TP=kSD#h8SUkFj8xn7_?DN9YWwdsr|(?RLo}{YmQH z0fnVIj}B40e)ed!J&o{#^JyQttnKB#{Hp5~Ql|I48Ik9y5LpapsnLciY2@s-CCg8L zzzjbY?}tgK(;)nzYk~)TKGgeNJ2n;xQf%|61djJatcRhRPVs-FS>_FO59vkgMU<); zQyXN<3Siap$6!{qu}^@)Da(I_fsT%D6jDM(Mdfzfyax*IeZ3&)R5GvX-p*aX>W)pG zRthge^1`q`%i#cQ*GQM`kNAD;eZo*Qsel7wsTjN?s&vph3-^TCKMw7XB0FF(;^Mh| zDkoZaLRgT?H{V1?#3ik@!=*)d+Dch;=ls9S8i~0=m+TlE=#YiDL04Fu$XinPu1h%& zVoHM@K8AOKALB{9!d!%O2LB(zWiftLY%WHScK;YQrT#=YAkV!jCds}d3ica8w~gzi z)gOpz>anYgpcp93Q^2jI2OV?O^_WUJS;j}_)<$V-yoC$;MiD37ukf#5pnO&1l$O;u zloPwxK^H1`ZhNs-&wTh#(7o2f4Q5@Z{a~{`5>sq%6T0;anJ{UF_;Jg5=df;aq!&#vq^gq7JPGedAwAh1xm3W$8>UrXeFuX! zvE)iOyBZ`UKv53{qj*c{EAlB}s<-j6SXP`|S!E1kF=?;F?{?BZq~Tw2>Z_VZ%PId@ zn7|^QC*Rx=g`2-ozmA8+8|4}58zQ<6r=S2;L)dMnp{aLGh9+>8Zy_*wr9@O*EH`W; z66KGn_Qn@TrK^=AY(N5hM^0fVTpWAW ztrl?*vMS)`3nA~<_toCIdt=Bk_@<)+VRm=_x4Kp{UzXWR0F#c>yC_!MJUcoo#-$&1 z^)eYW?$+3jt{9BaR8+0=u1~cN29;IJA;D#y1$kqxrZg}fo&l{0K79d!0p$EG_?3%8 z3$@s`aV9jl0?l=aF|wR?A`j4>;5}P92Q(Sz#7SRa?3?Cq*W(p#VE?M2DnHa1eYEDl z?*J-#aCv!kNTXITZ+i4l__2r?*;@;34(SC<(qmSJ&3HLU6n)xI?)+Qo#iox;&qD{? zA95g8^Z$w~M|$ctbpdWj_$;1?MP1I+BDGh;HSTN&KyPdh_iT(VcJX(YECFl|&kK~X z7}M6heQPmS#v+J~q9%x`)n@Cfs^b>8WYd}9^E4;Vp88VdcHx;!2kN2U*v~1=;V_k6 zWggm#Flg!Z6p$UiS9jHMU#Kx!wi8F`yzOU7PESua8G#lueLsG^k2vB~+xd`VkvWXw zeF_P&xVZGC@Ng##kQ}Nv-duR`>v9YAFX@F5l}G&Qw1O`T8{`0k2_FkPAKyU`HKx5h z3qHdtmgE2d!*@%QPS58kqgegvZ+@R1l}s=unB`hu7#(Z4DN7fOAF4l*wR^o;>XF<` z&@_u#&MaBZZTMx(I5TW`CbxopjbBd#3L_kxm@;GLD3dsJ+~}-<1YCcIefW^H;?L{9 zT)Gl*@J5yG@ZT?oz@)y*{jG;$9M^E~967Dq{KJ*a3ciP|e@fT{n;~shzWg-{Few(X z#Xv$-qd=sB@cAT~AKMK5)*tE#6-f##uMts0m0l#%KKFq=@BMFR{c0c`!#1jK(QKIz zU-`!lJvrZPSh!+h;{a|k-g0AO1N1!H$DqiZSEk{&PGTuMw+YpY03m{pX>N?9IwD%3 z1(LS2WKpp<@(8*eDM)7NSVe6B6h+{rSPH2?sxXl#V(~PZJC~aILpkLe$Cj>6fpzZE za-S=-md#P*+aY^J@euU^b?J*FY9X=#`&t1By%>-Bv~*U5TjLV6P;n zENjXrim1h{l19t|$pI++ELY2(1b;xXt3uLtLh|+hv+mDnymj`@p@JT5m5pvw0k7wp z?bod(j5DuIsxa!GjeqaXYf1r|90*@!o6jd3R22@$*=t|~Rl&W3dwAx~(Ex)(g{x$P z3VJa85#SxTMJ}u)N2U^Tjk5ep6bsx^!rm2m=IITew!cW zYlQP7p@#q*dQ>POh}W5c3W)!5ir}B}>~5r{|1HlZ#Kuc{%Y}!X8a^d9urGRm+|l;v z)bc^FubjOR_vCC#_a+6?bnIaC;0_!B z9RCYpt!!sjJ39mKFFPHGV)rZq7Rmp>PLFJ3$57!VO15Ex(nq#iNE&yB|6e-kjO84> zSWvVVNc1}JMB4iMCH2NP$16wk)&5kOu6{tI?0f*<=Jaw}_5v6%co!lH3_N^j)`}dQ zd%{3ulhKTF9U3i;#yg_fQQOC*fZlm9fA1%Q^h+@&E63P9$hC+pxHo5UKxx)wL4NLf zlLvq;^UM6i70m0ubTj-0WwX3;sb+q~1sV|BU<|ta|57OeG!`|KJT+%=Z*jd6RE}uJFGQz~-BBjw{S7xs9>E>rr$W{t^C7%cOU@AlrnW91e4*_;ZX)=wuozhWV=l)6S)}v{4uF8JS66?; zX7hI+&Sb;^yR?%|>>1SLN>fL3b!$&%@#pZk0M;m$*DNUL6T=0->jg)LaxgS;NjKI8 zs`k?-$p{XncG$nlf68gyiu}+7NLJLGF*;PDqXyO?3lH&fg-r<6$e-7%KevJN)GA{7f+FDI1&CKuv+j9g3tNVgb9@$eWf(1sjAv+Z6`kU-EQgdtbIvFcP_!@^2nm^o-RkAUC3&M3hKsCSrjqjURA z|CSl$Klbv%E*qOFu5Ge+6PSL6({1}hL1eTpwxzPD)$qm4B7;})a+z`elv)d3M#j1N z?A~OrZ?#`?%f+VfMh85)x`P=Y_CL=fz?T)-*qVfi{)8764f?blFlzv>eG<(BdxH9R zI00%9XeD#9^u@xq4*w32370z3{2fSDqTCC>+WH(NW6BRS(au2_MwOzlnrwYiNZ0EK zRK`Zu@~GL&;wHUtK+2m0^+AOA7yN6Jtqt>UOyTgBhw3{@o#IBjO9bLS?YnoZJt!@o=9<$L+rcS3!Uo8ErWK}mc zz_YmDlw7dYhdZhSKxuXa=W>hxnAP5V)e)pjDIZK|o%5MEaioK_A@(A8XoL&|uy}o@FGiy%e_h1LvrCDoMjxb$*%+ zhbhr2K)o?VsxUgZVKCFIP@lN0?*rysseXI?z4k)l*z>ss+YARf7Cw;uLUCJkB#Igb zQgCiS8tMyWTsp5)s3Wg5W!y&fAkh{uR#v9do@zK4c?P7WWpXn@D{EHhQFY2=z=*Nj{fx%YQ9^`)Zl%*bDQTV>oZ703vOG z2ysd@5?11+^BQVUPh?=r^J3;SA0gQ_(&JW;fLWox?oczs2qB_gtffjf?a54;6ea!} z=-#Is5GEJzLxn8ljm_3GUDy9TEpZ)&{g=kX`qF3$+~4)Bh!u85`*J+2DN-xoU-^B4%&_=0k5^y^Z?aJCZ*pvN96!KfptivahC+eRQZ4lXXuQq6+p*qBss0pJrgT?M(d z?!ydFme@?a;;3{|(_Dc`<|!xL8{SxgWh{!C$Xc!WkjxwEld;aS8{EH{L>0A|{M(+grLZFsdywMmseE{OKXQWRIiA^=S)3&xu) zGD|SRK&Hd}xBZ)o*HuP6C8XeIC^ z_eT>xJVOqzaacC-m}U6Ljw6B{?7LHGTHI3Uz@Per{{H|(Y*yyq3k(|TOEzF6}{v3`@%@sp2 zZ6w^oRjC3H5N{t}|1SWM`09dnV?s%luZc?ZhjI>TWvv+%R49|zaDhm1iKmWHRy`xU z4r3B|+|Tg{Z6{OCdYv7&2mvPc-PsPM>0(^yy$!V-Hbh8SeQFI-=WCuOOUB@apq51q zF)zDl1A`;`NCZH4FbtHT2^;|rf8H5b@K#_>WbePHJxi zHdOrzM1|vUH8{fpEzz1OyVpbv07w19?^<2?#!D+ZB!DP!*YnfSQezaG$@sc`^U#lJ z01MME_9isZRFg)h;rx1mGZySxS3EDL#M^+ZTidCN&)~yJXVl2f=I?Ea7w1cAlZnio zAts-nmEKo$bU6Ca6I?Rk=qM={{DD^^M~4*&U`0}i$mD~RDUwcd$!7M=&GcW*=}r`?l;^g#rde`+Xcw2teRGe?xm2@5a20V< zw-|+1HpzRn7%eKpNNtM)-$z#%GeArB&})*DeHCZ) zTDpT%w6EsO*#7tf0||5hPTqab*2gJpzt#Y}E8U01xqUF$=*ej=X8dc@pOVt1 zy;Tn&Ue_Tk9-Q)Iq2b{84C;lRIzz5v1EEr=Xr;_bp%2aX^@MmXS~Vyjz2nz&6aCk* zlrpu~v6OmNbB?YL%wI=-8x^3IC8*Y$d8D-r*a`cZj@$#eRB-`jMBp-o5-k$j%y*SH zu809c@|g{s_xJaqB6y8UW5Bpk=&G(j788H)-1p;(KOx>PSVsq9UYd_p(YaammW=!_Q*Y(=l=^IwN#~iGcuEi&&mqI(a~}J%r(>i z_Ps1)+)s86aVqwn^g#q5(p9#R7b&f{4VClh@udq}WqbtFwgUJ!84zDS$%s}6>-qg3 DtC80r literal 0 HcmV?d00001 diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161444607.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161444607.png new file mode 100644 index 0000000000000000000000000000000000000000..698934e628eac5321763fdb3ef8f2740e634fc89 GIT binary patch literal 4747 zcma)AWmJ@1*B&|~rI8$zj)w*j7$p^HDFNw{?iw1Ip{0~YX;2utJ4A^=ItPXZ2Zk=G zcYNL-@A|%Pz0dmo-1}Z@U+cu)*S^j^Ct6EGg_M|)7ytl}K37%L0RXUAG5-~W_?T}r zFc1O&+}C-o`1F-u_8!8_N!K8k;9%c7bVXC#9-o)x^{&v`0UK55-Z?rzSQ z_THkHoLwlv(19^lo*YUzNvX}smNb!M*dG-7q;3coA1`UPd|sVbPdLkdFeVfTML-0_ zx}Lq(10|a#Wd~Kk)=(kUu>Dhak51Md+PBN{0|w1zaOv~M@=Ap4AjMba5_6<%Ku609 ziX>_hR$y}Yih`ofUtp*zaTGb_^X>z7AP>Eq;zPV%2(-}r52&TLq`I0?PfssBGgG8S zR?(U=wq@)1U`4^CJ%C13RMdap(b5tdH3Ng>b5|EtS8La51P01X!^{$+qoY%=?46um z&f^1$i;K1N^osmp?d_(X{N6h#)KD2hITr`WF&A?Q(P>9|wj*Cjx-53>Ei}6Cj2E>D zcATC0d^K&Q%>y41MN(83RaOexq|+DG)Z9-=Ny)UDo}65-BQJnsC5<`7UP6u#zRT|r zE-F$?(?N%)r>85u*O{4&CQWYLrJI>OP*0FGzHx_qDhCILVS9l0{Abm2 z@B3RZla~e4)6=t86%`eRtv&)Qa$snC;Q2Fc>bl0pt;vSu+*ff~WCL*7aa|BC@4gto-agBR z!N^_PPiZ@De>)Pg|0OL=#5V2-CI1u_h85XsLCF4dc{wqKOLKK+qJ&#OK*`lrD3U_T zV_g;Q%+JHq9fm{jY0ER}89VrRL~^#p+Yvq>z!=2Q{(7nKyb-+Dc9@ zJ0pX^qyx+lAh&gMb&dtdl5mb`{~&dk?GP?)hS`u|vxm*nz~B}WMMl4EUx{IzrVD8rAe8;GitiR?{F2bs#aP%p&MA;Au)|qg1zCR#{_PQFJ86GAPG;N7= zlOmDL^PDJF$ArIrvtHbB+8hjKdPZ1RU(YbVq!>*FUt3!GVTB!4SyhB*FW4B8=ta<9zp*;zw3WD@~fi zC71kg$RIcmB%Hd+^}e|6FSUag%7$`f1FNhC$PjdhOmRoI-P!8dzeLPre0Ej+;hbDt z?&oOJ$*HN0pg6@#3_okvPv5WfLdf0!;O@>b%v$Y_l?piF#srzN)i04nw%lLe&e|H6 zC6NoYwoM8fAJ=I+Ukda$^@5PIDr4d!;kp!;lteia*yy?pcQ7L*B?W}y5Rml+$m{Cr zO1U8cgF{2wnA&K~*`aqQgT7?x%uYY~r zdc0%RO!xHc>|2AQqvOQFVq1Tsg6Ru2wf>0`O)J#HU=43+uWc=-oF6})Ya1D5oZXn5 zDb>B_c~<2`MoF`jf9pa=Nh9=M%KaZSp+C90T6oTx4R~+0aXwm=n5^}`tA^Tm`{9J9 zJVO9m{n6IRiP#4rGneg-X!{k5QHUyJWyRu^o}PuDpP`Q~Eq@fbc0v>c;(oZQbaH;a zhKVl;TMkBqq_rZpt}l-Pp~qXJqM=?G$+F=Q_IpLb7KCvcF)}i~AZD4mJl+x(6MKcE z6>xIsG#qR-RkSW{3y@<;94PgnNb27vV-@$K2PqapDi5BMFyT{BZt!j$M3XbZX0nb> zSC4QFG;;dnmhCl+Ww&qWuNXBg&DI8*jtIL7U_Za!=0J}=OhkH0bW`00Jdvh?Yr1Wu z(wUx%!t^e;^qJ;ph_ZV_LYVyBCuA-fJKN&p$Gllig5!GE?!r-M=i-L+@4Vx|jeIG6 zp@#wOO0&ldN`Y%7U3tdtK?ddL1>JRrK}^vdo$mVtO&xSyBb^pzi9TkCkPs52?rv*R z8<%(+lsixwqS=zGu8sE-<6kyoEm$egpS|p%YlV)*{ZEu*Or})udtsY!8URwbMI&3$ zU_2A`^I(j?(^En6ibDaWzW-^%mqTjd>VenS{X`Ok57vc>bv>dpgdj^39CIcqJ@>M3 zApah#H?-dW?#h1lgy*(ZLRTs-zx{Bi=`JLkPnM%}v6c#lJd`x>4%!I5v1euJ-n?Pi z#izLXg@i4A%R2*yiOQON4xRzG^8jDeZAY25A}X4KKkLn84@WG8sL(Avy~+B;2g^sR znWi6KiobIMrpQY00+6i26x!v*2=0ko2CxU^$S+JH$cB zG^#=peFK;|c6pR^%HJZLrh1lehf^v~e!_sA#d(S7=8%uck(1vCUyo z@!JOhD<+nx) z9oDeM4;S7f8$%#C)QCGK+(4o&zUWIZsW2Z~WN3QMI|}U3P>@(Cw3Lniz8p5iMAz`c z53n09!upbk$lS#AG=vs#s7mVsknWE^+<~iDx5Z&w5K`Wrw-_iF#)%h`Z_4|)C)2x! zndUhPGkP(o_?(ZTGt28r)%Rt)v-%V|?utyz;oN8}?4o|_YB$5$^Nm=Z0D89BNzG$+ zaB%Q_6aV99fb@9&RU3XkV0%uJlF9`Dko_id5_HcWE0N3}#Y=wxhK!O&w|{rp z6r>G2MlLo4O9HssJ~y8dWbJ*crvXqXoB2|>G(PA?%N3dw6kx~P%k+u;pe?q3Jy+`l zqoDX4;3Y%NJy$sMWGi*OMr+iLHa(s^Z#%qMo;2gQTC$*@6jw#TA6<;+f;)z=TTM$Y zs|c$-z(thGc96n95!j_vo&w+j;cfwm3Mm{@IdcS`;S%J;@{4i?`t7oN#duOBsp6~Xa%ME`O9iVgv z4(2<*A&_+|P018AJJNdS&a4!cFZSsA%U%Q@`X=`^7W?Cr^As5WJR=&VOyM%AybLwj z{?VKEOC#+43Ny$h);WLgg|~{s z(rD#XuXz^7#1-D-lEPT=9s*B=$_t{cW`IthyfV{J!X~XG#ctG+|Hv;5`Ne~7o8NAn zO2#;{2Uwo%447R=A&Ia<$sLM=wGa$MqA*dy#NO-JC*v{;2{rsGTJK~^QUx3%6QN7C z5K_y{5M8@C=uHXXs{+v@O>h0tUV5&$1ksMv#%~b5@qUMPYNnbr* z>=-@-+vX4P2ZO;v7M63RttPyu*p({ka>tod1GP=F$7w&O-B?>9LR*U%eyD5iKEnH% zD%KZ+77G4uTL+?|?#Ihp$h#7_3D4FY{Gims^?0|3qx+2e9?(IRru0;Ai-5tsG5wp3EvX2^+d(da^IQU86 z?K2;l;l^K*T~VBK6>Rz3#?3e4{KgHhd}N5Ne!QI%_)8n0zSD7 ze%C`#oT|nN4EjnbXZum@%?WTBWM>y0XB~gQW8G{G9E|bq85s8X5ym;PUr@G9I4lag zzw`XzG^3`p5H%X4B-e@J{OtTf*DNM2{}{v*^ZT6)FR-(UIdrrrxZ|L0fpTPkamC8A zdEHF~kNP9I%bkg9xy>X^g=bm`CXFhRzZBdz9Fbuh3jkuVNA)A*nmP+T%ywaw7x$&* zn(_yr)OaVoq|9fgR-Zs&U^T?804g&U@g9n9ujp2K`) z^0{Lp6OA^Kzi6ZI!*lV~=a3-Xb+lH1PpUHk5|z;^Lv0`KGpQ55_J%8*1#)(o=|;d? z6M*FW*w9b9*28SCDr%g|WIgAsk{YAbGtlPoV=4zb*q0)=sis@D{#a8=g)=zFt?c-b zY`rQ|{cIKi<wcg!3V3#uk-qdGFfGupJ`&?a^;fc_)i1EzF%a&>_NwCm3Okk zKdO-x6aZfnAew$K{|Hf9)#X0ib(UW&!XAl^=v8^l{~b*^IB>ALG0VV zDZDqob>nw-{ciV9GdnxD2eX)~DXLj`sz_T~xZ2oi-53Vt|Nfc^uJ}sqe_q@9KVqn; zsAHJF)r+zH1NT?{ZGkHsohBlb4o2MIE{sE|k8!2eeDD!nKEJRUtFC*M@X)2?Uyguw?77id$ zzhutG>jSRnUU>XCtJwpfL9Qd658=*k=|Lp<*cf{8BQXn&O%v}aL2e{Zjdw3l?oiuk zv-rz(Yd>^h-af>F2Tam?|G}zWq#FoI+dN+bQ8DGREe6*o_)BagZ539Iq9gcj*~az| z0>7TTryOA8Wx}w_|L;^#1UEJmR-?$;*gt1P!i%4H4A%7VmeAcg+pQ+7L@c--2t$dX z8_9H`pcL#GW}#=rGuRxwOpYgDVpG8k=%!7y87DrQj^L%;1DnQhX#Ur+W9Qn!~YgtwxFXNx)tLN+l!fNw(-u|O*(C?N`8)q|BPIEeQdu+g1Bb~zq n)0zd4B5fa$-T!{1IlL1I5LB|M9IV4UG69||X((1cGY|h4h^RQu literal 0 HcmV?d00001 diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161459549.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161459549.png new file mode 100644 index 0000000000000000000000000000000000000000..88ef84e439868ac19116eccc31d1d0f64a9f28d4 GIT binary patch literal 7187 zcmcJUby!qi-|lCIh5=?o0SReP8isCg=#Bvar9(hM7@DCZB}9-IQbAB+Na=2nluiLr z>Fz%Bd#?97&pGFPpFhtZ`+MzJdtYm>weS0L@4cgSw3JDSX@~&;0I8}9Tn_*M!m#UI zg!tHcRM(>p0MO2RSR#p>?1c5{Yft9l_7KI!6b69m zzVVol#DT*n+bopeDgUuBu5bjch{2dS)sO)M=l$lJS#eFz1X-BXE%^UkOcM-oy^rNz zxthDF{oFx8Bqdf#4@3+yz5P99#!Xh%T!sZ|YRMJOXy#wmm`L^<@^T%o8131WX{-cn z)z_AU&&)@jr%cV+b18F8l{G-;x$VMbxps~OTBexmE_?nS_B_66$OjWBjVR2aed#wv z8|6xuM;$EoTa>PxbR1huD=@7OevEs#oz_mTP$v;?%aSiujs?yQj z!Mi5O3PuMBt&f7Zo#WCyxj<)=H@Z?J1*&ZD*z|f{4_=pY0CDe;)FJ^cZNOIy*gc41O-j$K3F#Sc`3Q&SByTlbwFV=cwq`YjQ3S6LJHK z(ll>>kAC2@9&d;dC@USK<7F~`#UC0& zUH1*Nnqf-X8_eSb+p{EV$;x5O^nCuk;_KS2o}mO@ZGVu<;^ht5i98q>y}Gs{k~J9Th%pH;Gxm1Jh?eyX(`g$Z^~gtK!#0;zG)s*N^)p^( zs%zdh{*oQDROT(nw=Vk2bac|>8(%Bw>_nZ1FK`!34MAl&;h(SQl)R8u?m_R5k!$_= z&8^r;2x9nEj1)y>-}G?S^;j`HSF}13EHNjwpkaHitXTS#{w$@MdiEo^%B1A!!5-)2 z-)DZ!yiq$kIC}55L`F^zc=`teIa_kA^cfO_d^#YEE?UmW!JqUets;9Y)6u;&7*n+#RMXsZW2&lEpy&` z+5Oaey_jc*n${$~>)!Ly#e??=D$S#?T8$GEcs-e$i6RgQd7D>kzoe4zEE&G+q#2C|QA`hMRVm(mTMxvjx@&qtyI=4TcKrG@>^TP+2AvanN-MM~ zPj>K*5oIM30iSAO!aqBu@5K!yizJc0fcQ67jv3rCM+^+BH{X{f$RD3eLOLU98#P_u zn)La{{rU8vv}|=y2vFUndoICw^IZIDeucL_%oOz}JLXmLqIO*2wS3jMk(*7=Gt!Kv z4}EWsbr8NNN%uOO%3@}}UcdUla&k$Ww6Oj7S7_?@rBAL8t z-QXnU`t!r8sR41;8$IXe@$#%tV%s^#g<=!68SmQ>omn$dF~#xz=AJ`+wdv^9oF~3K zYZ9EuQr@AC2kDBr9(X4@Ne%}6R8${4el%?)HzdzqXbEg01HFfWYC!}HW zm>tW=S(Q~*GA(w})e0+RduX?NEcKMLqMI@mzP(+A@-($X%6NFGA^C&|)7szao(i5~ zNhqI}zyl3Y?Uu<+mE*Ko^B0&n6(>`jxw_1ZMzHmM(>$!%($i>6{PEhaskx6IzOiHs z)xru=*I)+o*|~Z7BAaVw)&(M7Pq%kEmN#M=iY$nxb)(ma$6;!6^P{#BDbAL?Ep#lG zLZV(=^rYg`)-4{oudeVGw0+;be(iL6b+xR0mkxhyBQvbQ=Y^#FG4x`l`n3{Ihgpcd zz23%?*+%9nD=(viV=x)2nB1!D;?_!e#2VlvP+GQD{Nfbvf$B8(QskvkTeSH0fDvv` z5ZRAUyyvZx@omLMkiZk}@@8_DhNB1c((gu#svC}slodzXANVMxJ_TdKXJR{?<@bU@ zLl6xkmUfglc^=fF2C$*=7<#OK=!u4X!mt-^>2hiA3ghP!Xa}MG@mG5fkPTKeU0aH# z)53EgfeE~dJOt*g;mVA?-Ad!Pj?t#~Woj?|c-3ZFeq9j-&#pDjMA{i#OTnC_5W{sT zilw?o&dP>2CGNchDRr7zBjL6=_LTo1hm?zExAApcx~t?b`{Z^H-RHB-Xoqo_+l~;e zO?98JW6Mrd4g!BfQ8xe=0yPe04O^xIz$fv_yyI6Q`^6)1=0ydyi* z81&}h|6CN>d+qK{%7QSP!x9n_*z9t2^wPT)7?o?)S3~ z$A$)j_emVuzmkp2+AFMk_rG(M@qgq2f$iY7W1!g(90CAq=FzR~(eV-8c z3tUL)a#6zq+DnGg-#&U+0SZ!=k_Ha@W~V65jszO7Dp_d&NYlpQP)%IGnZW+*hSsPnx^fz zao_2VBUdqhn=DulguX>JUm^kjw3mm=a5hc-WoQnj_kIH0E;L6KHTiDgoWENWwTx>R z?saVr`@$PY64|`vly1$;Y2LnPN0~@p9@@Ul%#F@!zvVE)2|NaoE!oyQCq+87MAB~_ z3X{vmb&}(xQFl*0?fFJ_yQvQ-v)tPA&>stBf=((cwsV{JJL%$mi`IRGy3hyjp@8o& zBBt_0NUBGq%ln;Kib;~t;i_G1m-ns#wVnvJX}AHCdOYmv9Fw{~(Jwi{nQJ)Igwq%( z6V?b69z|K`rE}`AO(Mj#!*V*eUI4=$;s2bW?+OZH3DzM3zK?S3O>7?=jNbQ{$wQD= z&2s;^!Il(d}n z?5>puF;`7RyIn|sh8xg6@CFEho{q2rmi6IYGLb67>9rOS${<#L*N%`4%mM z#gZv4WK*KR0I>(!SGKKgY`p=r)Eo(K-$~HkMQ;uzwrdpY1@8RVvpk=g-fw+(pIF4c z{4UxX**dZu_msinNZNb(yjSk5^DZ<9%+Pt8#IWr24&O~Q_}D1g$hE_J?}GG{&W~z- zm(y^LCD)|VM)=5Ok3{VHh>Fv3{PG-gr+`atF+W}HEpae29kR->7_yiC*}L}4f9Cp! ztD76MJrueqH>9txUqIsL@9*knNExZk3+j|z2ot7Kp7j2Zm~O~9Q2l8BQ8S+Q%>meJ zp}YMX{6w!j{bD7O!O&S*T3Q;RUi`e*JdmuHr1UjO#N^%L4$6ecgsR#$%V+z7YX4aX zW?Jf6h>TAx75)v9@(MO!=z|RO$}pC>6nKdpF}_G!2oL*My~mnHFZ$&4)XFN?k5nFe z-2gEb=wvLLBp|9U5UZ8Gd;g!yD}hNmz-L}1x0A6aDk|+OFZIlZG!y7F-Gqdnx(ju# zybPUa0_%By{5i{(D>z$VGc{2O-fzcT09sq%9rs3Z_dyqY*fvvj}uMg+wTAN zl2rwViIuoCS?;A==69e7XoMm08*migcnDZQPu)hLc344dg@J0HPpTJgfS-{(Xd^d806PgE)UH88h1vb_ zV4pvvo{v3iE^+MV*3K}VAW%&dB~zG6YzM1oA-V2;j(pMN6NzULp|V zoVZZ538()2;21q1xYS7h#`i=UvGDr7j5hVI1s%&9v^RnBFT#eCEjGv;MTGY&y1*}| z*%Y@bklh)1I^DeFaapV9EdwN7!;EI#bQHqO^8q-FuxkY;7!CkqP(b8W|@p0g5Vms45KRSMt>GPh~9YxDtZ0Ax`HV^Vg}$Fh^F+lsQm{e|0x z7_s3lHDhfKKSIkoXzV+=;tF=LuW^LIm{4OiRDa#|Mtw=dZTPVjXMX-Q%LTzf6jc;n z1az#s@asqtB8#pICNF9Qqynq5DNyq_K|9etcC&6;e4zKzvyamXCpA91-OOd~qMQd? zKlqOPFj4B@E%Bx@vvz}94AMSrOMa;Ldj0)28K7;0L0M{DX(o@>PXG-6mi?w3x_W5I z*nuS)KrS79^Sq?#f_*%kf`S4uudA(1{(ln8WR9)=+H`p{2lzSIG$_FOOcO4==5w@T zeZGA(a5AjCvxt;+JHiRhEb`Wh`if82zcqdEcfOb3`^5ERSbc|Q5rDkf%pzef3i+EX zx)ioMSv)#c`T3`By+FF;W){vr`<+c0O1vLMMNtmQG^61*4p<1<5dFte<11#pX@zUV zmlYazpDv#L&*TDb{|{VceHg1U47;r|G{ERdu$lFOnKQ{*%}$eNV6?@Kf=+!dxnG0v zXxiR4mM?Rh9P6Mh80V`d+*l(`UIvgPO+z9I&3wGQO z;(%jVx>J6|rWWWq?f2FCBbh9J-IrlfiHKQ_G>1u5V}`+R^)Q(1tew(C+V+FNk6O6g zEkcHT#Rx(5Fn-33>?K!2c)uA(F-FrVC?*1bY#{lLi{j(Ukvj&$2QHstEB;w*`KV>N2oS%fE_o%I^>hC2UJZt@eQSGiUQlV7t8^gXk1u+hYcs(pPVp zlZbKTX5LuB1uvrUmJ?a)zJ2SaZX)c=BWZ{pm0`>s$dLqVO9WwcLC*f>;Fuv)x!{BC zu!3*Nex16QLaq?j!>SDmYS8(T0Kki~g3F`L9L|{#D(g$y(G6wRbtUd{ZJt@y{}MG? z?01;#y)a2Hi1IyS2M3rSPncv>R1NG4Lu1pd1K0Snr8_6RLFO&g`qs-gWaeQPaC~-_ z;HEoNi#|T%RlicZ##D2Q0f~i4p$5+fdDKvgap2|diJNWnpY0t2{^&y7;4Ua#Y`a)o zCab(V9%OtZ9L>SwF^lK`b}nSD?+uX(89Ov;{OymqL^}8(tNbMxIz(#y!1;zaPVNiv zdhDPk6k2Uc0tA7YTv?MMR3;C&uMox|T|{?vGW4j8FZa~^(>S)f(^3j7&9pp&8aSN_ z-1z*CRriifBJ4Rqm>x;-Zr4Stu@EsGQmV4EvlrFm zWoJJ^A|HDg4v&oFVK5j+ht%JPt|7%i_z57Fn}fJTQRrkQ)^SA_$rr8xj9)ghD42_Y z^HP~mKsgd;w4vZ?9U-emtcj%y1FTto5_ZX+K5`(*1MYf5Xp zto2(9kNRpg#O2yTv{-EPDc@GL`A7k7Q1M@GQ)K1nSoG7FF;}8;WE9L?DTEJWuEhO! z!II;n{p{ZB{|I@v06YdW|GNK9`4{LxT*0uCjB}$bui+4z<|;M#gK|xN92=FyFx$n9 za+?ijEdIag8&7Ehxb3CaVxwrnvDgE2NhMr@oVi5p*Z~n0HU&~g*aLAxp$~&6=oq)` z?8ioOh&-8>-!?}sZcSNc-Bw>ochXQXzq4L!SoGmDCvNnp)vbm9e!VKlhVc~V8y|}1 z9u~oZizx5}mOc=iP$WpSAKte*bNK5C_-31Kc(K@Y|EEjIJZYx??a!up-oC7nU+a94 zul=3%I2@@@iR?@~^-_SnsXfM_2^UWgV|J%MU0(S@eNNZK!S>3@{yC!fqRd4^*l_Tb z0vN+LxtZU|U*&7dRz(s;N8Oz@@@Rx#n&yzNWOq5{W=Qih-WE_(1h0Zpmwe1C>~Kqb9hV|stCQYLS;e# zNI(xg$Ew?RvGO-=DeH7f%I=PI9mVWBh6bvU9LdPFPo7|doyYDKIKhO$S^vT~tQo!O z7K=1RKW^>cKCNEwega==)@d%$%2Ixy&r*qZg$rZCNdSs5>Zu;3v5nn*STVa^o|SyP z*?m`{cCve#Eg7QEkd9kLa=w3`|Cq-s?jE{AmtVb*?_sK}bn4`&`Ng>)pbmAuw7;E| z=i|P(8fBySiG(4W6NX{1BFytSJc#1`_(JaY0f&I!TGctw`r-R0SJi0w<;!YuAyLu7 ze`)WyNbq|W`HC0#?vO5GX+F-=bgF#@E)tfL<^QOMTIemubR10*^(9)O{M1Y;X!o(- zqoq)uEi)nG>^~DRJtxE%bsNh>$VD%+hK7d0zjF8by3XH{%$yu$Q&ZE)G5oh9!19I@ zp*eagz-N9>XD0*}=qL6Wj(?HvI0a>Q(*Nl00akZc1~A}r)y20?hj0Dt-$XgKiLk+j z?xM>kBuU@~I5i|#Mr;0y(eWcPtF3e&2_V8VjiA9@qQf4CQ|9O&ZzRAzKqN!{PW;+)Xm8>Q&=!} zn1p>n=EVz?w&9YKlT+v7QXMS{wY8b$%*^@TITQ^6oh=5*x)@ihT}U^}-8=zKx156_ z$r*a2&lcV+-MG+!Kta>fM(?)o>7rl3hBXXx_Hq(!KkEtV6&hTg1n+UN$Xa4L5jz6^6p_wK-Kc z+^=3vU7f4tXyhFTke-pgzbAY1gz|8-hn6E`G?*mhRv_wqyPti;SKe3pLlfHP#Z9_y zJA)#^BM+g7H`rX_?q^az=pS*2?%TN!$qgmKh9}-v6xi4Ee(IdcJVb#Id-1zj_T26f znMn=fLaTIq!6dzhfcrkVb*yCg##9NJ$Aua98AH`Sa|nzyIfK2_0NnD}Ab)5fNImjxNHLg2 zchTJlaAVC}CH1K5vvP;rV@nOL?RI|VO+V{>X7D?iO+{3Kl%WaLUeSvj22D#Icrd)-LXv!1^+LD=zW7G2%T4epT9Z2o2X&blSE@BBt&5Co9B z@7v)$xHphvkI|Xzaq_*A$R9`FOd0zrVq<$`!fi{IJUV5{jm4NeNz4WKpbp>k6b^I zKU6_~{6+tU`bjyR3+^iDR!`lws2v(2pt4`biaXZ$mPKqs?Jm9@+Vv*M&Ed*}0LpOG z@#l%FIXn)24-a2o^WUDZ4gd`PZw&v+Pc`qUZN1T6-`(Z(&7eBF<%(#%Lj{}^*G}`> z!wpDlo}l|H+scA&oK8Yw-7iC8(F8)@H*sh@t=rE@0l5*D85WfLvM=_yA-bfq1vtS` vC2{SsQQRT_Luo&lT}$1{BEWv4x(ceBXdF|&%fH3`>;tGOYQaktEJFVmaSNJa literal 0 HcmV?d00001 diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161474977.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161474977.png new file mode 100644 index 0000000000000000000000000000000000000000..ba44d63e09c5f7d14f43efbcfd81741535316124 GIT binary patch literal 10919 zcmc(FWmH_-)@4Bm6oC*VA-Gg)Q+_^_Z1_d?SX;gIN6BPuXSeHJ^2FSLE ziOVL9caHAPL1J&RX`J`%q&rVTsa^-M?9era%^J^oXbn6hAue<%HnT0j??YGEUE(!C zc)XyBruq!IqMlTk?O^wvj-qKCO}{cWp3p&kYI8ky2p6t2*toTe#N(y5r3+kW~>cps?HEx+R zdq%He(RH=o8bf(^-XnJzRMITQ`gH*+6-^pm&0H7v~p8>xcbDxA^X}PEzxx z+Y=?GAPmDD>L6q@yH4m+Zk8!xF>LVy&{J(#E}x zv(`J`{+UXdR4vnY|Y z^&9+p*(cWw{Sj57&6ijcRZ%QwtDxIF8NRC(t=o(PD)+zhyZ)2hI$*nLSnvFhz4;jb zbbrA}r9SxWR5{A-?k*^)$I?VVyTW-@R`~khyOpi21RbKivlBKQoc_w2P)Ya@?e-uP zDhdt+X6gy_W>d*Ur0URv?0(+-Znlk{-^jY1?&z3t5re56fzKDdSV7eJTyRa4=!G60 zI)SMV&X;47$xV5Nxib`(=iC>%c54?5-J0cOs>@D*SQteji(7HT!N3E6_tk7o?X*C{ zcO9bb#=mHIR%Gxyp~ll}x_UGl-j6ONE$#bq4Ak(TS@UhH^Y{`s1_)VW_kAcs=ty_y z#ful`Gm|YLcF3A(ruDYK2cU!`4^B$oV?145-EybpZu6s5D>r6BLc)U|%w=!<{3w8s z$jHbre_m-nC)o7o2eWpy%`?yqc$vi4n(Z!Py^DTl|0Mm52ncF#*3TQ>eFg< zy}gEQHvKwBF{RkxA73UqI#7Y=BjvM)Nl8f!HH;T)Ed%o&f{Q94A;A+hIpBl;Z7g(9 zwz_9AH%6p`KFdcnnNUk$KSsARKWfOaUVmeEx0>8C?}}LCN-)LM-TnLaiHVsR8t7m` z&!K($B&V^laZ#ijk>Y)}*HznkW7m%!Sn<0YfCVys$2Wah+fE;!ReQadHoo@K8-#~D zH=oYfYWTk4eLEGP1ih)+kjZrRJ^vjVA*k3eV_HtMb#pt?!qa?vx$T8YN=aFU^wYGt z5&WuKExRw+;B~?j5)v{3gqc4no8(nZv1=|-Dk)BPX}^~bU7-(ijU7_+gtTv~c%`_k zCA`dMmHEI!__8l%;r6t4yjw4hT*&Ry$Mt$3?SZjTtry$y0C!k;4p>-P9=2mpKE1ir zE3%0Z%brw@sE;LeXu<<#dB63}Z`yoPu%>q23+sNO{cex4win*)jOlFpX@2n~|B8)+ zvlR41q>VsHIPi(c`6n}@n$fNC;=`YE?7vr&jo55AR)C*QcQ5!7)J#Aeu}?bxbO ztob`h&%S-TthLmCr1~thV#j8la<%hxvh`MDKVHE9Ryfn|(z>5(aG$5~Dp57!EGO0N z+N6RAhm2p@?M&C*oev0gj+ZahCu%#Edt&tb=+@TOMiv%^ofad+)UEgDn{$eb<;X;Q zv_T`uhlhtvcA+65&NZ7`TlfHgdzuqZT6g#KoZJ9w_vLY;NjHC$Iq*qKe^&c1dDqs9 zSb@kHuT9O!cxGT=@Q{+d;A>YE0PN}fhMud>M#sk!31Ti>UqUCFz0Y)8Ci3PftKoy% zQd(Nc9;=C3e+;3;XCE_e2>VAylnv+ho6j<*>YQ>tfRkg_WOgG$fLZ!4Saf%bckiZ$ z{WPJPK-kyBv|hMg?N~z72r$ND9B4$?g>nt^lc!*E(UtbKkt9%>&tQsWVR!) z*vkW{+^!1qn(mFo$Ijk4s~=b$Avttig#36a2oqF#h>fcJA`GSwj+qWGl;I2{z~f=0 z`|AocMcCNql(sPVNA>=J0r^~0DoD_7yjNxlmHtbI(0)_U-kyEa(U4FSPB0l9GrdrJzv&3a(C@-LUBCsM zz4e+4!Otp4=a}=zs_*Lja2XT;EIN1CuN+fUdM1Q`r)^57bpx zGrzj zR+;$K%e+;5!<#+C)Uz};+p>k2)&PU6%+69@_Qi21==^&b?t~vOU!TGiO=e`~yH8$6 z350oKmicLQ^ad~Kx%#eyDefxct0-@3p-jwt^P&D1J!Q)gTfD85{wOhi*G8O#v#OKu zFt{wECwqd)fQ)YZXWA*$tnN`?C~AufnyFEZm%hTD(KR837UiAEzA4f6LyilA9l;E} ziH+79ytbI~ZN3Xy>pKt}PAJiZ*`$o+Ekk?Qm-S|{0%~%Q`eN$nVe#XHmD}GEc#$W5 zEoM#*J&)dAg&I*`cY0nYpYVizg!d+y3*lU!Ewe9qsLaW#kgq$`)?;ayjcHjU-JM9K04NpVfsz;=zA zi|~Achc~WppC;`Xd=B$X@N5=xN?&a3+ZZ4MDDPkfxmCT@6YednL>?O!!k7EMJg)nj z+Ct%kQhjU*3pac2JjHK+*dieU`9G~KNjHXVjiv}Z!R z{VUEmBQ?lr@#1{@Yo5%0J=cg|6FCr%H0^ZgUgRbdmxe_xU+y~i>p7C0uMMVg3g|RO z&ncwwI*DUIa!7P)=sCmSNkadc;Qt|g|7U3MzjbkfsYM<}0D@jg9E_p^2J47|1+Hov z6g4NStE-K#=8(Tn=I1xc!{96eOo3R`Bh4=K_J)m`7kd7pH=C$y7M7g6ydeNxE)Me1 zQ&Anzmeu0@#>acMTFCZP2P_I^>E$9MG-F|5+2}9WQld_HI}a#m@4d~=dY5&_&7XPb zQi`yIVI5XS9XlJWW!Y^zrF4E2P+fNQv&m9}GKV)X*fU2>)aTBp?hRnC0Xr! z6h2_kNToBa-@#G@L&~b$52~3>F*93KlPM!(Vi;_KY&;lJg-9&73R`!`m@C+e!^2A~ zGe24zjEXiM?bYStHCst{tLueUFn%a(LTRyz2iK#DiU&OQg{(VjKbPetUSBhF2^p$s zFsIfN1~ArRXiGdUagU&X#cuQx{Zou=1ugOW{?#9B*>xvwsSJWqNY~eKqY=F~q_h*3 zIT?=isBjec!-PMAxn9;_;w?;C=HeiD5}g#SqfT!=ONm?B3eEm3S{aQmX*_iuDkmC& z_`a?xpa#D{T%+5Dy1-M{FdRYu`3Wh(TngrUu#(lH10cO4zqvT=eNF%v5HuJ&iE4ZZ;sxEqbdJ+TsC`rVieG391|AUX-wT zS?XqPhD)i?PEQWgsUM#ULdnwAGOU%30!A6)tcjW&T*O&IXRjtVJGIaHLH|fCrQ4ox zIj4Gl?$v{XJctJyCeP*-$B3GJPYCI6Oq95!MLEeu&XelNd>n`k4KR({XesyupUz3GSBR5=!lmkabp&l>mlyFU)knbo(ite6clA*-wj z1O){_prfNBpo}ZlnRaV(+#$NWbTj=Pa#C}4G0#10au6rwxLr~^#>oZA`BSam=to}G z?1$bJf9_1(k6NIZp-S%*dm=+ti4g4F`i#?!h-kt`0K7~H8i_w|E5$fC^PimGNZF#p z_xn0Zjf*!fj|KXAF{?0j5L|6#*PK0ih>I7ez-oAAx3M=nzrhcO7s@lIGy$>%k=qT( z6;}HHv3^-C6yQ|K6i#j4Qq?SLdK$vazPj`5BOpSi{Lb7wnrrz4-$EdA(Xxx;;CK78 zVQG`48n+Xa%Ki-j_0u|$QBlS{(c~USgP35jPv5p3tPTc~6!?NAsaYVU7i-SK(yOhl zJ(8?6o;Aa2jzl7zhF@jyyYG>)88nP7_J+a#2oyhLv$Xs)Tv|1M+8IUw3Lw?hbK0Fb zxkP^rQ%8}iZc7xx`qH{S1TPX{8=1Kz_E~NZJ%HX#y5r(VQT4mgylv?zK8f8mzaL%xtceX0D854MQ-Y-_DE( z9@`@?w=D#{Ub4!r3j|^d%xI+`bF=ual*(&D63ulw586#+EOz@dICV;|Vo#DNT3kYx zTc!&3=jz>`vABU!3TC&rRIwzIvnk_TDrC_p?Gn%4MNNe>hs81nFfx`n{DPWhXwUrv znEKPfjS)#IN9!;ch%Bk?L}#-)(r#~_m)-$fjm%Sjqy%{iZ>P^QPS>A@zRgS&3EKEg z^d570=fM7h6wP@R+By{6m)ucEjWl1%m8OQ@R$4~a5^GtYtAT3lhw@eZ>jpY?zeau( zp@;nBXA87lXLrHC2)|w_p|hJ-d>$_Or*fVxdQ`n;Tg*rp?{jR&I}*_B2Jrzk4~dpu z8*!(U+JOv)id*S7(&R>r2O>PBvW+jplT^L~qZPCS@HvI#m(3Dyb!XJgym&7UG}wA) zh=Wa+d3uf;WW@A-Jzg2n^5ns*lN~E%sj|3T;-NC9>m(xq{^8NhCDko3&kU3&8-23{*+C{0;lFfz-o>g~yPnt7IMq8cJ7Tc^ovU@Sc8<1^4F+QYl^ zVI>lBKod@np@M8h+zEJnj9GQ{9IW06!(e7=5tF{84MG3{;XoivzaG&!Kyubr3YqVv z8NpxDY!&$N{{*|5n`izL>|*Zo1PW8;x zy`TVt#>-C&t3sCVF;-(7gwJt7pUhWfuNS+Xw>RQV7;>$MgD}BIz9V71yrHy?t7fZH z+P?|wRE!qvkpzOcc&xnlszsr@xw-M!b#21^v@>7Xe=3ClK}G{)KZvFhq0DYypEzMu zR#y}UgnzY}u!x9-?Nv+5T&zI$13XrhXp&%v845~Z=Da~jo|cZ67v4yc=#%R}3iGTb z?xD?iYV)N9`6}*xiaCL8ed-m(C+XfX4$HIceX**qRgnwbuUe~px$Z^Q8P;%G0zUw` z#c%Y3w`*#RHZR8+!pYKPO&Q$e$7Nkizj?B|(rTKETiGf88nW8!9O~+?jxIKtiGGH~jhf_zaXsGRygpVcN-b#>sc0SjjBpYlDJ_R4xa9;rkSUh1s49 z{|X(uJwtmBr~c&sGoh?nO;vY4Yd?$AcS8*it?FiX{z&Lqpd~KRD4VjZ+(8$rfXqt* zUmT**J^IX$l?duLiu{DG$hk808_ym&AzqCh<)sul2}jS@oUyz+F<@cd_&Oos>~2gn zf*-d8GhYX3`&r4fMxE`(_HmS`@X$;`qwW?_;SUoLoo@XFbTqQ}ZnJI8^~JFNM1MwF z8ncG$;LY|yd7b0$_bFMe`Rp#;=JtjIBuU%;S7{!nS+_bqfL})2uZTvyh=9#B;fTdC zR2k^vi-@8Tbi|L})-07z(X(EJCnti}gzX#c)2>ptYXuFHkO`y`qoyATr?6RSzzGAifk^RSvGfPq;o)rmNwP*G6UR^ODih^#JAHUdcP zKz&uyW_teXTNj3Wk$;^x$6^E(z9aP-BDTiHIPJ8y%Y^c54S+@t1j@Bn?r5;+K%K^j z=3L^ArAF)OVdbHIc(?LSip3I<0!mQ;7Uv4`BRbQ^iC)EeKhiQ+4L~W$Z5(?n20l^s zA`;fBzZPH)>_-&`1!fxBMOl;8HB7`-1;=iCJo*)N@IjQHK(c@yHHH~=Z1uZczE4IB zHT;7zbfXVfKhSGeOD@lZ!B;-Wl_X51Y4&yVL{+-L*C+ZQ-07A*5B>dpUN)!_-NBI= zYJk^?MKeZr-S-q+R0tlLDxR>VZ_9AY*vp^!8hyVw+xP+~_ySg}JLOBN1_qwWRyGWQ?o_g%=0TT$cF@@UL zfKakNbS8ZdaW<_t+Q0cOEhpkDoob6q zB!d<~s59Z0w^jDKh)9-9&D{gy?q7n9Y`^%M4OXywn04&?CTG6rKdCvFoh(a#av(-B zdMnm|N5L6$T@ju3F-;D>WVuO4Pj9O^ov)BKGCGO^O3BKS($mu${86(UY}zw2SxZXF z`?a=t_$ePpBo-V zEww7A_xbDLv=l6N;#) z;M|$2c;L_?0AMG(XLA%d8D7XBWe~=Qg#r$IsMFo?J~BA?q3?zIO_9Om*nd`4%M6)9 zuXNh&_8Rv^Ky6_J^dJylRn5{&_4dh=Xh5eA0XhR6v@U(7U z80qcpzPUY6vcD6ikbSHDL4dO;i~+%vOUI2}L_p5RlCLZB+y)I`6;|Syn3(CAmNEyv zf9l-V*?|8b`l-M@*?3bUDbo6F~H7*tckqRp;c8%ih+Ha`jc~PfqKrb&<0jn!c_~ES@L##FvpM0??UucOtDw z^oJUnC26`PP}OG#HI@LeNQRp=Ys?mPG>T-b%uNZKJ8#tXbYf&;S@}O%f)=5UhGOU6 zNZ$a+MD#$sUDUiP&-Z#%e^Eq!l$^w$E?f?Ju84-+J*_XdP0M-YXRo$|vh2~fo+=cT$8 zm+UpF|KBWOrQ)a2BL~Hi^~sBlm`kZT5n(j=6e)hC^3747vJQkB6N8-b(=y6(K8!KY z<6Ezd_0?PCyxyE%dQcUIu}6V@4uPZT!!I6T({k@RM0APl4eFuD8`C{FAD6ukM9yVR zF+EqU$}EkWq@Mn67e*3^3e%5arY|3UMrG@ab+9EVv|%yI>tSZcCGF`VgogaW7kmZu z%7PLo(1$hH*nxnr48R3qOiRy{1f#T+hsKV2MKH5NU5eT)XX6;Q=p-2+9@dnfU>`#C zer8#v0|a_xa=#Zq8hj#=0TfAvlYZ6eOd&seUe;OVvL$sK=By6uv6K8Ib4|>aLSUPtjJ8ty2kyD%E z*WlEnH%#lcqU0K0>9%x18*k8Je@dI;X0|hUd9;sIE)^nDfQn#KODc7RNXK7*~xS5Dejr-tzXe8zQ)BIo4{OB(j)69|6!-_ZK4EO-2Z}o`v zg{pTVgals@NLmIWJ_O4TPLWrrY&x;g2*rO^m+y_AzZ2XNA!$5Cqw<9(9-57H= zA+lNpU$V4@`#J1FOC2uag%;yiTa9J`v-R%KjW1sMb=2rUgOhV zn)gow%4eM6nM9cB7LL-&URk2C5I;18K-Z z(H=;jSG*1tg{gB#Z#{7Et51fnv+%NG6qtDU6xH*8d6Evd5-`U4m$pmw(w}iCk03e( z@}(_&(h&N9&IzavzAeq1Y`?(=x(_0(_XS3v!IQ=PyVB-S&hf!M1pPNHgCARo$sLZX zdFjpK-%3gzBlqWV%Fa$-hbq9#iXMU{eD>(xo_FY0)y$7AbSE=u&b`(^%7JU~zPDC^E=8E7k2jw~gt zJZ9kj!_Z2krR(6m)QJgddt6dd=eFzR```uSOF*u@Mc%BA^37aqeei9asO`4pK@q;zY2)}ayC1Zm<^ z83bze2!m8^m+|shuW==qT;lfzuB&X8X%yeQIZI?&kPPh7Qm9AqQ>V ziOA(G@oGiR>dco`$LW9C9Yx$KWTl%shcI;|fZHy=9_x1Vx;vyH_&&_+s#-snMIZeR zxVPP@Yva@H)hnr~?N0+r(!MeNqAXQGW!0>?qoOf-lpBJb85RQxrnR4m{@+e`1}WF<-mPOR ztjfsXhs0P|SeJi_F4Y=qwYfIe6|bbUU7ZHw#X-JR)yGb-7CMO$j1anD?{>G{w8YL z3hCA|scQo!N#7n7BJi~4E=$ejVO3-NU$G>$Y4)yLBgt8~=-*N0(EdBe2gz=U zR8}qN_o8g%+(bZ%BPPU$OTH?zxt2p<`D1`wd|+`HKjg_ZMkan@;}$HbT`> zWGUZK5yHetXHviuO@y{v;N&VaBPO6+=8OBU$RSD>J(>U*pF6_T0O0?N%SrxPI|QhE z?2$#P5tS6OQ;wgHRq6i!Soa^l@B>d^z^zBDQePc41JL)^QTG1>dRk5s)N zwTZj?Qn-wtseV%(-9HJR7F|$DQE}pHCD4P-&dq%Q;($V9YHDgeCffC2^+aa_#wn8k}hvax+&|42k~qd(^;R f{kKu$#{Y*sKkXq?5EHNg6(l362rCtT^Zvg8NjpBP literal 0 HcmV?d00001 diff --git a/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161499158.png b/NLP通用框架BERT项目实战/第二章——BERT源码解读与应用实例/assets/1610161499158.png new file mode 100644 index 0000000000000000000000000000000000000000..8599f8a18fd106fbf62e2f54ecf2285e327b66b8 GIT binary patch literal 12287 zcmd72WmH^Uv?W@&2MED~Lm9l93iy27%yqf&W)fk%7Mx zX^aUV5G6=PTtwA1<6z0>8{T%N(D9X?vc+opHMae4zw}_Z-*!AGrh{0ol{p-OO_hgU z$e^t)EC*GmzL=o3j$?`a?bOZn+bakB#xHIyI=Yv_0D5|W`=Sw=6fN_WFF{&ipbIlv zPDO6`L(})z7i=mlgz10Rz1n^Du@5TLCI;j8FHXIO&8^Cvv%RvUCcH0ia&%=-sf5MF z#VZ^(c6N3gxBWsxL#?E(Wbkltn4}^bD?W%Yc=3k3){wL7Rg7-Fw7S((k5!NGStrWc#8>*<|FSajJ4@4ZoG0% z`wKXqB!>{rxb+bg#MHA$t5u*C1>6Sq}zdE^&*%(F<~a?y8K z@@e`{x3jL>nJ&i>`uDjd2&2Fw*$pu_7(6{b;E3+TT)<{$FUp$B%dw1%j0(J*9UWD_ zOP23-rX)LTkE}IqXE9!XOBy=5zd5tJIW>8xGs|*AzFPLEBv;LHT}OMU^YepS^gJ8p zaXHLr-w&hDD$>-0+x%;8U;tYCMudQXP~Rrn;&RltHJq++v)t^&=zW@yt*Yu=c!Mvx zdNHft-*&YO+o}Chp~$FII*R_q*433LDk^HO*{SpZwoq@~Q*XT>zmi<8-Jl5WWb@XK zia9*AaddG>7ko%G4pb;B26OHLxq zTG)cul%9eV_DzfV*!;j=xE?lbe>+@k@(-|)k_y=k*pjR(LMZ(ym;809+39($N@NR5 zOEG{2=q;^m*K*1Vf15a)lS9>dci3`$+0YTiX*ObDZa#2+o5-ksJR!$w2s~-Z2ivUn z*1Wu)6SN-Vv-@R_qqV=k6Yza*N{c7mJ=Kcrfn|_nBIxO-@QDQGu;BFKHIKn9Ca~Z? zT3S4m{fd)jhSb>t{GTp>*NLq#9$vU9-xW&k&^@0r1N6e5qeTTZ$)4>lF^mvvaEUHy_BEESCyAp-u^tfpS8d=L9(z) zz3@#ZAU=Tr>$$yvv3p!vIXXM9&s7^0*sQyqZLK}t9rbqwpcI2SFHw=NnN8M)7rbUr_z#Yt1%*)o?0~u>fapkBp3f zF*u+u!`JgI05BxKeUyB>lA2+laJ8Y@|{^Bv#z{$?;m#ptiJX@g~ zFuEUDre!I*B2EOXSdz`eTV=jOY#a3 zfa^)xHskvG9o_x?9W^)N^w3U_Zx9_$_G9x-3VI9an5XG&V#{Cdbsw`(&Uh}(F z8C#a99VJdrm#SZk=45Kkf|&&w6(MzXyC|mRv%)awR5a<*(ozB58IZfV0EB^X!o=nK zzXNEozT~pfJ2ywfqSNU6N$6q9(Vpx@$n%a#_2)CHR~Vda4bRnCCWAvQSK7U9AD4`Q zeFb2RHHlTfVzwA>W;FV8%$STk^02 z>!^RfPB^e>e|+P4J=4%0L~7I6b#mFT;{6dAUttKq%8(erTU1fheP~^2!A)I_B177r zt_CPy)zAhR_t7S}lx*uU33IvV=NTVm6187o1rw z@r;{WTI`NjMHYys>Rc=LxwyI06knEGXcpGpmhss2lexUIb~Epf0$3nfzK18FqqbH> zzoIP}08^xFCHj8a7D|1~nZw)PBZDh#9v_mJwS$3?jlO-W%ALt@n#lQQk$#uzGLrb} zCHGN@9pp=sa*_kgNfW~l4|4Yg^0CVE#@=&-bmiN*oAYg^vsjyYo(*1qq^{)jAJvMf zj)#SgFHW6c3yW?-eNUxH&T0Ux4P@z^pOFZXG?dC|Cf`PtIOeVpshe?OkUaZg#S@Q^ zRc}hWKc3bQKnEVDy;m%Htwk=yS^yRNSPzhTujh5~#q*?>(A>hp9^zf+q!lwND`4KH z2>|94_8!1Vx3F5X(LMkeMlwH!JYzX94pNtUbF|D1zr|gf`-O$XnI6QT)(NJDiHSMo z#8juFSEmMH7q&=COJj36T#TpZhlWi)KHOa#)CoWC7G@JX2$JwVD30d4H>lXf&NL@S zMw1JK154F&bOo~=JMzA2Ni(T=S*ljv4FsmZE`nk?{n4V=)l$7vfz!ozOI~@&I;YR9 zKvebsqXHY&CG+&lh692SzVxX8Sj4fJnP32_@de^0{Jq=o(>3*Efq5O6nE+324h9#y z=jt|X^rhRjhXKL<3gC~YirJ{8X1QdRULbkc+1Pwl3Kb0j${J@cp5udFO<|Gy+}l0# zS)=F8>Gw>HS1KjjVt4X$(=JVV)P*Gvit1mRVQuS_UMK6l{=dmlu*rYTlxsgHkidZT zQuDOq7!f%+KxYoE*}su*02DC-sPhX_VL!PCCNnd$2E<%Rq(S;83Qakqbowg1@X;O^ z3?BFK{wxPjE#rY)PG+RS3_xamQZ5hH8h@j( z`#^esmr2W$gUYDls)HVZ!{^ulDB71x0O#5Aw$pnx#%#u3&X<3 z&TD9x{k{c&YUF}#$I>{vOgh^&@LB5eo%KTf7k)KuY^X7l(U1e5X1{+FbJM<+f~OOIlk9XI?9Cy00)2?h5fl|G0+$V5KTz1 zLulO)L{VEiorsi_QF^FRo|BF3hi!x9Y=vx%hDx8Oc?_^X5diALU>ZZk0zgV$I02g~ zuC1*-KFcU$SppO^$-`1j_rO4wy@2RH+M9?BMJb{3!ZY=u9!D z;b-(p@9F;Elx;}Xy9dRO3boI*B~X*U3*Q5(axOZ4mtJ;iYU)aZ*f-SF_HU8F_U~Ih zj(u+~+i*+=-_UI@-Y+-v+9s^kovH>HO#nY(=}r2t7wc0|d3kx0nJB=WYPuMsai7cl zmX@&4P@Qm*G(Z6SB+CCkUD$95HUSB(fM;uEg$UAVamE5(?-kO4U%}?$-%yuy?oJj~ z1K-FH^m1>m6`h4c22)dqC}s;r1)yMmH8)2EV&C{jL9-DsLwjM2vAfFy1knCMLyTYA zUNms`B1}u)8Me}Z=w3gpO}bLrwda;U zvQ?pATe*{9TR{WzC=jl%)k7_wfI$_iYw-Fr5Y0F2^LA5toYACwh@@6Re$HClJu32_ zyr*Lmx~%k3C0O>R@IH<438*ZB-5VNUli%&YcCcBCEu(>j+h5f1#t(Xr)4yRySf4*? zbXAazu(A^NSUKNTfqYzfPnPvr|4DY6;M@hC=Z@8NHITQQ=IK@nB-D@4!6Gk%ar!)k zbp~ld%eO7>K4(7=@>gBO?6`Z=&pZV!q054vR@aDbKR&fu+1t{Em))II;yiS*wKxBG z(*y*~yFt8;gvXvva(-v`V(6E0Cl}V|uRFVl z(T{A=v+BRbHYmq{*?;N56M>FshZRIbLIQ-4E&LrkFC3^10@6&K|D3P|H0f-T-Eju<5!!CvT8e zj0L);x%EEgx<#L9#nK(M{T-v5O{U!3YTJRmppLoG>(?PZ>QD7^=-v|aD5hz>3B9Y@ zK@sXd>{!nSa-u}&6C$|W(qp{GC!}J*C;G{=NEJsQW+`3oJ%2}F9)0k5y~SI_2RQS+ zd+tL8Ov9^PLne2g;6%{5-1bxN%Brn;n?D)7cMz67<18ONFkUo$bBlVgOYT$Wh)fjm zli})9F7}mSk3LxL@ipuTo#$dr`MzAioe{WSJ+^*VTrCnSkSNnr*-_EaUmYDCo6p#- zSv(OP1#GPF8JS@c*p+Ig!Gs$ASlBDUDoPo`8?gF(Y3mstf&3_Qmo>U z-B%oMxfslH(UG{uEX(#N?Qt+#{Yc^R)hn#LW1XlN1Fr$`y?#CDPtC;4Wg z4cj7HvDvfx8+;%@nRi_}?lM8XTU(|X0@^KpGrbXnpI}GNDQn92N&YnrHT5a=bJkHO zfBo+;^8e*Uvt2XiXVwsGieMc08XTM&UmW|#re=Ay<1$tEMK_Q(=i8TJgwkl20b=+mTBtueV7%9Jn}xe3zamAHSx=hTcpH~ zqeSwEEw#%s%h190k4Kb=$JzfqU8HBfgI41m77F@=0(SBzveKFgvfOSc_84iU4hj`Q z{#A=3N=b$!DOK?CleqY@y^({%nd5d2i!t*mNp3~405dv$0vc5YSAL;1I__IUS|s;{ z!jG)n_IX4iAW}ZhJ$Q;-u%G!f+Uz?r>fF@PNoKGSO>)0X}-zN(uLRdXG$%r^qRhc3k&Q$DP^=WvDC$q^^ zU!tg?f(C3Ru1geRmdbziNBh`c*6^Z92aW{^I=GHhh&XfG0nqsjp zG~|mk=0g|YzRBH*K#2`&E2zy)s;;>BCKBf$zyuA*f~>E$DCTlCSfftb-&?3 z2*T?P)am+E#jzb%$0VC64f4aX+Dy&cUG(5?*x z)KX+$pCqWW&T@8aZ0vI_By+CTg>|OF3r9f#2`SKl2wXAz42t zs%L1$FX zl9Dn;ph?XSZUh_*w?R5t>m*}4?3rEnp{Yg%>#sYGY9$)Q{@RDQ)}bB|txQVfbONU}=#BMW z7H2MroP_)booXyC8|}h(gG*C5qoSyWjYC@1(@UC{I-g?cT~(9J0w85bI$|4hQ&|K- z3BLnzSei2-_Op!MAu#I_SX1AfoCIZ%B+h6F{m*$GoU`=-;h1@B6PuJ+VdF3`EOp?YZ4Ae@ST{-B)0jew zPn-^^Fd`0_?lV<^K77A;5|ai=2WGesTWmmX+fuRaIGGcu83u~qXZLD(Bpvd<<=82+ zdGr3!swu=dj7u5UL15QtnQl2x=jX+K(f%G!oq}%ivi`|I_#gmk$f!b7Hd_0ZHb@*& zY$*7-9K&<}n3S;x7$BYx&=} z4+~@f&S>|{;$Xj~L-S_#0>}m}@Q;+B^dpg00<}<5c9anrwNu?S9iK?CNenQ5;7%38uq`SXr3gNt0;GxV|-m%;o?VBG%uY`;%hl+l9LA?*zH zA?3Rb8#!#gaZ2w&`8a5FIH6{SgQ6mC`?Hou!_+o>=wFl%zd|Z{@_Ef~b3?UC-{SiT zCB6M4G-bcgDkYu4up;~Z=$GL^hkzO$cyrjE>4GnJ|h7_{CNZ~mft`6>bY0wsJxNi~IvlzyP~c|G%OYFV-*_W6Tn zQfBz0ZsYjtnAdThPhx2O*g+#KRoOXLIj{>b-7GGzC$k^(3qJ}9vJ^mm8Eg31ytCwH zfloTfY?r#c&`F_?GHEEN+{7@9gXEL3(f>7Qp^i6nXrHpiSdk+vR|%XPHS7|UwX>T) zXs;Ak1CZR~@(`cG^H}6}rxn)3=tDNy`V%kKgkPg{2@3v!;g#2r)=V|>pLG$f9TWy0 z%$WqNi5aiA*mnUx$WzWa%p~|fH?9m0T4zg&WR;0bz5!W+)lSLrXKKB?GrljW9t!Ii zC#-cFSe~`>K`T%#bwA#`R=fh@@#eMK%lyJdoy6~%B54`1fdf}JSppvQ@sh4GfcGtF zWJCj6h1OY`o0}JDLKXMtTL>*@1w#u8kfIxI#?OQ#XZxZw8jqv-wjv8e-%(R>y_8Do zkfF;Z{!{DH6>s9V(H|p*3a2?R*a-Pg#2X2ej6Jm?d<07zOPZ8`f(th@bMc7Te3|-1 z-#!8OaHRGh+l7-%`(O8k63{V!l`;R17g=p7zt?&~&eRDLrWqsAdhq-H-X{)_kdRc_ z_sT*bi@ZzofM}m^~*`T~s1Q#zf_GbWl8-oTRq-RFvP;<%S%M zlL2k$Yu3_YlCvo1{-2c4bj1dT%c0Jq!zUcujt6cQ-Da*~UO?$8yEf1dMiNu9?iy}G`*qu1%TST*|4t^x_&MrZHz z=Iuz+ETDQR_=qj;DDYf$*7;hRzfOlv=6>Ty#p#x4NKiX;??qN`<1ID=^bTBHboYlZ z^VHP-$^H3QaI>#n%9VIl+>?T=&iH@|<@^{R^#NJ+25aAXumpndT1Dmvz|vgHv-1_a zrn>zc6~$3b1@8X0u)!xPS`e-1pmSH&X~f zv7_3D1d`FZMX?rflH$;&taJ9iFOQTe{N1@@WVZVghh{9X_T&~qZXQ0vf_0h2v$p0b znK9;HhE22BsQ7ZD*wIye{2tb|f^-fxTAAm84~xB_%nlbmrRWMSYmOeEjwZUFF-Qob za`bMgQRH)|pr;0bu$!OH0)$_hlZevdBI78&TPVnT@lgwp$}xvEyAYr`8Gn5_eOg>e zc&d#q0eru|F*)zwo*LcE^GJ#+8@h?2349VorNtFvGWs1bX`dV)E*vjP6lQkjwugXh zJsRMTO832)V_GHdN*cqe-C~cJZPuyUy>TN4b+EFl{*D$u&}%FAWi?o^^?cl&`0N2;XaHM8JQ zouNsiiA$lPmq>8hu&pG<-NP45egNgpE}|PC=JEa@3*d=|A#Wo=LE%C3R?e}n+AKj zw&8LmZjQVr&N%7N?9daU7gtUD-w7v?H>S))X-^y;)k-)7+qaUq93&~JOD-t;m-7Q3 z{15zLx}k(#w+$jo=D`E5sF?$4%Z)>4yrRK2sSDM!+rgYdM!;AY==0McWGxVL6aZ=p zg1ukt3n`_@HjDyQAC-Az7`}tL7wXtQn?!Qpou!*?Zn@)>8A#eZ1bD`ImKe3I<Z%$T*|uL@x8ojIn`%vHGI&x&(@*xD+R_(Yo_@ zj13fW@LP2CZs_z>?$#K-j;H+jpHU~IU(Y+Lu9!7l4YX%roN*G@l~e*ciUC)czcf>a z0dFY!S}eAccv)QU4VqZODbQ(sF9(=yz2^V3K`plsCg5@P^#F=8J_YGK;TCd#?B9Vl z;$jdkEA?lLt4d4I22S}7mj(i2XmdUZ!i4c!$osV@>VT-4*6*6n*%&7ADP<3p0Y zygl|P@~(#CkfRxJe5UAKRwmDuK$4uXn%8dy;KPrj(a*vb6tK zT(jt2=E*o+YU*70tb@a(AbZwbG|j$WfstWhXb&erx9Tm?LqH3}Zd5?TIAoz zD+74yx2+5DNz-p?PrQjG4m0g`#;8D@$)>~IPo9r%UYwEu*TtG?PYjZkPd#CcYwlEH z{7Jho@pM?~xjwvVk1^*$)~sI)Xb#O`ewj9NzWPA2?PfY?_(X!Hp#3jrys!pDmbf@) zR7e1XPXv>jd9SU_@?t#ANV;z^Z9UCUjNDLkH1c$wvH(tNh& zWK(4J;jbTH>a-Y51p8V>x6CkP*a{4Z*1KhfhMK!SYieV_4dWJGfaJn;ew$S^TZVN( z(`mWD*e&eJFuo)^4QnfBbNzq)uxz;Nc|Mbty1T&@b}iCEFa3Xrq9&c1=w0&YSLPOV z>H?>Fs3#8Y=YpH?z(_`hrfFTc!^|Ci4S|v)u$K|HZTd;ASP7W z)YZ^lYxJ=#$_hm15XF9+Ma=yh@zrj6c*2q1>U-e<&sZNi{{j=K<4#_u%uhA01nh|A zU0aTrq$^7mWoKHiN+~{Vbkoc5qpyw|4c2#fE^agFqlnJ=19Ao!tyM2$C>fv+yGjH_$)pk z$bNpY3LTtTGqv;${@gN<8NAEpeXI2fqpmO_ckWCSWR~TwWPR|r>Zu=%-<>IHI0BOB zIoB!_y;&Huns~(oJ^)u%1xl2K8pRNp6G-4L7%Oy;UD?7Prz>3;WOu8;UTQpw60k0s zNf$n|M)`6=Z!KdaaZ&zaF9X;>W#Tm#p+xnK;801WIF9E#l@y<%&3d<(Z>zulYUSh4 zT01#aAD`%*IX~ebD`tn}y`!c6bbOuydB83a7wMd7ZrYRuY<{LL>Y?1AN5E{me(>nD zz|4K(`evFLm_2XhJ$nQv0GAGVbHJK@CQ>Y|M_7mGyHfONnY7myZgG>K%hiDi`@f2nRh&$Gl%1%6E|U0zAtV`4_ES;3+Pg*dY?#eF%MYYlElq;+$zN0T3pp zsP*nu%#{D2iv4k;?t-9gFBQ#0&L_UmD~cEb0c!AvHAo2&4a*5gKem&IHKPuj5OuJX^RrUUiCeuO#gue^< zX6|;_nWY&v%FVL&y1m8zl0skBIBqHyEbcMcJX`>Dl494+P=aXD6Ij)1f25SvlvRF{ zS~j?sd)zicd3ATst(`Tfno2>P25wzgvc_tBQSnA?9KT=f*U4lO84#-ZtToP-ES~&P zT>hve{j}=8;=G4{(^fmTeq)L(aPsC72wLB$cwcpV!o_k;W6lwkiF~}zYnalAShh@a ztRg+vDBoSXS0fc;ag*x!rv)pH$miH6+G5!5aCuK^s@55eek;GWrbcf>g^R1|9>*^e72rVJix9Z-~g@q zq0ESO$U)eaH)P#Thn=tyKsK#w$oG>%Pn@O`x>d@!XgP5_HMMXKpb|^NG3x&xzS+l`!4wvB!RR+ zv7lJgw=fhB`#pP0^66FyWr+qF>fGBCK;jT^Q2KVEYfZ=+u$DjMu*LHDcj>%RvaVOF zK>7Gmn5S5A73h`(y+ox)nmD*|^7lsTawPy;i#fFk^JC;N4_*AAM-pG~(;1Br&h|Zq zlkL2ud8P9;iy;Y6D)>@rs3w{fC?Y*rGYyO)hhg)B%r6A**TjFQN|3u2 zS8661tI@ILzz`MGW8QZEE#jX$8M=nG!o<+g=x=?go05LJ)4 z8N>Bh9kRvu{m`wV*oJx}pvqA>UO4{1)(ti3mM$QU3JWcWC=7sr*m!tW%^y%^D!#Dz zDkou+k-~?P5sR~wKzLAMjB!G*-oml}Ti$b*&;3U?<$&l{945}P9v^A}^-EE-jrc0J zpw5@qatDREE2edMA4sLfjzTEle$^%-xd9TN`3UeFg;6Q<8}gYso9liCcQOU;n?qA7 zjS%3gfj)=CIE>;~oIHs1*5X0VOFU;|Bguem;_7F^^Um(f4wQVv&5L?sGHI#alNB5k_Z}m=%e#8gqjS=9aJeM_%D57EJ%p_H09SAIAUI|WR7;Vq(r$kyA|5qd;{FYhx)-B6nA>W;#9&u49r zAP+BS(0YCVmAsi{((!t4#Q5ACa4ypM0I*F+ERyQ+086SDT8Eum4EEcw_CCLl8LzXW zAz*3Ei{^c{Gy0yX^ZyF3M&rzrnMgo|T;l3151e{2FL*wZ^1oE&zzLk^68-k6;nTPL VO&-