From 6f00e286f2d1d09dc663d36707712ea730ef59ff Mon Sep 17 00:00:00 2001
From: scruel <scruelt@hotmail.com>
Date: Wed, 17 Jan 2018 01:36:49 +0800
Subject: [PATCH] finish week4

---
 image/20180116_235545.png | Bin 0 -> 53989 bytes
 image/20180117_000349.png | Bin 0 -> 34851 bytes
 image/20180117_000612.png | Bin 0 -> 35162 bytes
 image/20180117_004820.png | Bin 0 -> 48120 bytes
 image/20180117_010904.png | Bin 0 -> 204959 bytes
 image/20180117_011331.png | Bin 0 -> 12180 bytes
 week3.html                |  22 +++++++--------
 week3.md                  |   2 +-
 week4.html                |   2 +-
 week4.md                  |  67 ++++++++++++++++++++++++++++++++++++++++------
 10 files changed, 72 insertions(+), 21 deletions(-)
 create mode 100644 image/20180116_235545.png
 create mode 100644 image/20180117_000349.png
 create mode 100644 image/20180117_000612.png
 create mode 100644 image/20180117_004820.png
 create mode 100644 image/20180117_010904.png
 create mode 100644 image/20180117_011331.png

diff --git a/image/20180116_235545.png b/image/20180116_235545.png
new file mode 100644
index 0000000000000000000000000000000000000000..33f246edc6ffe3833be867d95d0c60418637356c
GIT binary patch
literal 53989
zcmV+A(i$y^P)<h;3K|Lk000e1NJLTq00VFU009~Z1^@s6P#U$u00009a7bBm000ie
z000ie0hKEb8vp<R5p+dZbW?9;ba!ELWdKudX>eh4bY)!^&fNe2AOJ~3K~#90?A>>G
z6y^Hx@$YQQrfwPuy@P;s2pvSup;<sgDe|g_f`a9M1yn=?6a|kIQ9%(D3sQd+rHKd!
z=`A3j6a&OWN=PMbv-SOB*-4g!5=gQM+#fEk?9R;2JQF5i?s=Z)z7?m_=|l)2gb+dq
zAw;RC@pc1*5JCtcgb+g97zyBn5JCtcgb<>PkN{2yA%qY@2qDS{3E+efLI@#*5TcBb
z08R)Ygb+dqA<75|;DiuD2qA<JqKuFLP6#1{5JCtc$_NSIgb+dqA%qa3jF13M2qA<J
zLI@$s2npbX5JCtcgb<>PkN{2yA%qY@2qDS{3E+efLI@#*5TcBb08R)Ygb+dqA<75|
z;DiuD2qA<JqKuFLP6#1{5JCtc$_NSIgb+dqA%qa3jF13M2qA<JLI@$s2npbX5JCtc
zgb<>PkN{2yA%qY@2qDS{3E+efLI@#*5TcBb08R)Ygb+dqA<75|;DiuD2qA<JqKuFL
zP6#1{5JCtc$_NSIgb+dqA%qa3jF13M2qA<JLI@$s2npbX5JCtcgb<>PkN{2yA%qY@
z2qDS{3E+efLI@#*5TcBb08R)Ygb+dqA<75|;DiuD2qA<JqKuFLP6#1{5JCtc$_NSI
zgb+dqA%qa3jF13M2qA<JLI@$s2npbX5JCtcgb<>PkN{2yA%qY@2qDS{3E+efLI@#*
z5TcBb08R)Ygb+dqA<75|;DiuD2qA<JqKuFLP6#1{5JCtc$_Sme8&FiT%@%eZK27Y|
zWRfpsk&v8Da#|)yshONhOd}#RkT8=!<=kIG0;n7rLe$;W2oCi1cJqZ0LI@#*5aPNN
zr_<^5b|Y?9Qd%b4qht7G_c0C}i^Fbr6nY<8t%m0Hs?e!<Z9286Lqup`F|<^O8{^E$
zz!4vfGc^upRtjV$;>=3HnRyXsMj}c;IEsHc6u%Jg3qkP@M=@1IQ@I(6(d6ys3n7FM
zLWp8kCIh&w`%kiP-98STh%fSeH>q2h2k&Xb{T&+?`M!lHh%@~H_R~9X#O}s%_IGgD
z3%?VM7ENS*G}YUpt<es}RI%tADufV12qC<#Oa*WU{)}Vx(ybi%>uiDRo7AmL^ZHc?
z4e}#2*q?}yK*ECksSs`=Avv9-v`j9#zoukx;LkXY#GEa#=dMoG2uAelM4QGniu<(0
zoycLweqs~0L(6d{pDFU)E5TLJHR^@7!Tq4o7Ww{#5JCtcgm;vQ0Pf`934Fe68`}@Y
zcq}*Qbu_PEg?n4prG2wngqi#cz3<fYY_{${$@W91*!BBqELNMx`sVek@WO!3)UQ$g
zmd-&4H~Z-w*mljwnHraWrMoAsVq@1ZN&j#ZzYy23$$)U28HujplzE0%I?f%zasFt5
zJ$H(!BDz*jqOIMz_)km-A%qY@6uVL%z<sr9Ctobz=CLfm&xiiqTQHz|O9K3SitJd~
zW(!MyiRRm%c9W5n<FW3k-fbDyw?mN~OWb)JXMe}GX913LM?6>PebH8Hjiy>FG*w&P
z)Lb@aPKIj;X54=4vAZEB!(+WBycW9l&!MT<_*PCq2qA<JLU>uJ4d5(R8}HBC!1^73
zsLQlk4Sl*aWpJ-HH`UvAqcXB`_<HqDmTrvp=#lHxq7Lsodmp|=L$MuO+=d)>Y`f=U
zJGjhav0^l#Z7~pC!(K%@%+X=Te*9-_dltBQ>hjRm?}@(Ci!!WI2qA<JqKqn)0bEjA
zCa=$2=`q)>ebZWu9CR<0BST889p@6$nDPB)w(dWvE~{BNod3T3Fcrcj<Da-br#TJl
z#`kf=N9Qio8qhWChqiGa6rX_NJGk9~?Z9GehgW*^$Y~<$qwg`^HAGVgA%qY@lqsby
zfIAhR$f*A=BOy6mUDm&Q3tk-18Liekb;rM4v7LD<cBt>eO#Zz0VlSH1t?ZTdh_b<v
z7=v~F1f1y?)MeV*ozb;_u0(?;r#TJV&M&ba`&nJ4_=TYFF&<51{Ss@35JCtcgt&F3
zDu7E$%Vfy-Z`I&UtJN_2$*%P3?EQH=>v#OY`|~!aLn^~e{>&XeNP6N#f$XPuVBIto
ztl6#w8ZElkL(nyS#CvV}a~;;LvvQN2Xte16{RY}v9lh2jA%qY@2vIntCV;b8Z9M<}
zVs+SLfS(Uj{?mu%^{aTfWx0<0b(Ys>t|Tcf6L1Zu{POKVGAB-Wa3scHS@}wC@a7YM
z;oondsoK)J4a1d4#kz5F?%X(y7DKP8XevnELm`9^LWr`!J7W?H@cz6FYVfAjYD!)3
z2GFo}MLvA_VKrbo6`#ns&weVfj-0qNIkQr*t{JNaZ%S|#eEQBR6~P;Treb3ZeLq17
zzWlT0uwz|65ocP#wH1XBLI@#5=~5~JxUW|2^vE_j`pK@PE_idRU!y#44C$`E-+nMA
zUzr1Ohq7j4UHf)!@0L#hhMwb5OclM`t}7@3;TRtLK%Ix@G^b%%`*v=Rp%6j{A%rNk
zydJ=v{5!!T0P5epMX8wcb}e1o)Z^(s?bP?*{Ir_`e-==bS=>>qn?J&F@r3J*MvI}x
z_}reZQbq{~N8e*S=zRfjrp96U`P~AGfeRsoxcv+qIFQ#~d(GR;5Vt5kKAsviYOrh9
zE^jwQlpwDMaGx*B4c^)}t;LH2I(x4%h44(D_H>E5OMNfBaCbKQ=^fZ(epBD;JH1%y
zi)L#g>!a^HQho3Edmr`_o4nW}A%qYm<^1{cBqk<$yBXpZ*=#n>oH>KpZ1#3jL<#b0
z0C(WeIJO^*0bKLmMh?2yYo!8i#>-Fq3xi$<z@ZcI9`)kH9mHYBwrjrnR$IR(+WI}c
z*q|Gyt=$=2v;OLP+uj9Ww|KEdLI@#*5aL?A8ZFIUx>bGMr%TfkEz(^S!c6`Qx-Uw7
z|JjnQlF;N1WIz5h&eY38Xng|EwSC6B4JssEi-EcG;W84j{l3D>EfPWqA%qZD<Fx>8
z>;97-B?AWcYU8b@+>*z7MiCt7nnx6SF4-d)i?{>WE!g%fP~YmB^+WLq@M42*g5DQh
zt0&dBw&*1|b27ZxAR&YhLI`m+UJKwBuG^=+?%%xyVJ3fXHRYDLg3q?<`^6jfd$Bd5
zq}dKGQ?pJgfsyDM_wjOzZjSb@Zn+6pax$>*`_8)!5<&<egb)StN&uIXmdT+L@c<a~
zItFwv9W}CUR-Z0S)Y@<-|4tzOLW-ALBua|?_(t`$uI2v&Z5b`<uF;}vGemuBKk=(%
zq!dC3Q6lViJOBIN|2S~qK%qWov)S0ce?NQn?7``D7E|kP%<XUvqU`WW0Jl9lMt$A9
zeiZ`ze7w<&B4g0&xTkq-_5H7VPk6C4qNF$yW7GoJiqV9&?!Ua;qFbY_(GDdb9B|c!
zbDTfw<rWDcgt!wdT)2>*fBu<9jT+@!7aJSP;lqbHdGaLb>FFNpbUGcu!NDwEyqGOp
zwv<q73wAr4gD5+6-Z<zlyN{`_?`>Jv8%-#3tsB=+=fCYZc#0<;Xzk?|iQ?usm0LPO
zQ@u54v|emY(a_fHs3tLSoZeCDOCbm$gecoKY}mlBzy8XsS+mgV_3HBE<YYE&+QhkY
z=dfC>Bqk=3k&!{~-o5G4r3)I3s}G`9ty(<t$Ro^|Glxo*Dp9v?$=_Gr4(A}smJ;uQ
z%Qjm$a4fgzb^B(uO1cU8T)K3LDO0BK%{SlN^gixsUfZLjKtgi*bv_}=I{WDz>T6B)
zw%6FQWL&y*iK$bkvS7i2>u-D&nwlNd*Y;DtU1Lijgb?D^Bqk>E*=L_Ic<^8X0&)|8
z+3j`~Em}lkVj}(f_ve*YUg6nipCvIdktd#bf~{M(dhDld+qP7#T9pM07Lb#ZBj+G)
zdnF#g?L2&1O|{>oZsj6RUXqoS#l?#kue+ViW@FyGc|7;rbG-1v3%vgN>)33zn?A0u
z(Lj^BmDKm{`gY>><V-t@Gx?0`joue+)uNrpS(xj1{`~n2A3mHHUU-2qW5!^&-~8M)
zO@)RiMibyFDd0GF<fiu}gb+ep%aSEa2nh+HabwTX9`W(<EMB~r?CfkJA|e2&UcEY_
zM~_CU)iP_=EV8q+Jw7vd@L)D=+C)rD$=-k64(A}so)Qn>;xDACubbDeQsn#Jv112w
z=FGY7c8a2K_uY5%_~VcB+H0@j<KuJ7lSf<LT}^#`F-6j_-_9Io52>%UHQE(<@{+<_
z#|;`Z;Q#%<|HtUjql@G^*3@XHzLt4#LI@#>gV}86x8HuFY15{Jgm~5gwpy(uB_*+P
z<w~-$vef1E>eZuR!-j0$yqV0*Opnjhs#S}CfB;snUR@&Xhuh;EMA=m0bKsKGaxd1<
zAipBte@;#gX0!Ra+iA60+O%=io;!W|bdhBK$=jPKLnv==&WuF$wGvdJ$oHR<laues
zTtSNCI@W~OMD4@Nl8mZC2qB7Ie0)5YE?uHdojUo})u>T}#ful?@9&SFU+%r)v17+L
ze*8H1-g~dda<>N_c!2HOw-;->^ST|*!JEuxGt;L}=fMXbq+!E`x3sU!%uHs^oXMk)
zK3d?v$L*%X1Gu#G+?&#f(7+<!zoIB8ic+Z06jj>R3gIU8by8a9HMSIGoij5@eXRsW
z7Ww|Yc^%^)p1V&8;DiuD6ob>JPjlwX8G?g@^R3frwcLI8-T9Vp*sy_wgan>?>Zt;Q
zpTNLCHgDcsEbT2wSv-f>*jWDh>o0UVR|pUl6;)t6ikrn^VZ?|Lv}n=dmV-9{e}8}O
zyYD_mj~>mmY161tqec<5vh*tPA(ROzxjj>%Wwdzr)kK8mPF_t)&6Ii`w=ri{vie#H
zDCfnN6g|Z+cNj?C^Ath|A&N?Jaxw`C32G+B>)Ehj151}KWy+K(^z7NQz-<Bo0&Zv&
zR#7R7=kWE{Uo&RR7&>?E%!3a;NMd5*^*>Y$rcRxT!C+wc@Zm+a&!$bAGGM>}UViyy
zEEY?V?YA^4`2a3CcWzj5^uT$OYY3$SjonJa)4Q<6$78qKC6K!vnJ=j?-L=zh7m9yw
zK<do&&M$T$gb=s4!rU8e-n^MPbLQ~;^Uw4A^UtHz7F@Q+&(H6w>xx5JJcqa6ew!bE
z{E@)GK$<siPQ{89i|trfvwiz^zWw%FCQh7q!@=*3>fgUVTCJA<{`bE{y5G{K!~-~Y
z21+QN0M2MMdeq=3NqU_Ihr>ZcvoOXkn8lR&^Ra#O5tghh91cgx2XY4vfTDQ*ef8CX
zx9!m3#<ml{6+LkNMIXR<^Ey@n!f`sm;dHVk=!AE!T_J=Jw>7O+dqaWBufP7vqD6~%
z;e{6%GGqt<M~@yYFx7r~dOB9CwaD9gHD&P}6h$E^DT(y-bec75rVgbnDR#S^apT7E
z#1l`b**S~an{U3!oH=v&`|rPtW&fo?iO+%4YI9@8gyi&_4&s(BUCQp=yYpRmF)=ax
z^Upu|5<oZ{4gv!M88vE@N1cwM;&3>~Hs^4ubshG+_y_<K#*U?4pFTYB!w*<z%s|(n
z1B#*)`O}80YS99gErY&&UGHCg6+Ze1Dp!V)BXhT_TGjQ{eUm<828<fzdVQNe!SJ^0
zUB_1rqbTm{*nJGU)5#}|V|k<F30}01WSV0d8jYspu3aI75Vy66hzKfIu6)hXH=8$a
z=70bDAFsaps+yQ0J3E`-e*29|l`7%m<KwY?c6K(ED_1VocIQ=A&tdJ_wE*<!(W6+8
zQ;==jwsG|6QNI25+hRLLvu4exTemKseDVoXr%o-l<9Jhv2XGOg0mNT$B}TZF04^*n
zj3!N*<XdjD*|1nF1x_3_7!1YMli+YT_~$|rKL0yFxsDCE*t7vQosPjj{J^hm+tR#q
zXB>kE<9zQuw2_f$G@3#usVKB7&-K6mbp>#{cI7UcF$3b_VE_KyWg|zr0>6(wk^t^1
z6u(fM=@$UkFheEy=1OAR%yq2S>x=C=b~>HdFD0<D+6CU|cmjY~+F68K!g<~CIy#+B
zf;b_B5Vx#Wty)y5P=SB``KQ43zyA6wW5<rAQKLqzSg`_&#e$+JL`O%{tXVUBeSPzN
zCN?&f_U+pjchgm6@f@5^Cwunn!DKQ~w{G2HJI>X7{q@(hZrz$nl`36-<C~-?3Vr+b
zWy+K(j2$}`lgV`b50x<`AHap=25iZ<kg2gtmo5b^uTY@^0RaI#{`liJz3-dhbUHbA
z@e)`qnBJXB#%FJl9T7%mKmd>Y_#^*o+m<R{e~os<3ha|6;dtg5v_3vJm2I#{En5av
zszCGRp3B>`f$iH}!!WO0C%_n_zI0~Xd;oW?>)7Al-z(R#HRB@poCu}+pW$q%@0tTQ
z-Y_16*}%)TmnDc3LI`ooDpssWL_`FC|NS>kr_<wJC^j~hDO0BK#~*)i^5jVzj@;=t
zHk*yEUAtm1c-CKaI-UIb>#qzRJh-Gzp-i4bR#q0<wr!(Uty(3XsWCG%lXdIXF?Q_O
zVn0^Ljve{WfBr*sbTpkicP{qhm9!EM;7ozJPaBG(R+`0P!Dh1+`F?MND<D<SrKZz%
z=9g@L=VfyAdg7{AXW-JMY`phg{L<3Uz4Q`}Z@<MhV+PvRtxIlLWrq%~uZtGtF8llM
z+#!^Cxx4STZj}J80E%Cz`r4UsvB>xDt?Ss;19uUJ)ybsAbx3%|Ky>A^0E{z^qf&My
z1}FmnB#0A22yxRi8V%jLb>o|FzG2|NfgZyKt5vJU`t|Dz^?=)5JFO&#1(wBg`2F|a
zxp?s+g9i^LE-sEmix#2R>$z~@0u?J(<hkdbE4DfK`}XZ4B_)NHEn8l9+vCTNvuxQi
z{QUelfBrlpMvS0ZwQBtG%P;KSy&I#^Ncr;RdGygo^98~HRjXE|YSpT2*s$TY4B$%q
z4$Ksg8^9%B%DTpuCC5Gf_*N!zYBU;BGIG%Bjpz)1)V11qX458h{q7DOc;>tBumVm%
zvv)6sd+x#c+;i9x6N@ifW!}Uj+qdT*R(Um5Zmvh^PNDdRsjo{*rpBVUjuk~g$xcQ=
zLF-VMysj?|Q(g60Y}gp$JA{?CmDufekEe-32vM5YY&I4xTEz3uKTpq|J$dfA=Qw@(
zG&Y-!Pe1*X#~yo({{8#&$tRz9E#0`;Y-YiN1q>ZJl%73%GJ5oAQd3h&OiX0bq)9yd
z@WTuqJeW;+?j_0si^amxqet1dZy)E+pTFj|4?Xk{<;s;~$BrHO))gl3vDs{_Sh0e~
z9(#=P<;xek%~!e|&f#hf9z2M{;UF<Fk<UK+j1C<-Fl^W`1`Qg-gb5RP@4fem?btCf
zF=(|~YSpTB&F!{t-_E>w^XS>LC&Pvf!)P?}&_fTgbm>yIZr#e$Pd`m|b~ZzX4B@xm
zek*VvK|w)8Mn-bt#EIfK6|XDt9=OVpxizK^{25o$hxc&w=us|SyvT3A{f5P2Ve#U{
zRIXeZjYh-0_ugBmeQ7irPQ+eBtM@_g>ra)+m8hSc&DjG7SaG=rYf1n9RI=Nd{M1tz
zEEW`-4c(Vt;#{!;+oVZ2hYnTe#ueGH%De&FtFO8Ox&Hk<d*MW(dGx@g#(S|Px!3Ww
zZQHO|EG${F<fgA<0441#K6(v)1}&k!kxV)=iI<waM4W#dHf%g)e2QRmFrDcPNKc#)
zqV$<DV+JOZiH|<|2&2)+s8OTn+qW;>x^<&z)24j?{r3zSG>8{pe33?t8gb7(_mpV+
zoK7dxrcI+}&6>=fJsYi7OYh#j89aC})v8tFsi&Ue$tRzrd-v}A_S<h9Ja~}6z|voO
z>G0vhELyaP;NW0PCKCq^9H2&x8pOxP)2dageDk_}e0+HR`RAE4XAVu9HofUNS?kuV
zBPS<^K7IP!a#qFL;T*2T{XifiBZFD9W~uY=8a8Z5)v8tb>Z`AK<Bd1+C0EHSJw2Vj
z{`!lgq$C0Z1F2oRHeq35SKZ$2$dMxi2L~58_s{L(#fyCN%{P4T!3TtdxMGG*ojNgb
z;zTA*n#9hXJJD*j%$hYzol|%<0RaI-M@L_`U1d>;-+4vdT}{nIc_ij6sp;9*`9$H}
zXiwIK3m3R}@ghx|Hf7zqb&MD>g7oxs&YU?@=wq65tn5A-i$<$OtM{dQr<PQxP=TlZ
z`G@wWPpjK~Ja8b>SFGS-R21(13neKD{fH4L?b>16w-1NIapS!kGiKy36|j7H!Q1}#
zzpmhI@nYB9wi_WmaRpK$>#48pr+0w8=%3&g_Bw9TqzUWRtz-D`;WvF9D~f^=w+n+#
zL!gh2;F`^-XsF1v=xJ2Sc1<|WR5Iyf?883WJ}EIEgeY|uFJ6q*YGvrqp%{%u0HUIz
zh>ngXAt8YQ0|t<ilEUWAn~8{sDAwMNtNHfZZwU$tV!(g_=yW<1MIkCGidCytQL9!h
znl^1pbaXVwjvb>>qel4o`Q_V()9EZ#zkl65BQ~3jr=EI>VZ(;es8J&(PoB(>Aw$@^
zcW;58i;9Y3;J|@=^UXJ$&U3$XqxS6C!`7`^dG^_7sZgQ99e)njl9iRk!Gi~>P@w|T
zrcLt*q?}HtIvVV1*HunV4j+E_A<sSc9NV^S<Lue996EG}mtTIFH{N)I<mBW6Kj#)7
zACJGk|20c5ELgCBd+xbM4c-7XvwWXEeen19$H&Kq*|TS}aN)vhK76_BuDfpP-=i!j
z@gBI~Kwp~ItHR!+vDobnw(dVkug;B&Z2yX)Tr;xI>uL!kZpPlDu~@8j6h+HjH6o~0
zy%NdE$!IhhUO9G*grFc!hJ|5Q6ef1-Mu?vuQNR95gSm6@z1%&o-MbfU`}SC$eHO-#
z#~B)W{cM#ZM|ze7xSlp`Tmjta)2_K~Rjaz@!Ch(RPS@8Gp5R(mXu@lum@48-I}6rq
z9OsUrsobo{_V2Ch*m?daN@fxUtpdSe=xeux)Kr`)PToEAF0V9yg=9lAnMx)P`8>q>
zob@!K5n8R*yUBQj5CX7Tt!&w{h4JIZdn}KMi2<NjuU-IzhK90f(<c1={i#;1TE6{c
zXJ@lu!2%RT;n`=OEz&lc&1QD(+Qp<vlRTFH@y8$d`1sJZYgYhz_Uy_2{rjm^tCq(N
z??3<i!@`9NF`LaKB_-kK=f}{YLrXj%MP4y6F+B0a6SQj8iU|`YsDX3SrcJ3@wJKVz
zmMYhHApGxt|C@-2hyv#_U5nG{q+GdjJp1gk)UI9ojz5R%Ie73OF)=Z`_S$Rt3V6rH
z#u677N9WF+3p|H}garEa>qoU})tE732Ib0?Q`bHI_~T5RIFWz->tB5H%{Me^)TqGY
zr>3T2G#alNz_oARK3^~Av17*oXx+Ls;JQb8_~D1Id%ndP411eb#y)jwo_m3AKXj@{
z_uaE+Pu_a#ts>p$jo7^R@)%o1p-by}`1<-192`toSQr&ULwV=WA;K@$^fK#oOlsAN
zQ}^D>_PKL8HE0kH_YaHBhW^t}(Kc*|eZc~Cu2GRaWsAQ&+|T`szD*lf8G$Q%<aX^U
zI6I|KX=`^@U)%rsUy<&+XV0FD8#k^<_jw~6v3pPy&?pMVnr-m+_s3*1VKSMhM?F3|
z@DaXtS74c-N#FsW2Z*!ANl%;*qSP2QYE-^nwJlq=5EvLpn>KCKWeplM$QQhQ`|Y<3
zA3mJ7-g=9XBS*4t-@YPmpGKo$<j9d8L(a0Zv)Q?GCk+}j;I6yw0$in!nm2Fmkplhn
z>C?RR)>|}c)QJE5=RXV|KAbaW&d{Po3pQ`wT;y%N5m{MTOq@88q@*N<3>l&ZKH!>5
zW;UCtTD9tRZ>AeJZd~Zp@`|ERqehKe4t#EhbGQ+E_Ur*DFp0>40|!V+NuguMj`^lW
zSS%I>4<1ZLMh2gM{<%l+2H@-K%lq%Y&)s+5&0~)}MoLObfyZ|^9M_$8(Y9?{f`WoP
zmTla)5r2RG8%lnXS8*j{DGj_6z_qBOzTWlwX|m1UnLu1r>~;sc4(E2!c4<`)olb|J
zpC7@&!Gwl}Qq#|m2?q|~d%4)-SwBDCZ{8dwFp$$vJ;kosvq@>uLfwZZApyhFPos3|
zgzfT#(?Z=KFJGQNyX5lauG((>`{xE`?mBNTy_CD%j2W(kCojKTsPDs_MpLbo`r2`N
z2RN=?$g`}lpK?tGRunMQy%!%J9|8gb)VTn6Iq%~AgYT<B+*!?8x*NJn5GRBv74&+2
zzBx!2E?nS`KmMR`<Hq@JJg?NTV@F1f8pT_0y>;DfZ<fJe$k)c>$Bz>i7gylTb6zuM
z%%En?n)K+=gP@=w?z-zP=FFKxWMm}6h7Bv0_Fm7)lPCG^yYFb-x-~8G+{b|Hd%tz-
zR@%00OVxrhUY8QL!#UiDEnBu=Fc@gtwr#$3OP4N1qtS5x{rBfvw`9o@)~#E|<jIpg
zg4-*N9Xpm|$Br?5`t$<V2LuFQHk%8T1nuI*iyS_Dn5d|z8=7aAS7Ku6NHSL(yb{1g
zga*>2t}E55#cE^eFJ*gz;hNu$sB`%$M}|<nVi+2Y2EAU7udgpAlZoKqV466cj6Qr=
z{am!k#3y&(O+Y{Zw%WDX|G@_we)COo^8BZv-MJG(>()5NjKP+gdgC|AefvVYcAj(N
z9(e?&PtTvg#OZVeZ0_wwjdIn8E6mW$JCG)_K1x7108Vq7Yc5<F=7^7W4G9GlqX})L
zCTKJo3<iTo5ZBV&l5xL}L+f-6fjFr>$)mbQNwy?Q5GRBvb^iSGPtKn|Pp3|ut~qoI
zpnCP{)U8_=gTYXuzssVdqj5MKv}@Pyn%nK(y_>01r+UnB4hjmQR;^n6_19m;+{%J2
zS+WF&!%<*>eCEs<&YwR|%a$z(2nb4uI*kATAOJ~3K~%Wreo|9Yi?f;6bSvlJa5y-3
z?i?{OF`PSh4y)B#Qq3-u<m6=b@83_07A^AiP@g+@j*S~P(y?PlYSyd?z+Zp;h12Q8
z;czg2{(M40LTJ*Y3FgbA$*z=>lS8#?)o9V81@q_6Cp|rXsj%|p%afIrh24JR54?{Z
zJI1+l=V;TWjmOWg*=*+c@#EM0?D6Br3mx>86(v3g&h5c_8gb}^YdGJxKkeq>E=>vW
zyL!f((#m4B@x}6O>ihoPTs>Rv+HMAe0e^pgH8IJ*lao2~*Iz8S+*Q6ZJe<31HU?g}
zKz4RE$=$lKqfHxXEL=#nrAtxlcGs}Vk3Pcj!w=X$_yA?#z#Gd}xoFXiXPcCp?wg{m
z*8|(W?*Opvo{zRhJJ4MF2BEaF?VPK=*4FI;8m;<-$H&J<o!IPjI_Z?!i8l|w$>c_p
zu`71=>Gsi!UaYgOBTyfB{kfY$2vI_Q`spVCx^?U3vHa-Kqa-IM)3IYmZ#2upnl)?i
z^Yc^Z__(cJy_!ai8maT!KKS4RjvqgsZ!VU%N+EzNYopO<q+!E`9?P9hCkGE6M5oiK
zJy&^)U1w)!bMD+Z5)u;Fzkfex&Ya=H4?isN_QTDeLvnI5zx?tG=gyrYGc%Lq<YaU@
z9Ycl;x#?__#pTqgQ^d!|)2C0Ld_xP@uU}76QWE|9_eZDGapue!X3d(#j2SaHfBrnt
z(b2SN(}tv^BtH7+Bf59*?h%A(wOTf9+C+yA9jH~S7JK&WAvQKP-}keA{rY_O-FM{V
z<XknNKXBjxI-QQjja~UM+*vcPOjh#q&p&he^l5d-aX~I#yqK>?^>*R4{NML?Y)GA|
z5ddUl<?!|Do!)B7E&1lB-6W-D0<PY-K3$rs>#hvq+;fSZK6j2TXV0qJeN?_Y2O=T}
z3k$<!GGPo4=k%~)?3z25v^*0*HD}MFf8q(0Zr!jQIU>CsrGU0^9~7f&eu6XYEVd)7
zz1*UkV?XvYjzrfafAqd+oAp=MX*3$NS}jJSQSFHf3JRjzrEUyAF<jklmu?qNYMvz9
znq92dW^a0<pztgOCl=Vwc9bjrY-fA1v_%L}y2QrDGH%>B)~#CyfZc9q*REao`ub9*
zP92YJ7cN{#R#wT^qdjxx4CBU)Q|GLurKJ%a9Zh6pq({$4W@aYKmoLZP-(OwUxpQZp
zefC+8o`|DIkFs;;PKFL0T5>0m$De=xNpNtmM-gjq1!$W#ZK7`7x-@9e0Dxu7mZ=#9
zV`5@hvSbOncI{%qgbD24y}QKQ?pD}y$jQkeJw2TtfBcb)7ccVYqmT0Dn{V>)!w<7#
z#||EQ>@g1K8F5t_{O^CRx%veawcfUE8~*<OY60<|e)@?H9Xg;W3OPABWM*dK=jVry
zj}J3v&ZJwnZuIQgQ~lemTQ}Z+|9vbL3t?elIGxS{hcDKtQ-_?K9OB{%E+e*O%NE+V
zZ_l7XgRokySS%LSu3Za2y?VLXzjJbOSigQf4?XnIRnOOAv2f|qr4pH2=nY;i;54FN
zC-wExjnSM-O!H!E3NJN1o5dUUtM7;P?Vy%OaC6`My5|y^OeO*Y19>$jhPsz70bm10
zMn-ZrD2UL|P(njPF_}!*>(pW2^ywUZ{dFv%xpl|1n>S-<(E`WVvDh*)B#`qW#U}u5
zi-GEU`~Dwr=45!WMK{52!M1mS`c~JZFN$A?$0m7$xWK?bLPA0a3JRiMLO+I`%$;|!
z+OV3ZHLeuQMV;dME51TOVKr9|lE30BI?#b(48wW(PZUvfpo0W)Lfipn%$UKu@4m~@
zrAq-<@`L#JctS!#JTmKT*suY+-A?!J-AlZU)2C18-FM$*^=jAevK1><ker-MczC!+
z{jWK5=FqikS0W-JuDY+BoE%1u97(fg&6qlMYO%MyAoc6lN2Af?%bXk+7ssYen`qRi
z5%ucT<NW#aY~8w5?YXH?p#r^o_h$I;;nb^FuUKoJT~A@pK~WT9V`G^<eLB^vS64GS
zwrkgpDO0AffB$~I{`%`ub#Jz9+cvaXZN6SHfRK<7A|oTIQl$!e_Us`pE>6wZ>gVT&
z$z&omH5I4R$roRI!I?8>^8Nk(`|l}Nt{fLGTtK7I6qxX(S+i#N`}=d?Dy6Lc`s**u
zW-~o|_QY<t^XaFb(!G0kDpst>_U*3!!_S>N$6If`Mc1xf3(O$v78@H&OiT>_`q#g1
z=G#^3c{PA*)3^rB>$`>lSgbZ?eD9qMN;m71MO(<o$^oEG)d;$_saN238jS{>PN&}d
znoK4l{QQ`F_%NZDhdo@<Xm~m_6sx~KAt51zg@q9s8cJYbAQ!uLXUDvG#P#iq)BV)V
zW<x(^iYr^?^5sRJty0`DUBg}|Cf6@-r#TIK^b#+(sBmlt7URrtJt<TCLeMpRq`>X2
zypG*Haf8kc;^Dt@)A=qjEMXL*uv)D}8pI7@2vJ0_jcr%mW;U~lB8t!XTwOLD*JSFc
zc<1Iu2vKq>RH#6BcsPCf^kKt>4gC1ykE~p|lJe!t^WAsfas2pkzW(}aHgDd{n{U49
zl{S_yU!DpTD$t`x4_2;R$&n*RShZ>umo8o6|Nig)IDGgpAAIluTCJ8rg9cr7KW4L;
z7hZUQ(9lp;uU<`XaBvBpMXuhxdt)}6J%(|nrKR!Sd+%Yl+lh>fL{Sue`spWn^ys11
zv<nLhqkjGR==J(S&50@wg*^v@!GP6j<<Ox+{PN2$9{Va+t{hsemXwr~Qgu%j9v;q+
zAwvr6k$Ua5*J$0kHIpY#X3d&4j2bmcE#w^$5kad~t=P3|7ePTmJo)64RH;%W-`~d`
zdyLktTXXW{Nov-tSzyV93Kc5QqD2d}H}FdR`t{?r*IpwqFp!B8ClVSO%A`q?SiXEY
zt5>gP+O%nW^wCG$ci(;V>C@+$=llEbzvJucd);}ZWtI0HcU<<ufX)mV|1AJp_n+j;
z72A2HPkS%7>iQOM*w32Zj;QZP4!U+NE=5t$>2&z|`r>dnu-olavD<m~&>>!F-kfZ$
zmKeRBA%TG`&&tANFkmzqF&d3zWMq(GFmQ6j2>$8OgZdwTjOlXMyyow}(e&$wy=zzO
zGiRcyTUX{El{AeOU8^UtZhRjATl8X-&}wMwmj0(cj@aGU4*a0L*R^~c^jEJx=e~}O
zMx)1^xR*}9ghgZFr^>FmCbNBJ6KW3SZQI*wk=k43#PuKH)q2vlvz@){Wf-2B*xJ*c
z%2ehY=We+TLWt7s<(FTkNs}fVIB<Z-$VlFO_gz9lLRhnA4a=4-W7)E0G;P|HfddDs
zH>f4;)mLAoNs}h*-@l(~)vEE%JMRz>5WuQct5~&a6|u3gbn4XUnm3-=+1b4M>Z??%
zR*lzRe;u7phuLhtW`@Ax^6<kCvth#q=FOW&%a$!Ubm$NZ7A#=s(4pky<dBe%z=;zl
zIDGgp|Ni&C^JUpA4M9#}&jDP$c3ZY=$=5@gnVE^h;lR(&@46}TOVZrAbFaECGBT2d
z3m1};laue~LQxc+d+s^bu3gK<jT^7|P+{M`eMCn`Gi}<m0*lWB3>h+n(W6I`k&%&a
z9$ZjR5L2g4B_}5bMN!mV^EPeTuz2xe%w{t_K0Y^ePqAdl61sQqo-bj`?Lu*uf}fl(
zmT%*$Rk?HECXRUUs=ZmI!S;hOjG4I-yWN!rwNIC(j2_(ex}S4r^U2A{AtNJ$<m6;h
zQd0OSAb`nv=DH0wo0(;^p(qMgtCg&*EHW}ONKa2ED=Q0&#X`lkYpFeN9{RN0VW&<X
zA8fC@0<XW0*5Cj7NlrwOvaA`4<L}EggR}+=y{Dpytnb}MU4t|E3_1Td60ENI2$~8F
zG4z^x-6SmTpv`@4rlqBkl9EF5rDP`7pUBpTt?IV#o8RYU&CBR?x+43JY&+Z4VUl@!
z+P>l|hA@P8c!%+L7V&LGEB3Ni4FZJ_;#x8@Gr8-oyXe`o=QVG9y&*e0o5_<W)2LA+
z`t|FlE*~{&)K$~B7v$c1@1=V6>U{OpSGU}z^z?K#Y}ml5Q>TcGjO2j_9w00%jO65G
zR;^k^N=gd7diA1Kty=l+OYC+#ojP^G$H#|XfBp5A+j6sR<s9;Q=bd-><daYM?z`{Q
zIc3G^%$YOPs8NH>n>QCYzpW@Z91eyK9m>Xy8`-mGPk}*^*=(kJ_wE=B23D_Loo_g*
zTV`e^QBhI6{`%`Y@x&9w(%!hZI9j)E&Fa;w3tc;|tnhjd9JuC=#l$DFb^l2K-krOS
z3gJOCtX=UspDcN&;u9J7*-vWl7Ik+uUU~e+dRnebYGSwBvD@wROi3Z`)G5BboVxXE
zqmf2gSqxVcj7B4Ry&fMQpWNQKj0`S3_#hWLcBIby`BYrH7R7Ey$;m-Kc`}Ygi?B_f
zj^@7mZY*1+C=!NlZ;`X?MVzT|V7FjhKLJDEPt;NarHL~u1<TsE)!<DrRYc$ItsBaq
z>AsfSJ<5>#aN_Mh-)6LKGzUUm<J;dbzCoqzN(@j20C??bWCgBWd{qb`3Q`K5aeK(l
z&SvDukr<6e!otE>vt|v7qHy8Dg{#ghDhYvsfjsg^{^9qbp`kqW)Kgw)QQ;NEIjmc^
zjxWFblDFS}yF`MwlA_UQ_~esMc=5#-dGygonKEUHM-TDw<HvdZ_16gr3E}h4Kfh}5
z2H@}S&$w~p`1s?G>DRAcvGf{$_~D0i>(=eI4c?%X1aJWFJbNF{O#Gfx@rhWhHeR2(
zk`G^gnEEwJPuJ(E_(WcsvP3OBUO6&^$uIWKm$>9w@&<7M0Rif8%4g!^iTC$sb7Uj{
zWBmN6os~uR%iHR7I*&juJw2UFgMs5CNAgdP9@P8vQ-c2Z0|3pbQy6;p#`eGi*r!cH
zQ?sTFt1Jn6UknethvonNgEK3|6(p@0i{Zf!@+AfFCZ{<K>(B4vOuyh-p!daa-^4<-
z(S04eQxUu8Upk#mCLNi?n8sr`66_jcJj8bhWWxZw8^j4A#Pu9Ga)dQ&)({^bPeMWh
z8#iub{P^+s`};F`^k{E4k1=D$@WmHj0Pyk0AA78O?6JqZ(Ij!%h7B8-IddlOz4snZ
zKKZ1#n^WX`eSP`z%P(2Gb}e6h^%ZN@tU<5W<8(TSkB_Hs-@ZKd*kd>JfBb*}1NiaB
zANlmtPkH5)SBkWq`}gl>`}XauT)DDH_gmVOiXoJ4=MvKxI^laYEx)hPz#Bulmx|$(
z+YiPt?z5lN;LX=);HwFbQ>{Yibv{`zhr@x*W+OX0o3ykvl9G}*pOL}HCQUdI6a+w!
z!@+N6Gxha)G#ZWi8FxxocW<0~SY@Rjf28)jdFV27vmiQse6Wof1Fya+!zxRN<J=J}
zt4D*wH7Q&13qjvwe5n{t=}3&hx_&}#@TSpX=s6Kh)th@t<?ea2SS(~^Ws#biN^){C
z=gsGNzWMXS`MXjD`#b$vVO~LJU1zjf?Nxul_ojEgER$Cbd%T$;l)dTA0S*vH!KsUd
z5aLc#ltU<QMQIsAc`MegUCW|Hi+JXlXXw<a6K1oStgI}8gM*9xp=C)7p)5#BN(vbn
z8Tk785*}Xokw!^LNeme>gjZjEwa98QUc7jb!Gi}gX3Q8mb?S8e50qi0>QQ)wa1-yn
z*o!cetL90z*}~hO{m7Rqyqo@e@rM13nYq#<c$@xe-<uBJpx}&t<$QhfWu|<@$A=WF
z6>t?wG#Cu{`S}qX986eP80E^9BQ!LWfPetbKlBjWzy6xD_uZ!+N6E=SKXD@3mMyWZ
zUoY7zOMs?AL-hX|tqw<YW~E?R`3m+w*Lk&F_7j`1tbD~Ic++=y{-%RB@a$3c^YbGp
zD2U+TU?P1YnHD{bDw(b<RGCU9eT;qBW!rVl>u(jS)b#)EKR2o_uA-@DIh$|Y0S?G8
zN+E<0MQ-E9jqKaEkMZNjt3ku@<HuRHY?;@yYZj-FkPxa=sd7`n8@RHNe*E#reE#|8
z96fsUmfMq=naP9+6BsdK#BCqEK`9I10GiaT%-r#Vs98Dpf|$2r2V-ZgR(s}3N@{vG
z@6KJvjPHL{=e$*p4B@K@kJF@X<?DR<`toL`bl><^(d(J;`|lVWuH&85Y8j~0k$pKO
zyF2i6*Odzn4kkQ2obd2)LPA2&l`qe+S6*T7#~+iPr#ijn#0d=d-wy)^VvmiLAg-8c
zYj^e>I_a=u-7*8~){jfPPMk9*1KajFST{}0o%3ciVYvT2w0GZs%lp4_Zf9_C@a1c{
z3KI`cB-G-1(2=QR@`%qP9JU_DZnqct_2<qu8BMgu^6hLVo_LzktVoY1gb?D^xr>sQ
z#nC}O|NJwvX3fH2FtB^~ZWb(9!2J31nLd3w7cN}zYHho+pjx$ReD~dV+<o`mx4bWZ
ze}6vt<P+|{|JLto$^z{>@4WMlw;OS#KtCh*wZEIc;u48Fp8~+?vq>!bB^tZKLEUPR
z81%*WLt(Mn_-ge|#?StVqcORu$D{79#;h^@hzJcVlH<6CGv-Y+;&3<!$;>1)J)Lcr
zQ`4T-YDu-*>E>{t(P-4|wOTD&trne5hrwV#uh*;D{<1<tiSODKOK>p3fBb>wa<87|
zk3Z0S`6YIz6Gy97C}sE;XKAMdMxw3V8RxkpIJ1%fa9%u#{g1VvXwj6beM3n@Zkof6
z{pe3vH@=4>J~yb*gxA8*Yl`dmMI`UFoOg(1fH{B`=UT9-{3a|K3z<qLE3_-<XX!_f
zCg`Sy^u`g#eCE@F7Cgv<9_!LcXCVtwQ0Po&03P8H&T^K0>?@LU6+(#H!GZ+~2o4VB
zp@$yw%JGjKJH}_9ea50ii`cSd3keAcoI7`p=;&wy0s;yw1YMe(IB|mh{reLg9nH?2
zJ6W}A6>HY4VcoiQ96frJM;>{kM3QKvrlvA;=1c|;9!&M>)r<XjqI4)#bKtIIw>$V^
z`8K}!X}8Dn;6Psn_iD={|87>O1R^(byfwca;fv+l^7Z!h>C%)}9{*R79?#9`bYi#L
z$;rv#(xppkd4V~VD)D`d8tQf*XJ_;5<$%q7gY2GzWVhR~SS*;$W{>%C+1c4>5)!C8
zcP{0xC^qS+TNm5x*=Ra-QUgO#4D1%HTW4WE_Or)gB`^|Q%m3%97gxlAoc*sY*!C>I
zndUj1P+Rw3=sUf5&024_BJZ`Fo}NxhN(!l|sq8WA;f<zmkgav~0M@bBVS{A@RSi{d
zIKhs>)wjtz)N%q7c!zh?_m!zEbKisz;tHi@4xG3(-kJj^ysK0PaBc_wjN^;t+c<P0
z-ebA1(ZD^;Ytyc2Ejl!<iLcR6=zV9KE$lrS%jUf&*md|csp;7s>+4jFVC0}KG_Rk(
zqI^+u2VrKjnY6Stl9Q83O-<#^`t{jft{mV>8M-Pfi>`XTM=ysv`=2|>i94Z0W@e@<
zTV-Y@IXO85{r)@kKmHj1)2BU-Z5uEE=hUfaDpr(imBq+@dI$D>-{DA%@mQ_|grlhv
zg|<dpG?klyw(!?6b_<Swe#d@h2aed?I5QGGk725auJsVKwTfn<@U^(F<tu}@ZN_c9
z+3Zd1ifc|lQ(IGhw*E}0AylqAA%rMl62RRaB!Ig!m5Bh(ZR`G%e70mOvFDQWtuyF#
zG_PNU#&s$Y5gJIC$)B)be@p?sM1%&Cl$J?yS|+LK*(4;Vla!Xp(U^1W`u#K(t1aLD
zDo2JetZ#=B&478e%#<%SZAwg_YuIL}!@-uE9O_>V;_}|~x&t}8-Hz32B_}6`tgI~3
z)6>;#l{T}P$}3k=>+7%4X6FX0PLm1S*s<`!3urG_xtAO2V&Jf2Kd}khzVC9AiR7g<
zpsCypO=LY3|8SIma$pQXF`7^U!f|FK;xwm$`4Y~Ii#W4Wa9%iuJw95U-<Fr+7lN+k
z<7n&mDBj_kSIGN7B5x44A#eke8%<V&xHh&n{Al};5PgUQaYBfEX3Utu%$YO2-HhAP
z`Sa(|>2x=pghG@KHk*z3_;|{fFJCM*)$SA@e)wU5bpT7NG8MpqYnbEu9e=QJ-Cj<`
zCtm*pg;Y5*g#O){)2B<*Vi_)ZJr0KhtJSKeWKT*;;*`b0@Rlt}Hn@6b>e%gU%gG_k
z$EU!X-YbVyW@l%6468Jo&1lb^qwd_fL~h>fdHe<qu+5&0wtahbPLn7Gb_=$nYp@?$
zman(0C@2BpXzTSr*S!DD_2?CWyg{6MXmDCu8q30$F|%Io4OuTsFTQttkFVZWf;b_B
zhb>#Suw}~@Z#Uz%<emf9yLWGIH$~h6_Z+w<pL|m0z}<p}9(stTO`CeV88@uV1#o%A
zUr1r&u4C*zd?w%U%EG8qHG+Gi>e8jvUAI&kpeVS5FRRr`Mn(oHDJdi;C$m?p<(1~m
zv0M(Qx>+nNcR299TqCZaAg-WcmF^(UJ*+Z#-#+Sn`YC>Y|LyU4+u*@C-g^&iWTf0w
z7c)m<435(~aGcqhZ+K;4D52HS)@X;OTB}k~a}IKQm9Grqeu(^m*>z{D+dXV~n1#-T
z==FN({S`up5+Fk;Zx1qr^3GJI1Gu~rlGE9`|0KzmveY4xNvWBnWw?e+hMD{cHTe@9
z=o(TP5gJHnkRP2|)G4y8l10TGc;)2ekdcw0CN)`MGVx)92I_Vr&1ODO6!e#axU22!
z%3+mP76G?rXH$LIGOB<7eg0vUlP1A4&&aUK65`BA#BpW^&a4!inTa^Fk|8Svr#TI0
zMj}c;IEvBa8de!l&Na-^F9c1MmMEr*-fn(@@(vBo8^nE5?Gu((TdHn1JZCu5nJz(`
z5JHpy3E*xI62RS=ZkqxX5ut%R(zUs_n^7dLtgB_W+p*j2^h!=9?#vk$UG5^EVKh=V
zJDaC%Hjm7dSMDosig%q(hhDG8$Hxbw(dbHYVleRcV~=sROBd>W`YGkMy9%c(X=&(R
zdI|eiUtym)6HU8zGOV(gDFNYV8}{;cGm4bE-l5TGR39ifolc%V^E?)fg;iBn0WjNV
zHl`dC6KoUE>2wmn2_b|KLKHym#7n8XL0mvU049@(pr9az#l_JkF?Y_?OTNBrvDvWO
z?KmzM|Gw7#+&9vJfq{gCgix+rIl{xk2@VcMQ?)9;PnbaT<jG`Ls-%8a8y$_lOBbBa
zJ%=qZu~>>Qi`$p`0fJty$Jf`Fz`#I)gM$eQ3gX36FVZQYle+B(J|8g6F%6r|cFpTq
z2qA<J;!Y(2Tq))*itOX#qXu!o0Rg=I=bu#1$N<0wJZ>~{(rU%wa9lI6%3EmJU@+k4
z=SNUb5TT)=lq*+`u&^+Kf`UkI-=3Xce8H)wp2BfCaSApYx-Y*(-=G1GFTPL%MhWD^
zjc^BXI-L$*Utia?92`t=KrnCr`8H8WQR=pD7~f!leSrjVLI@#*5CxC`u9S24n)&+r
z5)>4K$z-COuP^WY{yU)-3jhfk4Sfv;k}Z}S3aaw<#^ntT!@|NSSFRi(AtCsMh7$Yu
z<LsP2pQN^Jb3dDugnq;bly>c~?b?OI;gFkbaYNkKox3M4C@6@KkPuA%Cf+&v4h>Tq
zs@sn69l>Jz;_LP-3n7FMLfmO2fGY#?&LMIKakaEs-adR7?d4$Ym`=yzIvv&<=!wg_
z-@E~$dst<7csOBUVFU*U<E&PVgOet4=$&^kmoKk=R=amEhI{V8@%;1HlagdurMMw^
zgE&7wKTIZ*YbdX8Ii~zRg({g<0I*?WsBtJ;Y+EFV6G8|fgvdhzxH2H`d^q<_ugPR0
zDkq1R|NK+k?q`F6akz>)-e@pY(6CB(Z=5@j3knJ%wR2~7%$vvQL4!PoRq8+g9Bspf
z*cU92VU^;BTzNeQ1qBft989<|oN3Y1)F3WL$)S(258G_p<N<*YLI@$mWfH)Z5myW1
zdL<__;LI6yyZ;)EEU?=PJ%8xRVU_;={sadHtASi-XehoRA)I;oX?D$>OLD7L>Sr|x
z2^gM!8l_VwYzGg@uu5@VS7urb4h|+bIG8H>D!hB>T|zCcdW@M$CIfs1aKv^*f;b_>
zO-V{hV(QeX)UI7yosV0)c5S9kok~(tlDC_e&#6<V7%^f5p`oE_d!wSFShQ%7x0`m;
z7A;ytR8*9DKB1wZj2JP3Q>RXOyJ<!4^Upt5|Luh9=Wp!Tu_%f{j~+d|-JILTZBqyC
zPT_Dku-ok(HMNq`(iqdA0ei#30Pt}-S(}|rN4*}cR$J(_|5p|PH=E65XJ_Xt0v_?}
zuhgA87oUq4b3d%pVSV;lm^2AZP>>V>7uV#jQE0JP)WY>CDJdM|7$aMZBu$?NK!hWL
zZ8_Vhp|62ftCed?2ysJ_l9K4rqX+x;?E|2D_wE2}*suYBmMvSde*JpFF8}}OZHEpW
z;@*4jB_$<=kdP2swQ5CDQj*&K;lqdX*=L^>$+1eR4%~<lBbYsVHsJbxhlPc)XU`t>
z95-*?Op_)}inR?T!5w(JuPvZN9y*rhI&j;zZDa7@!NkPG0Ir|E_3PJrxmC9Z>47U_
z+`}D>Mx#e&$_an`L6yu*0CE(Cfkq>z3o#!que`%5^?E)2{{CvVO82nJz`#I~yLDs7
zym_1%FaW1k>-w<GhW^t}(Kc*|W8p#>Rw=GYQ51FfuD`#(nw|14=Uq(reFDCAUjPy`
z3EXeEpEzrrTu(xX8#ZXrAolIsN6VHiNlZ*+{rdH+U%#G%2M-bw62iWH`xrNFoVS|^
zxPnc0@HTw-aFUagS-*Zgd-v|;haY|bVD{|UWvVA`>eQ*so;{n8kPr?YJjmX?ds)AJ
zJtt3|q-D#Nq@<kf&?*1`AOJ~3K~$vBw{Kr>H}jUQUAvZ+EnBi-!v^&s!JTgE)Twmr
z*pZl+82O$Q0}0^DpeqxP<jqWJvRZ+{XQtc%D3|}bxo@uB0pq}s5UN(GLWBDCY2B(7
zZ#Hj^F+7~p!-lbI?p#t@w8(Aa*|X@McmkzcH*80a$W6Dns)A}By5@LBG3nqWv`*K<
zfs@*k^wRet*^(^RlMv#%PMtcX_J%B8yx60ctx1z6YEM>a35Ygs+(=4F3bkt0%Gb*_
zV88%|4<8P|%9Sg<(Y%}T#TQ=y@Y!dddGxY{g@v(r@nQgCVq!RS=#W?1S5)r5|9${|
z_~8fXVZzn(HfGEiTDEM-Z@>M<TW`JP?IzuJB!DZU^48RHXQr&9C?1(9kLYwfbpx3x
zn*;5yaV(8SLzGs_MvVrm%|=#sHZ!ua*bx}W=*EpPnM~O0)ZxICDI9(Mbu6Kw>Swi^
zH)Ckg0>_v!*iuvF##<EV%9@A4!NHhJCfb<W@aEw+)gbPO?g+i~y-2a9$h9PdxTcL8
zHv+C<TQzIe%(uR4*RBAhq@=KI+qM#ITS44`*|1^53S9rd0}lYGflq07=+Gf`=-hw-
z1M;n}S+gcBTebx77<O0|z4_*woIH85!1KHlRjgQ%DO0Afckf<0bm-vi=G>MffGeX4
z%H-#|;WhK0W5?9()?Ozw<&!`(@C9(S4(_>mws8-48?MvwZ@Zms{{F;PszhjLD1m{2
zT<qSR9rNZ9*SD|du*#1<Lff<{_T|fESfwaX-r>Q4fq`le*X>d_UjFlCb-P`<T|B9I
zl5A_XTt`BPtJ=JIGXPz>bSZFsSXdafYSjYZ=+UDk)~>7h`RAVjXxFY?f$QtltEav$
z3q4l5cI^VV=J2_ws3-sq95_%SZ7MGBz4u<JnMYX~)T~*P(W6IuyBW7N3E;}GyfwAl
znf!u+g6NZ!#KV98t#0>Uqml2gl9_S=-~@(V<2cJNe;rEhuu7dyM~lnJQQ}P|!o$PW
zY?X$H2u_X|!R|S8NNdzc-H+z)ztQ*W2R(aYKYm<pzC}KHd*a+dTu@LD4<<dx@Dsz;
z?baIBGDtH>y{6?l5<*-lH8u6R+tjXI8-TR5wBl~gb)}@FTyuTiUc~hD^x|&LExVEL
zY4z&WfgAg`5<=wCdAk8cCEILa=i$@DUq~f6Et9nLY!Xt^NlMMcVzr~yYKRC8Ak5@X
zsL3BwfG?FJLx{S&8o`0S-fsR)a|cvDK0a#JNW0z63$d}p`TMJxDPQvSrFM2UZ7*l<
zD@<m}1faqd%QPAdH80;Z@AdKFnZQ5{1_MT;5u?#adU`rpciqLl>C-9y%P-WOJsbVy
zU*@`Be!<zS8Mculaf}^{*56-EEi8n4j;GORR5PMFolXXvA3%yBg+<j}^Ho+GRx>JR
z6w__f(d+d9at#R~gb?DkSEd8Fq_j-7N5}BX?qeJ{7Khz_?b>7U7xF*d(rPs{uUCam
z&1=)CMI9nS1B<J<#l{_s8I4A@2Akb(XTl$U@NDzu#QlHv&O5$|`v2q4<T9JINe5+=
zAy7cJOhp6%zgk4UI8XukIv5U6aeyFhL{a#<zWNisg5p*X5L`%c;8&SaMv)CIt1`Qr
zHffT}{r*Vrnsh@)TD&KZK1l99clWv8HF>}8y(|{;H5zU;nb_!Z(XvP^RoB?<QnbBB
zqrqS>C{-(sMk6MZNohN9HX(ttmtIP{MT=;*Y84t$L{nIZe$E_xUwnc0?YGem8>X}z
zP>pbvz#Pv&5jXMJMBG|8U$y)SfceJxSPQMZ=zS5LPS>FB9jVZPFKs(g_Hm?wEXYqs
zD#$|0Ka1o@M`MjaV`+pYEE2*Z(O6>8*qWhj-UE%v7V7D%sHmu@sHlX91}Wfv+j@}C
ze@G(vKw7o;C5k?_>^{nt-A8%tlb`9{zB&KAvMbjO=u!hStvh6cR~B)iC?bj?FYVmP
zq&|Ic=yXbD$~7JjQAOdGHD&P1y}9J@O1)km<c-TW7})>FBm6aVC>Ou;4iS6y0RFH_
z!wom!z5aT{*I!55rp@2FcbsC>=bnIqEF@PhlH)8=emeL>&<cJ--r5L_DFRFp7o<@y
zUw>J|0ZORk14kYp-IUI6vA+TEZ{xp-az*i&_c3%j-8uI?tV^W4(};&R;5)h*--(_6
zYg*n|M>>)tz4QvLfVOc*v={Y5Xni>vTeDi6v5Ja{ii(O#eWO7MxNUonGk@uC>^gL!
z%=O*dH>YRE7DPpa5oNa!8yQZt-9pnC8)q`}$jHg(to(nLgKc|{vn%C9kmoM>KpM#h
z(pZwXl}Wb^<g#w9>+1BXg>3NZ^?J-^vl33(E;Ey7|NN5~mt2CV(Xd0O<33U3bB_nT
zUSA_(Nj4v~S}l?!Df`vy^%x8Wj7B47v)Lb3*|jTM-g=8>t5y;J{`<vYmEV1b^y80s
zr%%T>b?V<LtnyrpdH^Y>jQjrrH0lFIoXKRuX0s`txM%l1%hTGY*%aeXlAmFkfz4@S
zJmc%1i1Uev2Y$wzyc{X>NR8~zcXAiLle_S4T!_Zr0$tbP2%WA2tx)~_tEl{q$jHb5
zpk>RJA)ZO)$a4jMmA?xCIZv*vDxoSWD&^B41l+-6XLxtnI@a$<30iK@>*(3B1%rFH
zr+<&OMB6Oo?jtrToY<&vI<{^Sv^+b{$!}W^vOYPLO*;?c_IQ<JKKkl1dUkBVgQEtO
z+O9qlSea6iB*hEYKP!s|_wVOFMHQ@87>zvda`A#FR!Jnq;;%wkl5dOt5B%8G1cYY>
zHUpQ#D)aL4a5x;C{^vhAbNS^;SS8>Ot9;=Fe4l=b_l-9$?66AJsIL-%g?a!*!1;VW
zp4syZ)4NS)mwguilg*Q{I<1V-_{%ug2N5S8-hg-0BBbo&rB}+LyID7Xn4~2JO<1Hq
zY|<Lz_rT?!4GORHo!o`*)b1dWFJ&Lc^ZPq^cdkI!_b!C^L3MY6Dk}AuAw!0cn3%{f
zzx+~WMZAoR43d(P0O;7UV_i?L6bT6lBqk=ZVZ(+pORsO<ycvMV$jAmEc;srD6}1SE
zD{lt&h*MEfshoN*;6C_zBMX)X_h+$&85x<-i%|)^v4$C|wSRlKnc;)FF?>)roGv#@
zf7;F`-)+WGPzd<Fe&e3|gt0gD<K7YVzn4YH%9OH*yCprHl(aOyYu+4yIVKaGolZtV
zr5=kOKqCHj0)f>kWl>jF1xq=cGEm6L-Z(iwF5h5a-;^mzSY`PB{QziFQ~hC;x7>m_
zcP`qNEib6BO4X=8Hv;eJu&^*i!~x9NIfn;&KEM&{5xjUAXC6lrXA=f72nd~s^PSj<
z_m7Y8o!k|?LT^TBbt&3bebKh;U18X(#u|gh8dGYyROs+~YmaY5Jh~YQ9scDxC-D6E
zGUE0x(e=L{ZL@AQdQK`T4UH~c{HYL$iHT%nWRxoNF87IR+qP}J5D>k3^&&Abk)=zQ
zmMJ*D`|dlS?4D}%kw8(rYSk)+4I37;J~cH}5zul^J{1*}s-cnUY5i@t$IHv_C$f6O
z9%Y#zXt`;~CEPvyvI@Oz)x}Xz$cNu-Wa*FF6^|Uiz+UZm{=Q+DO@>-Kc1<DY!8x5y
za&mIW%*-SsCx^$obYWXjqiu^Mkyubb-=YE}!?aow@wXKyi5#pU2k$Ke?gj3|--@6j
zWP@8QYGvSZxhN<oP>P)7=jY>fxs<R<ox@SQt;K?O`gE8&6~Sn1(B8P3FzU;rJfmJl
z8`HMI8}+j1&FyyMa5%`$&L%4>i(~F%Jl5kej$8bK*dke2S-6rbg)8g6u!&E^yLl1b
z9m|3iYfLtTUZc@<8D6s<QJ;voe+}M0KJttD0ECX$q96EBgZ99xs8pBu_;^xMQW!aM
zB=5ZQjw0fclam=dcraO6S$y%u7xh9ErKYATed*@RnG+=97B61R=+UDANJ&Yl5f9wp
z!GpQzqKo+8gAb~`ukx5QX%h42&!=tMwyasRMwxd;Mg~KN4kalmiHQ>@GH>3zTAM>C
zkiU28!o)su<Or=>w`T3ywG0|GsMe2nKCD}}jsXJ(kdTnT>eZ`5J)H}JdMV&Ca`JiN
zKP!WB-TGhBmPf`6rg`JYI-AGI^c>#&Y%RZSJ*X^e(>#V(AG?{RG4;P-gq#OgP*6a2
zb~c%rnf#TX&jUr3DFMuqgtHt2x1>002Am9d{{-;zIm|~kz(rBS<MH5hI?2z^SA?9?
z=|q!}L5KhTmnJ{`6nrl2+xx>Ruek=TR$DK^<Eo5m)YlmDJycj&NPd1kSy@?RWo2>5
zdx*(>CX;E%1R&NI%j&|_bk%oNJi)a-H&+gxA793o77%bO7|`{&4WZjjXpGj{JGkh^
zyKM>HKUW5ccWvX2=!ZV%_vWgo{0#{dYLStV^zGX>D0H&EiHAU;*0yb1;^X5vbm$N%
zDgG3aniQLLA>aaq8WcD6mcuH0_wLQ=)vFtP6YNo=Mg{e<lg}@(iTUKolS_FaYl8YH
z;8IglnKWsV@?QR%lm7-~=FOYeAi{y`BlS+erKY9x=&Q>(lUdxPa%4g;9vU?WK?se}
z{@#l9yuV_D@;=&T;iZR$)4hH3kj$s5$eu5^+f6}10a;mDWM*cvTNHVycW)dze*|qW
zkB1+<ULp*JItf*jTOD}4UfgasPNx%x!{M)1nV(N#VIdJachd2#x3C;O9JH->)F`C6
zbI~?y)*!+vRinP<k-fRHCr%b|``E{no>PKE+^>bd(oWy5)<v8zJq6F|nMir3m1RQw
zAawojuhZYN<jTRj@jb+SYm{Z0ut@YnpF`U?^f^8%Dxn}bIhl9geV4_H7c0%O6A}`*
z`|i8zh3Bm#t5&Vz<BvaP$&w|2Kj-b5Yp&tJ2OlgmH|~6?3jqgy<Nfv5UuVgZC5jO3
z-Mcrp-g+zJ$B%FD;te1wDyq^(?En4mf4T3z`)d5y^-;hjCns~sC6`n>ZpV%t^&)(^
zAyTgdTt-el<DUCO5pRN^W!ha=Gkj3!!@gE;*u%^3Cn_P8(KZVUpBqy%p13#Pghw9@
zUbb~B^z2!BY)K<@*)kY0qTF4V3_FuW-0w!CQkfFq*1|$QmLv=YL!E>v28LC7JRS-Q
z3n?flP>P%s6cpffxoEy}C2c<WBsi?nX2bi`Q}Ez}^*XFlHR@{*`Q9lkEDREHe;EE?
z#w9aw3QhppiS0;qC(_bTdwG=N;SG3xo(mrTG0_U>E**#Nl3Qy0SXG|W-XHM%_I7bz
zq*g%xj~NJU2ZU@+Dk>`Vi@FkUDz!^}6mTlFPrZplb9=lz@t>87c(aBXd28Bj^+LP>
z486P)@5~sf<lbfE<TLg4uW-8D)!Xs5ZGQ14NyR@cT0pN}{&j)lG#VH=vUuFck#Nf`
zuzY#ByDwSP#AdT$v)SnHbTaY40cG4$qmdT@uh&~AG28OIbUGbIqfwb#OiT=o8Z{y+
zDvGd(2u|E~8ynt#pVNZ}7jK)BgMQjHgx<aJ{`xDTDB|-~+{C@E5f5*`y>d#ic+(2#
z`rU*6>KS$J`O=td=m$?hKj;x9bW$qF!o6||V#@DzI+vOvu;Qx4V!>{=W4GJsQ`m>u
z+h=3&`SVl{3J1B)a2=WMOr?)pP2x*W2^McgD~4-d2&s4jf2geCpRW|(Yd#UrPcN6w
zzf@6CQBhG*X>imV0r&FziAv6!AZVHM@J;mW*doNU3Z_eZGyeV9%}NoI)U<S-nfF~#
zAGvd;XHUNv3*?PA{QrOcdGWHjbN#|@@#5lT@@si~Imi_u14Ud!L<A$xp5@xV{!+%h
zWHPbL>#b8k6e#3OCKFbxmB`3QVq#*5iHX5(w<E;GvHR(#**0em1p&Q!w0rhoxaukx
zI~MP$Q;4EiC*rd*RHMF_^{huz;@?bWmN~XBeS^l`N5!Ega&^<d2LLvkjXs5an7(T|
zg5(#gdxgCW*AFMllU1W4PAbU4^ZirGb=KHhU>xx_+Lpa*WdGGg+pHUg5&wtAUi3NY
z6Y;Emq3k|_Dk>@}Dk>@shI%33KKOcLP_@ZvcU@iY#G6dV)=ii(t~e=m{f?AUZ4RnU
z>oS^$FIfUbJyn9}-ye=0t8|yLh%*|ESglrUHXGsL;Y>|Qp?g5w_Pu5^f4JRsDuzn7
z8Zev9L_|ao9UV<fObpS{(L_W<;JEBEHZE8|%7h7sX0x)r?$b}vcj|<1-aNc6SFLzj
zs)}mV2Q!LMEMgH-(ZAsg=XstlCE{Apf|Hz7#y!vTEMP&EMV!fGB0M}CyWNh>X5*UN
zYj}Lm<I1>Ax=s8`_!mx(vu5rOj}y<TXN!x(7_AtteXia$P}f*vf<(LI%E7(r+2V%_
zDk>@}Dk>@sj*ttugU8MU380Y)z3NTaWO-bD*~N^%saQ;X{M}}@?Jc9H*ZCqB?kMWn
zri4;9FQaHm^X72;cyPF7Ig~VZZ8jS=i-qTR@1|Kn0RZ_L4Wmsaj(a?H?$IhMtkQ0`
zD?%<RDhi9u#<AOPFFUMq@?^CA`y;MjuM|qDQ&gkA6vsKvSjH;vzvgQIzUO;o*-U1V
zMjDGL_AWoibM&DP3s_L;F#<htfg)~L<}fB6n5c|P)F(1VI|i4x`Xb-6_BDKGi$ajK
z0*0Z_6^r6}hQ=C$e&}<c_doQIvXA3l^I}lnKou1g6%`eghC|2&+`G$)#asVN+Vaq-
zL7|(>IWXa-{tW5UL3v-JUN|`<@{va>A6u5Fs{oBgql7EU#%`R^$V)qSVix@d-El$S
zcD){_#}g87R>`o+@bGY=qN0MrDzz<Jvg@g**gktU&bT;bTVeZl^aBSXO_+c;J-tpv
zsA|+#jphX3v)}VQ&1p`5`UfrVK@Y$mhFKXU?-yCbjXE`oF^9(}<GwL`!{a=z<a(aZ
zy&)dn5R^NpANWwc@2{tA+|i!{S%mLc65@fMLpUQ96%`c~6_xWPqylc+-s7y_;V&sG
z2wEN)GdN_e0?voW?z{?v-d~D8`9NAwzqs?}%{O8F`bzWK&KJ32qh7BkEG&$OhzM*p
z8y5r5{`n_DkwLpzujf9k7LUhs-iB^<=UG-*WmHrYjT$u~IyxGg%|>4T{%l;ZfYh;L
z@fnI6tm{7f&>vR0V1bg;SDWXc8ue8tjWn9lRC#}rlR@ugniaK=|B0VUtt$)p;e^?2
zRzzGxL<IL9zn7bj-K>n8Z=8SrBF-n`-Lyz~D|EaTq2skx-#&y0@q^Iy7^%GXZutnr
zY8GKqQBhG*QBkRLLaLVLFa1q<ebbOj>a<CBO%QFfFlJaE<^8-bf2&?WljY0(6)8uK
zteW>Nkg{41ltW-;%0Lk}AU~gb4;G8iFN{WBq3$YERy0>RtkP<=28C5dMn)1A6~)mz
z?qK7hMV#$l?8VV!WT2lk3C-n~<K48W_QEPvqrS?>Ic+y`W2IwT(z4PqfyfUhWDyq;
z5kX{RB;n!VOg=oBfoBFPW8XHu&Fj9`gG8MCbIf;)ZN6<~ihgnb8l>!^aA~6zUB3zE
zG{;b*>ovMKbk>oMcjt-_&q(E5S+r;oD^}FZbvt_WDAT7;CpR~@M)s$oqN1WwH-t>U
z{kHX>QgzZAX5{YSmxXF7)#CPR`(O|EhoK!knHf}!<($~I&EFEBfB)c0lTa+q($Y$A
zw`r5VI^{Vc7d4T~u*;PxN1r}jsxsxuI<8Dv-h4}j$;s6!qobp-+wDlLTCsEHOm@tg
zg{w&uWm{p(77SNjiFE({wGvjT8ue9UJ?mM(0){g@C@-!isYt{<yZ2f8pDh;nGfXph
zSA16yaXz1qqvBCIYdh0R+lw!KUj~af(T(?ykCg3oJ#MSrM(nkL-i)sAUCLYU_AikF
zn!Kw7la-aljvYJr<BvaBw{9Kj>FFVz&%giuZ?<gN!qA~ZYh-_|TD78Q&z?-0Gzo`8
zy$@7WR8$%YAro+)|B$4-9+}Wf>95w%@QcrW%KIgWThDJty?XhD*t&9Z>H7DF4I4@?
zU%$TW>XcPL7IAX<e!JaXsxqY)7-u%KJp@Hf%9?LrSY=pP7&e=&RJF>S0R!0Z{`(vr
zGp0DK((6U{-h1dfbwd2;qYA?+Wn<oV=1k?Gm#R@;Wv<`~n$uh<WKvbm#}g-ueObiW
z?RM-|J5TO?k}la@l(CPQA7hEQ1dqpq*Xw1Edk+r$=l-7b9-e?aQ16aqN`V?pcw=<k
zZaSxV)fa>g*A(Yw7CI1<J`L@J>M?J=`6eSrj^v6fu3*4`0qotoH)M19`s=S*wQ3b}
z=g!3(P=&X;j2t<VjvYJl#1l`{*gjQMR8&-Imyig!jGTOu5BR-F2EC3^3H77I`uTFx
zknT!vxP!;ekajw&k}XOg_cp7j9l)cH`m0S&om#wX)F}V|)25x<@d7Bb47<g`Gkf;X
z*y*oIn6J@ri_yp_uQ#M6`en+iRw)-biHeHC92v=x@#ERFa3Ps}`xbATk%3|Scr*hC
z;@z>MR9K}f-ni!;w2d3X*s&FQA628iYP7(=@8guN*4mV&oaAJw<(t?9KzrJs^YKcC
z3EONo>~=e`VX@5FIfu4+Z2|D&Wt@2&KY4$`<#G|1S6mQhi?9Wk%cVTH5cmJ6tkd=W
z7YK$@$88X31$38<Q{IXPeo-q@mcz7Z(^#`+4ei^vCnhF__U+I8UaSeuo;}NxPd>>r
z&pbnTczBKPfAZwXY}vAfl`B`)_`X$CR8&-Io{$K*_1jaF*F8J7z#3)@#WZRRgI>p#
zJ>!-4zic^B^^M<r(=W^bG@8;sa(jRgBVgGwc<r^~bxW4`n}DA~{##j;RhhDdUSFy*
z<!GIb0=K(fh&Tu~(&fSxC975X+O%Q&?Aatg|2&0_8Y$Zf8#iLO^iq5eKa7}>p@=k5
z6mh%V@RPrAhW6u+@vdB1u832O`pW4`U(!fp9c6o$d(eY4(n?jE+|Kqgt5a5$@<d#W
zDTY^)U!g_5UsQVWGBRu=zj}Ygl4qfr+h05-SDVXr&vv|CFTV5?rB|NDWJ73w)p^aS
zz96)|9E~*w@VAlho!TAZ8P!iL77HemiK9o4(yLc58U=iY)Fm&!{4(+J@eCO<q*nGH
z9v;qv4?f6@88gVw&##qZsHmu@sMH)G5pX|k-lx1C+&eT+G;5kmyA?Oz-moLJ>Ki`t
zh+l-2_Y)}2MvN%Ez6L0(GNs*ar?VvS)UI7hWy<w>Jr9JiGG$o=hE)d6Ulww5SY`I0
zL2P*ceU6M8g(L|6jlEv<@4SQ1r3>O`pW*d-@p`?uTrTnhdd%sbc?NeuK`G&?8ugWP
z12?dREi7VDxkBt+-UZ-M9#xjjWF}kK!UU?9Pbl9Xfg!j42NW%syL~QE?kE8AHTjIS
zk7bW<51n#5Dcf(*Za@@8yeYpce{R}~E(NVnt$Ec4gf;_|*S^DLglDS&kd%~!!{MMu
zj~-~Xb^n!l?AS3r`Q#HGc;JCrJ<g3c-iX`n=JU@#uhrwIsHmu@RG&KkHgdY$Y};2H
zM%BMZ+q#}Yt#D<}_@I^oXEO6bJfm}?tjd%T5fKb>IJi5d*kk&M(a0N;6w=C+Wg+MD
zmCWf2tX64?iQ(|Q_p)i>Lb7`GQnuBeIfLP@yU->i;N7(gm&?V8d+tFj3RTkW+lTbQ
z2c^#0ms;#mQjPl3tY<yn@C^Xt7>B0BznRQb#!5(RVT-cvd7ftxi+GObsx=2FE#l;R
zyQQ`zuWo%+5ph{U7UNov!|E!|Vce$Q<`?#dH!91t7xgQ3jE0D|%@xXPG4=NfM%HhX
zoYkVAn*Lncw8<aJd(~B;c|fyt=~8Sq8<(GFu5(qfTCH4t_0_!p{`+`5o?1PYii(Pg
zO7*C70k`qb!%C_B?(Lg5*y1H6F`Eo@Z(p20Blov!NCX<Xft4xmI(d?7PMlE2J!>}e
zT|KBwSr%HYwp3VUWMpJe?>MntJGRZ4!=Fz+NnxW#NPq-rfBh9pzkZl!&7x4F;rMO0
zDf>0go{c*<H>i+{7$9&|qrNo#>5o*wzmnpt<ocSdR4IFz1wml4c`}zqU&;%%7chE^
zJiqmM%%Z<2M20?t#HNYLcH52H@nohUW*k960=*fbWy8+dmC-isg2rS6{MAQ&CwGN-
zM(2(k_B?p-U<5(nU;p|SM~@z@v4TsYDDwO7zY`S|6_Wfnuh+|0UwuWNK7FuSYqvO(
zMx)`@TW@9Cwrw0bbf{L3rJ|yuqEbETT)?HB&Q@Oc?0D|w?@J;{5{nlvX2OIC3>-L+
z$&)AZ*I$1jNfPhA`!2(W59gL!ZeiiVh5p>8TBLX9R?6$MSq-x!vmB0SG#UvH565P+
z5gs1S^h1Z}lI_2CUf@o%nLq16Wy-QBS*_Ayu@DgvL3DI9jT$u~Dk_Tb@NhD(xrPnz
zzRR&2Za~s#0PuOegwLN(`<rf}AU2l5NPl^K;p|z2fB)N`59RYA<(xpuJmNo~YSh<z
zWG_vDyMU#ZrR2rtk$7<;cXYXf&#j;HaMHt=ye0sgf>YV<u<<Y_Pp?Dt`R{R|_2msW
z&#?@&t&6=n4J{8&zNUu{ALh5;{5?g#_~Hw?bm_tiFT8-m;i$GpE;~D$?c2B0p+g5+
zwrt7n-Me|`op+cuYZe>IstR1goH%iU9Xob#^UXI`J{UN7@E~u${Wkyk&wn@;P!wz1
zwr$LsHH+oTmsi*>pmpok7z_s1u3cO0xvQwCsHoH)buQpCbBYtBqawnpy}#F9dyUl8
zR9=1cRo1RuOLlfPW5<qV_Uzf{^?H^pSwd7)6!+eHFUiTt)jnQD1bP!2S_owzCHn+<
z)mH!jAOJ~3K~$~Dl_{U!y_+U37f}ByQ<g<}VU;m4F*It_2)o^mE+&T4mtT%nlF$Nj
z5TtPC3>{v68LhL}m^Uw2famye|5N|Jb|}kLqrU#*^ZESwjSd$EZPB$7z!&9XQ`b$r
z()$%e$}ZZnNuPx1laM6PL^Q3#S=T<=m^Q_43eK^5Zita22~iY@j*e!`m@&%o{QP`g
zc;N*ux#SX-FJE3^%aF=gw{9J|xw%|^`Q^O&>Z>eWx|F!MIO5~ux%19DnLd4bt$z0H
z-@l)Nf&yB$th|-RXP<q>ym|9z(V_(wi-oJNzM6IG*0F5aGFGfuLFdk$S+;B$BSwrM
zFR$$Hr&g_6(V;^JHgDcs)29+rGBPrlJ9jSe@$rf`K0ZF4xpU`|k&zMV>6Od6b?cNl
zuPd*`Py=D{;>Gmo(?|LJM@2<3Y0@N8Q_rDhKs{&Ox^;{iHA*>0jYh+$QKK6CwW|()
zhwC0H>RiC(<P{slu~F44hy3%;Ka-V}#gk7yiQR5T5CpEe>MDNx@kf%9k{CB`9GRJ!
zeER99m`o<Z!m2MAE23$PO?jP>)37Uf$>K*2LzF91zL=b>RHi&!4=YoaMR{SBaszNz
zmoDVR6^FkHfFAGxxLo)s3bD-1MfcK6{vs}p;)cGeQD4823+{M49vlt_Pwakz2v<b#
zAOSqOvh#kD!uH~mz$XFL*xH|PU1Et*UP=w<TFci|6h%B94^KVy6mPxt7Oh$pM?s{f
zrgGbDw{gui*RXr{?(_PL+O^B?f&S^IpXl1PE6+dwJU8BWBcn%;=H7en<<(bTt#WTT
zm&;YIa4L_aq$CUm0}&As6^{G*>#y0fXAg7d&gI4%Z)E)V@mzG#MT{Faj&<wSF>~fj
znl^39^5x6<>8GDKdh}?S`_XE(n9XKVQW{<gKzU?jWH5B-P^M3xPD)A&2?+@#BqWfM
zlEU=q(-}H+XuT7085tQo_0&@g7%<?1xE7NpO=9%u(Ih1$(YtqV5)u*sm_L6$y?ghr
z^@r<q!Q#b>88Bb~OO`C5ZQHgaBqY$bZCjQsS;Bw;16aIxaj2(Q=lmV6dnnP>^#RXh
z6@P(6RU`k+>-DmD@nUAom=Ux*EzRFwZp4TY05oaRgoO(i5*r&!r%s(p?FV4XmMs((
z7IMWESCqNFs>DWF0SP3?$jU<$&#w%-rYM{*RLIAd+Y6Y@X2nqIl$FKwUAuU`dw0NJ
znet(uk9XW|3<g8FRod#qIR*a6qD~Y=T#=D%m^zh~%a_w(!v?fPd3~~o69EnWryZux
zJ|l1PWQ0Hg7v4AoXH<)rBbAqdMtw~S^tuxKfkiGPNuu9h{b;ed1-s3=S<`V1``heC
zw3q+4x+C%^Ua^CJz5#;gLO>H1c&#(f`!g#PloVvWdiCPnci&~@%9VWj>8DDl;M%oo
z>DjX<_uqd%&p!Js(b3V$=RjqwTD1y*haY}eF+OC%!ou+Re59qNmHXWS{s)blH*e<X
z(W7`g9vU}pOl)i{W5$djHn!pi0w+$KpmF2IG;7wZ+%Z{MS*%#Gf;ZlH1HE3aEH@gB
z96EG}8*aEk$!%`et{vB2do34Vd~vz^Ytp2Na^4pLW5$e849L~1R}&o_4M1{oGJ^*X
zCMhY2XP$Y6dGqFlc&2`mlarY+VFF1>NwjV2FY?xqMcmxEbD2MXK9P};tX;d7?nSnP
zEUc4~k{B^!M1#(|T(@o=qeqVh{9)Xq<Q~2FMa=y9^BFyQG=2N_rA?bQ<?ZHz;_q<X
zLrvWaxXj}C`|5b$L{VhSm@%dP8006W{rdTfN(h1w6ka2<XU`sf_~8dmoH)TpAAQ7q
z_uW@*0T&e!h9vp8<-kUc_883B-o1&*%tV7<0F-4gNYT+qmS7=Uo>?o!#euH)l9g+K
z=yXVBeBqaQe2WEQ$~Q_SNkS`07(E`WMk5}LhQSU8hjVlJXn?<B;Ri+|os*N9c=9AV
zK|rg~K$9k5GF45uU35|9W6qQEjxUFansak$I(#^$^mH<SEkFmrE{`kv5%K5#38IMM
z>8Ft%>{EOUYiN2y)fO6S43Y%d1`j#DRP<u8@sLhBc~a$GgwvYSI3;JL<I+e&)Kn}Q
zypor{G=EjPFBdLOYfhIf47K1h`taC2<h02lGb$6&AtIfUFsGSum>duTGzDTQj->^X
zV^86f;tBH!N}GiX1&yWn-aWiKiG+vS)|s%b?n51Uo+SmkBuS+nBze7F{_p?(k1xLX
zf?2a>F?Q_O3LiKD96x@Xef##&t5+}XxZ{pe>({Pbi@{(hS6rPvdzObDdI+b}$+T(H
z=-Ra_dcB_P>}(b<Ud(mZUB}d^QyDpOWVv(jcsy9GRxFnCA9iltx|K^Wy_CqvVliG=
zSV&r08c|VE^ytw8@C)2++qPjeR@`^BS+iz1ot6LXHUv^rQ%Owp7bRM<WQii)0J?YY
z&b)c^7(IG4ix)4hHv(?@^ywreB{65t9LA3y&zLb|8nl30uwVfI^XAP{jCg?P=xD`T
zm6DP|a&mIe`i6wudSl|mi9zBG{O7%9%^FftQuy)5AGz<o`$93rI_K|j-9t^C3plv~
zB~(wq8I48;4H^`*EH5vQO`A5+vuDo=pICzb>21@dP3hUQC(D*Cs}W;DuhZfaMK<0#
zl&>C}$S33OX4Z@u-1FXh7`$G<FXRHzloQHQpAd?Ev=q;OJdpOuC;a@ce*y4B=gzd7
zI+bgG`biNzHIB)IFE+MH*GjTj{NlKr^;*CnN!ZVvK}=7_ir;Sc0J(q(2+V5J;QwRs
z0K)3kh_}Qlzl#gas3$B2pCs{Cx1+q$cP;Q<sAp7tB>WdK9RJO1EPCw(3IP{z21vv2
zc8vkzfM(z^`uMp02_8J$62hX(+Ixc~@ZOCM6Uq&(yHLo;$Y9c>Nqq6e7kvNy_gE~J
zaz)(k-Mh)m%;diN?n9>w{;G619Bkjdo#xG()2>~+Qrl)`W^(=Y*JHEU_~x5$Fqurs
zI<wi#qmMpH$BrGj?Y7&<%gbZJgtGe``h31hy@gj^c_o7b`c?uQJ$jT~yLK^R#0YG*
z;?Vxe#2ZkdSZrwg_~VZNBqSu1>G`<&>Z<|27jxaZb=7`|TNB)L(@o5oGv|UZYLk<b
z74cb8*Z{O?(}v!?dy|xuL}FrMgFR<CJo5J2Z!dHG$dMzNJ$p7QR;>722)Mt?bq_Ul
zF5m>A_{;K4W?r@P-~u^%^e9J;9AVI)L72_v3deTo(uFQvx=>hHSR>(mk|g1D72+{y
z_<qve0OZ*1OrAfVPwu*lHy?V4OOuk6P`rkOJYOSV#qW(0f$8_$!-@EK_Fi@wUY(9R
zmM&#&zkYPvw@>jp)+jC)+JMSx6;YLAOP~}kG2pl7ORg`8u4uXM^ihZ`GKK;|4jVd>
zBq4=G;T9!4V*Si%JTK%wJVU_$7X0E(7H}?#1zjGn8}x_tcv^TcJG6Mbeos%s@Amii
z=7t+?VCKx32!fz^?8^EMkSkmE3g{Urvu)cpjvP6{gb5SM6h$w+^b*O*$?Vy)CrG>n
zGIZ!r#*G`tlqplV^2#gA6oML!rc#e+VA!P0jvYJjcs%s%+4G#g-)g&Bb6p}=(;PBn
zNSW)SqoWm1!0z3<>xF>3kPLjehhoX_<3RfK=|fUd65F<ItE*|%D9OpmWM%nN4a&QJ
zx_0dfz#o77QD^fCC4YzOULUA)0T&x(CGE8TX0K@hCx79VylLESH%_NB=t-oEx5zVA
zT_j23RC+d=+&r4Ru#hv4jK<l-AD*=3vdb9w#~)n3cQ5xOCllfIR`^sk?97=e9n+AR
ziME_C+rWJbPAB@DoXWq*MG;eadbz88l7v^1aET(Mr(<wBneo_TJoeRBq&I0ouHDXU
zt5)&-op;j6;Xtd=pm#XXRZzBCnXf2fsN#9o1QLEniw}RU+qvR485Ciwxd0k?2jcVj
zaC?0i9a@@Zn}P(Y)oaD-t-K$V&0|w~t5rm!!bWJNiXUl6l0*|%lc4uyAxHv^3M&q0
z_4$05ye7i(!*ILZWRSt<@t?ChdN;W7|9DVddo&&dQA@x5cDz;}V%`~a=J1f`bk-Ds
z#dr+i(fs=BucaE+*A_WBIk<|d+Ey32pou7o96EG}MT-`3`t<3bG4b*7OrAWME3dqg
zsHmt4TcG%SJ~nUOjKN^wvdb<jwf@_0zeSQH{`t>;mRgsZn#zCw`(JLp`Q}RVT_#SP
z$h>*;c=OFSdFP#XO0C!FbhunDTrO9YJ!6t2@xTB54~<4sDoUj)oIQKC!qC!&M0R#|
zrDNjb<4H+LAtxuN4rcWCqAI`Bi;7Yxs&cLBBULF()Vz6f07d9s==>e7dwrnp1zcpY
zV9Ts#rN+Ph`irQjD8<{hVZ#QDMk5_Nb_^Q#)mLBP^?LbNQMg}iaVFD$K9=o!=|Ali
z!X6sM4?TP05d=hyhOawy;<vVKx%c2f63(6tDyk7kUW*o$8c-$ImwaE=liPFMXIbmz
zYJM)43x~r&Zf-9BN=#(_?YC2?*OSt^HMcEa&a9*)jDm1ZhHl{4incSJJ*yNNsR(_3
zKKlH!?=i0^;wmgeckm$nKKiK2a|FnbjKpPYg2nAO5T*QdH1_KEG^`Iul7ufm6G@U7
zv#}||Hg>=>@NuR8UCHZG+4Zf;^{?(e&Sg$=zLeYNW_i=)eA4a{3bloP51kKxqN69^
z#|JI4BQSckXf+xnM<&F!t@NB43X(HZc`cfwF_}ztCg5bxRdtUge=cQYWUy$_A`%l5
zgNm_)hlev}%owh{_FAH%qLkJm72PK%Po8Akwr%w5*N;Yxf*%Ux<>m41x8D*M7stSX
z0|8jGW(}=dx29dYcC1^sj)H;$`uFe8-o1N?i;F9>isY_cyNHU4qEVwp{PN2$xQhxw
z1!A+=ICbh2Cr_RvK0dxmzYnL=$uGbBLaSD-N^O&vn26nO=h90rEqD84$Bvcy4pmW6
zQBkR1)VYAOg%>}SuTHPD#fum7&_fUL$Rm&N)KgE9o14oIKm0(mX3Z335B?<Z|NZZO
zOrJizI@7KanYsCBv^oU6k*1M$u03>!E7H>V^wLY&S(KBPWi&FUOBa64%VWlg6U2MH
zrJi>BDi9}uiTh>!U*0yAt*`1h#Q=7@2@4CuWHMpO&E?J?e`MjXVF2umjb%~St~_@5
zuwp1x#Yn62nC8t9t1wmsoMnuYpVk)^7Lwh%HD|-Zh}^#)(di`O_;KtfP7vYqQC?=-
zA2;1Z2feXaz!hX&Fal1a(Lg~48jS|Mpd~CK7Ef51;;jg*P+HMGN<Nq<Z+zgms_e7e
zIalyM1ecxvU)cY6`l6?C7>Yc@62<Yddi=4%a`{mobona|qh5=k)j)pv9_ofjpa)KC
z@i)4!%}SJkf8&*X-c)s8qA2q9*I)C>E3X7KsTKr*goFfczx{R^HEM*_YQ<)=5fKrA
z*=$Cy*Q3>H%e=4l@83^$b~atRb}c2Ul9H0xzkfedrcA+Rv*Gjk`0TUKm_2(o;4hE`
ze&P7>#~-tL_3APOTv}Qh%a<>wUAuN{+_;hb`}ZrMRx-VM^}^|Nl9`!VYI_;EHNcD+
zGiceeB}a}N;o!l8Tz&P`L4{4cUN6g*E#t{2pRDlr>T<d0(xpp<V^maBR8&Gs-3vHt
zv4G3WEjaJ}tX{pE^z?KkEOODJMRe}mnS%!p;&QpL*=$IX#G7xvN#DMGgG60zpw(*0
z$aNy<jetb!RxN4Kq6Lu-2Q&ZpgAL7^@j<t4q!;BwYz`0SmJS`5l$*<APA6djhD238
zWmPqRN{*|J*aN@7lm(E(;UGIZ8+%R;={t9_qFXlrzHZTiOEem8FDR(+X?Il(x|$p(
zi%_T2iC(WKeZT+;oK7N_FDExIk60*Iyq&t}BGQKr<zlu$k#kSVJq69Wm9s^|LsO86
zL8m3$Bw%dR1gUZ3poa=o@rYGdlm%{Em3>uqTuGAfdc71D7Ba2nG~7Z!=y6fPrp~Lw
zD|r1$ky7!`#qNtR>T=Kt8nlI(7fkph5F|+T;n74#N7sq>?OZ>@%0m=IPMtc%bI&~&
zBs{x!@6J8<+(Vl-ZLnA@golR{5fOpKVj(On45QJAPNysPTCQ2M27v3XyROu_jT<)t
zaP!SK1AeboyLRn}E9xcb@%Z}*3W9*g<59wi0?$*U(co}6&}cLm3<kVjud-brojZ5-
zf47v=r|i(7LyR3emb|<?h7B7=%a$$q;)^dZ8jYny<L94$PREWNY2CVYnfn4bbLI?3
zj~?av>#r|&jEahiic09Ia{<@9aq$zuZF`TO_kOOv`f3gxIz(=6F3&#uEGCnQAAb0O
zi4!OC#1l`@rArsioH;{WTpV}beRmDaykayO4f_tCL95fD!Az@`&54VP!{Kn?a5zZF
z%cI}#zw>#!cC2XC3Q?oM3%nH(!3v9oR|^Zd9u#j}WkzCEjh?D_=+0-qa=uAnVIek~
zjjXIJ?mu;kjF=dHEAlqJ)Vw)eGcp)l)D*m|yoz&uB7ZK1UqxeNFQV0IC4A>j!an>E
zJJ5`Z|0s5j9ZQoYP0+iVLApQrR=R+^G8&Brtuq6Iph2q<Fh|EClws7@MCfEy$5l17
zwxTgUpAVPIMPXqfCbtQ<*)QO%Syp=P?Ma*CZCHN&a`G%iQ33KUB<SJlj8WK(POE{O
z%G((<Bz#%LpTWBD7z`FmowX5w>V;4Gd_FuL4|=_xh=>TXva)E_tQq6SkLU8sFUMpu
z`TxGd!?9Yeig45G^~yt~^6saN8#iJynds1=L#cKD_{TqZ?z!hUd-g0FH*VycZ@yvX
z%$dr1xfqGV;oycFZs5TOAEas1rlt1t`|rOK85zmJg9mBVs#TdqOj@>VNxOFKSh;c~
z*Is*Vsr43%g_xKa`t|Ean>KCu;DZk^8jZaD_S?*wHH*!gHxm;R!|K(mIeYeOrI9Gd
zjveFl>C+V!AGpwv#c|7)Ekit$zbEnojtjXzT5fJGfYR4b<?nIbYnwV3aD6(rLJ+iw
zqK{oEC&<ooVh^vp*g;9gj2Xj#0R#B;*I#MZuAS2N?W2!A;`iTw=jhR+j2JPZ);(`B
zPM4cae;z@j(SlCH)&09+vls~r3&Ucuke8Q-IX|C?si|CZ@+5C}>cpQ#-oxX9z{s#L
zuJ?L*RTODc)MPpoPx{Zrpz`^Am`o-N1_OG%9=%@Aw1WpZWwml3A_6aPZ)7CDIGtRq
z(^bh6SJOhXym6u^;&!{yYPHz@{FBC%E@rZ`QzzOSJBGC=EbDOp{^+i_g4ozt3^~Qk
zyQS>3D$S*#AZ4fd3(yE4*c+j%q@rtesH=Ni6h#C<!0Yw$?jP^6ShJY8V{x=T)tZ8^
z0^S+*PO*3k!0a>A*?c8N{U2yG8pOjJKy-s(DB~y%58sgu%4;F6J6fS(6yymE=Z=hw
zWW|aV{Q2jf#K*^DGMSXm-SF^mEEWqUlSvV7RrzckG-wbv-gsk~-yePZ_GRVDm3;Kk
zM|A7fji;V^DySiMzkdDD>2z%0zP-YVg8%r(Kltmfzc_Q|4A)<OJ>lV{3wnixg)wyK
zQ2zJ7|KW1EN>#LM+O#R(fB!vSe)%OYyzm0oU3VRiKmIsIqmky#n=^m@d<+Hy!-frG
z;>3v+7AKJ;iLbx@nhqU0(7AKx3V%Nhg&{+RkeHarFTec4v}w~yt<T8FASo#cK+XHB
z1unn*asZ_lUs=fB?uJ@QKCtp+d95hcuU`*9@7}%ZY+j+{?{MAg19dLo?BQm5UfhB$
zyN@D@K7QMJkl};QFZ`@!%a+`E=bb^zG#ZVPSYDTG*?knZ#|vm^-zt{4#?knEKJ<D$
zMxzn4*-Tzu9u9|ti}Uk&BPoeh&6@Fkd^|ZtWuU*)=~ycWO!s=3>hmc@K<aDAmRt-V
z&>-^pe9ZpyPwws0hfITkOs$q%O(xbA780$~m1{iJ##8@_yl+~q7HRKZqNh&9^y{xd
z>rckT@zZtJ5tE%wx1xL&QLpFN#EC>lM`N?u&{;aeR{wbM@CNi3m{G6MfCdfv=9e@W
zqrM{K0xVjsmZmgi)QM5#7v|$`>}FxYLe50_E1+t9TCO~JC2KqQ%a6CuZI3aw4LW;M
zw1sEUcwG2S?nc|ZM<`FHM(~~7rR2bA!Xgoxb**HJ`h!NJ3BIOHn-U%#jwDGKjYcdM
z3l@t7v)PQnU{Jy(tNM8w=us<+>#n=5%<xKpZr!?Z(@i(=<(FSFYu2n%MNk4+v}h4-
zx0^>FeYD&$ciwp?@4fdPd-m+1XV0Fc)_3gKk>{R!uGI2`goJbQq<K6ZR;^maZMWS<
zSXfw<x2w;{xqOL<iDYDC1U2%8;y!V0+qP8=$yy*#6t7yfieW{0@-nHZsfvJ>d-63z
z<ep|f{P07W0&dBYB>>!b<BfGawUF?4x$dDRB(;JE_AIW9wLUpD6jM;p>2%7I-0HA)
z%K_!};65GDYPAT0fWctEVzCer5kYixG%+zTL`O#x9v;p=PoL()_3IgS;)JqozDC2d
zdOep20>65_h@x2Sxz#2bjRu`ghuLf<A|e92-A)U=o)?poF&E{e925jb>vT9h9(+Du
znZhd2xT>iiZILHa8{pBDBnc@i3m$zG%Vn1Zi8q(k$}giwvvT@$e4RQmDB$T)>diM}
zijT);vk?{+hQ4uoG`6B<@g66>le=s6_gq($H0rfYFN|Ua^53J?Y9%TvinzEq;#$S=
zX~L%*h%NrxoxE`}VZLJHwNpVS|3jE|1JP>zhQD~|e|0|p+Q4_TxF?aeRq0as4FN$A
zFquq*hldj#?JvU8s8J)LqM`^74_7>I+B%GC&}cNg_10U&#l<mY%9L`)ZQZ(+fB*a6
z%$hZ;%vJ?5J$m#YAt8YU3l`MIbQRXETgU0sr@8mudu#PLb;+<{!<4YK2OfAJD3>rf
zIhje5CIRr`i!X*`eiu5?(a}ttI1zx!lP8m!T5RuSWMnXM<Ve8ZPNN}*(#e14vuDp{
z-MV!_>n2T_L`q5uZQHgjv#Irk$lv9<hnhO~zyS>G)sELb`5AysI}hV@xiOpS)_bvS
z+cv)c{(BA`I>gD7C;9l}k8!)**laeQdFGjO+LtK$*!1UN<^7Pp{=5lIQSO&Uqrqe{
zq0{Lw7!3Z(jV2R$d3hM}^O>@5A4C88i?=#<<dD_hW9xuc%T)#gqr6^T^LlAq#n7L+
zMixqXy&kjKj3|nDy<RTK%HpxTdwHqo3Ft2d1Jeo%dBf{Puh-Y<c_<YK3k%`H579mI
z44Qy1a!C+4aLqMrA3hv0Je*jQiEdwffw?F~yD&16(|6xZjLnACYQ<nM_^)gHAiP^Y
z2mD6;1>u#s0F3&w&}y~H!<5+ASi-`>m=ZOG4UxqmgyVOO=gPBJ@=Lp4lx1BDx}rDg
z(Y5M>X3tk>G~heD0R}z<4ZQ!KnEJc&T8O_ggflrm<j+@=$%G&Xh@z-GP|_87`$P4a
z*`!GmzWw%F#*Q7UH0!?j;)@Xkfvl`7R<B;oE3dr5bI(0jp~wUOc|QOA^W1pjjfx>y
z)A)Qo=FFMH<jIqjVk{R5%a<=_@ZiBLS+ayRYu3=WZ{MKM$%zvu)+@t$?%cWj@=Nh&
zklg(F(MKOuJcvVv3@I}tv_3Lx)-1Mc*+NoM5^dYIRlLG-cwO(_y_q#@Rw$=fZAOh6
z#c#j;#{Bv788Bb~y?gg2Iy#y^{`iBetSllUBU!$Dd8nsZr~DnRd#DMCfQyX^r+fS6
zBp*n_?eVhor|sN%effQ9YJ;9Vdn(~5ADv?#u#$ZL`!2HcoPfVbORJ_)LF=_zEs`WD
zPl9D3XEYiynM^nw4!Y;(^UfcCu(Ek`K5W|-XHnSNVx5j3B#BvGFB9q@tg_@@?*z*F
z?eqk;D;sIJQxJH+$Uv40oLrlo&9T%}J}G*_GT&&VqtnTKUaw+c)h4oVlOze>Z@(ct
z@(9|UJA=k#^y$N{@#D#hi^HzdVKSL83Ic7v{Z<*1GGPLi#*MLBt%?xWXf$YB^@Sn<
zryBM3A6djnlEh5wOun{!t*pB(^)_z(>sB;j8V*JuRF?NB?1A2@N8hLugg1ixbR<^}
z;^7SlZ3l$nG-?E2+IFNIzvo|LvY~B&RaE7NN3xKUJ^S*qP(SRt=%R~Qy?QmvmoMjy
zH{PIi>(+#ahqHhGexjnH_~esM=+>=jzxS?PyE1X&M5axf#?qxrYy7kG!w)|M;NgcK
zuF?J02fBCf&f2wWdH3CSS-g0$Vn8M&ByjiLch@WN2L6Z3W#taZf)l`Qx7X#Aszr2k
zG^<yy=JnTKXUUQ!K?eM-x8BP5@#9N{wl+lO&6`K}?%jFsz4w%BC41ebPM!L<^ECZk
zu6roaNOf6qEP(HS-^Ggye*nN5W@N?d_hAh)hGHt!!tL>L^J5FhC~8VR<&LYk<?7OT
z3NmuIrYMSdJRY1*C;9pLI2;c0^73%GT$~gH7PfEC+QyB8w(TQ|yeW!YS|s9X`b)eg
zkN~_~^!_g3V@iv-qQF7qz|R@LE5IF+#QR<^E|-hk+*~p;GRV%(=J^gClylJm-xm}x
zIG~_FZ6N=ieaDWWnKljGvSmT*opEs-m^hKMmtLxfX}L-r>FKon$3GC9PIB9~XZMF6
zDxt4dt2Ib`7Jf2D2|3hX^K^qZ>fPTy0r-u2<6U1gctIM7T($5u@im?bdrDb;?O)e2
zb^laMCKD%(C%L89Edba&Hr5|lPi$-~5fKq+b}YfS?K1#0wq|uwbJ+j@AOJ~3K~xw=
zz1LuWKklWI@TI2!pzC%My8icvct+KuWQqRzh#U@IQTu|*wtw)!2f6s-i)&P9ZQs6~
z$&)9uXwjlFD`Bc!xC|aVn2RpDhz~yaAk<S)sRl=m9HDjV)~sE-mO+CCg?c(Fbwo&V
z-~g^0(1ms_{gt~M1%-V0&BjnorCNOa-DX9+HE$frO+zlJaJ>AqSf|rrG#as5twcsf
zD)}3ByPcL=El=&*#q90diE}!YZMO&lR~igF;Pa7D<mIYK{k@H1@dkd;))e?LVA%}d
zBoHWvUIuyqpA?;&d|r0Do$&B*9zSq^wt4;ve_r4YlZk^B<ik}5S-5!}4t&o(i>_nG
zAn_)e&7@42z@~)@$-d$WB{#82lP1K*#$vbIF*IvN%76dMk@4f%^Pm4HWys}Ftw7^T
zxOk}Y+PirX_-d~Sa&6<?xKMd5v>(!7#YtKCd_KHhFQ5B94-#(!P7h$pp(#W}L=X`X
zK{G=$%%Z>Q=CCuvlmZx9trlJPo6wm2m1Cux6L@!h6OwbOF5<p5ig-hBM(8mzv=gcU
z&ZR&}s1O99TH)h@An?W;Z?JFQKEC?us~VZpsZ*zT{q@&*=bd*{@us4pqSAl}nScYB
zbX#$?$fZAS=VW?L2xoKdWal|qlDJiQfA5GZ5QM7zN&}0W$OS;6qM{T}kIiPIe_kF7
zHg4q3!-p{x6*BPx@9On*5d=Oe5^=R5gk+kOc%O)0)LmX;xm>?)Q&EVhTv)(vx6{aM
zX7-<d66N;y-a4bzGQwaW)9tRYxd(bS#m_!N=+XuK?Ad4v3zadah7M)@haYn6_S-Q>
zMiLbjr4&7gjEp2aJRGyxjL~RB?9+$LNt3X|#Ssw^;V)cL6apJ0;JT?seSJs1FTNMQ
z=U#Jhfrc*GU3g;u6WFbG>~_0f%p0Rwyn8XP?tYa=PCueFeAa5UXpB~bUZa)m#jRf;
z6*@w3O6QO0#=E81pRVgZ0!>(C1skZ;Crl<2^XJc3nuu4ICQX{0Qz)m3ii(O#{UD?Q
z?y_#J>DjRb;15N7^Ru;~oX$D(e~W*`QQ#K{?OMii^<@{I)An*0r0k8eSS;A>cBNWn
zWMm|fW;1smIl{tCo9LUFscd^jt7W{wz%?2TyS(076LF^q7I7ut%gAAs-%`3VrOjre
zl^`&4=T1e4?$hbGqms&$RmJD?`8_O2NoWQRM1SX<XpbFJ*5`KW#Fn?-V$b7`BgDm(
z`W?%{&0sK;64Zg!?8@q6ryBM38(F-q^RD9#(;ay60?;DA1#@=JAvVnKb+r{0sIgcq
zw9~iaYVm69Ry$_1S@D`^G#YeWhAY)aC07pO_Af(udgqLH+mfIvqq<9O3Gs|nR8&+{
zR8-EDkP0|}2S*K3UjMfBAn&bMAG*n$14|OO^8N3-l=qK}8FJqH3KVj(=PEKXl9-qn
zVq#*j+wHXR`Ix<ZJ5T=kCyfHUN^1pyUIqhC`FuEPSjfrYl2z#>6que{vNEO3X2WK)
z(aYoEvAuhhacc|)o&mgG?|IExk|clC%TuS2?!O;H|NaOYi$ihUQBmx9{BgFt^%l<V
z-IZ|3MvWRNUQUa}qIg;4&{mVlL_|ack&%&#_pPG571gM(pU7U>UEW=cGL9l&;}3Oi
z>}<^I+g~Tf6r+f@u&^-9X0!4TB`PWkyWKC~f`q$PK-c#!<rv=WOArtI9E#IBXM9ID
z<K6a!@?O{b4$#+LlXevq6%`c~mD(ZX0<L50CXBtIpYs0w6&v_*)4mYSsB+ftNa5|p
zzbfx<8ghx^NjzU<(IbadhJ}S;v)M}Zj=Lr^llM1lV8rp`2t}gD3(P4BtNbpYcU*Oa
z+$;EV+g`40U<KzRmu|P&Y(zvva9vgwV-6R$TzJ!DVo_0kQdRriDS2)#7rxhDN8hOv
zy7%4#uiv}kGZ;8JdNk`l{E#!lhGDf@gM^#iZpUi128YK5^p4Z(^_Wa1#i%bUbTSCl
zsIPa(;{LejI5!w>;EdMas5{CX#Vg6L&_drLNW2-1M&*Hn>@}9}ky3e&@q^H|?5(`_
z{Q4%o(|b$Jp*|sH9>M+N%Sw)>wrLlHjzcTiN<~FQMMXuWJ`!>P2mai#fxU_os9#+8
z1G^5Ls9=lGk(!pyGxNSf6#ZhOPv=%lx#OxD+kZu2m2$3DjLF0UhYs=I&70|zo2zVl
zOsnMvgMpiXqveRWh4@<q1pdq@V;*uy<hFC1e_5V5gTa8+YE?wsy~mH!|Lj?1++?$v
zbya9u9+>CmUA-FNl1tD}n}#N*ICnCmUq3c2TuACY_h2dtk(51|a=4`23ZN`e7Wn&@
zy>eCQC8Zkm^#}Pr$#iFuU`XJ&a2x=$Xy%!n&(J~YfX!yZZntBxSd_kga*+v>$)w~$
zmRBj&aLv<b>_rc4L^qz*GZimpeM2h9!oBKQ@c0WNX>85VU-R?@Ris8mMMXtL<?lqj
z5O4s`-#3gl&0_$6KHL-kS;^kRr$RidU{cf4nLOu9oGyPcj^>Rcnf=fWRW4j|E|d&I
z3=FH3!~Z&XJiN7K3y<yHi_POvw*5}0qpMEGY@ZKTiLlCh0I9@JNe^33{GpR&1+zB6
zp9fcxbw&SoF0owpDjJPOrKm}GcsNh(+ZR-sa<s|B;R^EM6!EryKm7Bb7_Pex?STWz
z`hu1%**<$VJ7&$o*QSl)y_CIffq8C~iL$_ocIQ$tPBrR7PoQ`kt{=`p!QazOkOZFD
z`3!yCeX-l^rNmpH2Ufmk<=17RH)FW|B_&r-D#*h9{ZmK<S#@=)RYG#*;92t`Qr>C*
z0=*f-uoo_v97h!u6%`egza#ZVz?n@3UVZFlqHPucGIH{H;N>OtCY*Bpjua-m@R`yw
zK%Q@H_O7cetWqwp@z2wzd4IzOhMg$(TIOpsJge8!TM+oQ3f?W5q4*ngFQ9a#N$^*j
zJPB+lvHVZUu1*P*%I`au%9KjDWOg>b>C@5m=z(taYGvPEtCa&2C$e$D0`mIzFEh_g
z4v{O*>sDi^Mtw+;?-i%V$pm2noAsNOb<=lEXJElV#q(yhT7$$}AXOFbn()R!qF2g1
zf_v%2dgFQZrKjLt_7J|4MY+0KA^0JKii(Pgii%2uq}~WPfTl4vUV3P_BI2AbH_y)d
zHspm(mLzUv`hQj`o;S0}z#CIX(5h)vog6=~cbv&&QhKZfh6Xm(>zT4|A8&2hLhJl|
zW!pVkEms)~j0H{=3Ayre<L<)WCg2JDp1QJ-YZX2iuxti?(RWwr;X&shSEdXP4-cwL
zDd+O-(&-qh)8X-W{OthbpZDKK*Rdn|*IrZF0!V_uiDAQ7|KW$6xa~G9Hd~N~QZ~}%
zaLKX^_1Zu+>O+GhNl21}*Xw1nW-{LxirYC%JTQ@KbFL*KA|fdNu_o>bZPPC3ubNhT
zy$iB%ubhIo_lIijx4MW2e#X6WO0h`S3h1wRASldNMMXtLMMb4yqLFH=fmk&-nV!Sc
z*S{h)tvLK_NS_WocIQ=!xT_1Y^PK$O;$MTRO*U^F$*YguTxa5~B(k9@iXvXGm%_qA
z^7Hd?I2<?}4)XK!ae2M0Y~Gv?+qT6i6o<swB#BvGFZV-G*qBU3rtF;*i?_1IE}(qT
z7dUsH&qrZlAr6Ow%*;%(va(oVv+?gvos@A?oK9YlB!n$n&^`V*!j>&T`^o9rmHqeM
zkK^Ktl{`VK)r!?>RdSa~7AL7|#6!R0`FU<}V{fg1e&9n09j~qPxhQiw@H3v@-d4gU
zWuso`d|k-qR1?U56CRI;r=_QP)%2>e?$)EX^5D@2vD@uLMn+<@*@AK)YYN|qop^qn
z9pr5lI$wwG(s5{v)*3rbWk~<e-krxsQQv<Yf6dO`yUFh6;7qu}smK}BatT-g@x-G9
zt+#^Wt<<YkL0c?TYikum#k-nRsn#lr{#q;oa^DC7;g%zigpg~qJG1lqV>6T8974#k
zN%%hd;6Zj~XZIU7+Ii>u{eC`WMX0OaN7?v^aZIv%uw3*wrj-7THV#1$n!b@EN7AWN
zC*FGNtym95sDnLw_RzU=XBI75#E20iVm%z8ku=Ew2jSVbCue`o()HQKF{{PQ4VRuv
z#+dX5UAh<uD!lvo3bGciG5WkgxM0bQd#`BF_dZpT1wDenAf=_H6c-m$SXf9=Q4xN>
zpF^_D>)pGvsCDb8YX_++e^FJ=D-Ut?c_Vu&<5pFbva&KxoH${GxK~nA$n4a~c;1|s
zUgFmK@5fBVG;vvSGTZOCgPc*Lj3uRdaEq)YSY0@c1#wf~I6~!BO#dAEGmqOVO7e_8
zIGQJRJb}mKAt50FkH>?<;i&iUrqha!5&UX8p`#UhGqJfb515GgoXbJB*86)JLMrMH
zU!bh{AnNDMl$3^L?9)hbt$*fXK@iSFBEYo_BEX%QnrwgrP}LBx&0oU1pRb5I?u~PB
z^X0$bnqT&>*8(D{8sdxZHuKv2CB|Mi-S|=cc=(138>C=KT^LQQ6@@?`KuJkS)NEW?
zSs5#QK3?hBlb;+F<>Af1<Y17efrRp64UH9e^x*0D`za_WAU8Lc+=2q0=+T1}<zdt2
z_p@N+NQNz6j%2m6|JrNWecg4KoKBohr!nj1a=EbE?Wa_nBo@R?eZ$g!_OsM1Zgt#h
zH0mC5bO_Ubm`*}`0zRM5=;;>Ol)FKw0fLMFhPv(RsKZiRYs~4tM(%!Ly%&m6cYceq
z@*T8-=*qov_Y1KMzqduSg%AXx{)qtBGKc_oW@^#_PPcaJeqNiugbmvdL>+h7tz0mm
zD}(!`F|=P79QNAZ443)?tlF}dMXR>6eA8}@7nVky@7AFe4_rU0&VAk*QslDAU@%x^
zS!GE{2}O!RR_D%ScI-$XV)mg`D8!!>h3g_hTw?^FP$)z&7^JwknEd>F^5)Oy=<Ba@
z_a~pQr+4r0*bX1&(|hkFc-dtrDJe#yWj(m*RV8D+T=JyEO?`vVe-ZFa@EfjhUSWi{
z-p6}0bK^`}yIMyz<UVOXzj~zZUWU5*eL}~wqmE1NBuuG;kURe(Jo|Y%0bUId`e`HT
zo@IpguBcM!RPwaLeBQ0dX~XLBEeL|p!ifOaGKc_oW@;7zPPcf?4rc#jF?$c?RXJz1
zm>JM3mHs_bN%XjAo8+NYf}2E-3y0lGAgGX&S4d7?5jpvV<m45yCHoM|H|{17RI0pQ
zN^2jJt{%!o=l5)kZ>?TLE~^X#0@W_7+;6k-O3$9GOo-mYH?n+L<=Krii=`KwDBHM^
z(gz-(aLE$#fE}GWanJYPlh>vV0BQO8ytsZn?c(E!i;Ig|E*V*zq)7(1O2kcl{n3AZ
zz7KxSILA1OrSOb-YH=#BtbK*Hj<&|ko6F^D)bM5qsi@okgR=Vliee&>WGkkW{+L?#
zL~<n|xs$;jk7V~Cxs%X}j-mMrz<&a*=qOrgKH8COs0Y?n>|=}|IenPZZwUADYv%1B
z1VLzcBEYo_BEX%QnpJ><@G{4*mi@p7U#^NOa#CMXTKkwVdH~}`^=op=B~OJu8>cTV
zD=RCjc3I_rTeaf#?%g?RtJu$H(=;AX6n+c18Ymd)V+-Zwp*{H|^1OKj6oq0SA2{l8
z@cBazG4q*c2$jzi{_@x{<{Upxe0)4kr?bf}mpmn>dQ;!_Y$S&dDZWkk=HBTG&zh-$
z@Qr=(vG7fO@v$@Rre2?I-W1%#Sld`~OgR7~mnAcM)oeOgJK*#A@cDd3ueX@~tf&E$
zEnlE+__#s(0!r>A<ep<O517!fOL7H4Xi-FfYZ*j<J2N%A02k@Nk$k>czKs=|_EcG3
zSsUFtv|{9-?u<ION6e~A*0;*bD*b+cm1UJDLLuJi+LcdJQcxpqZaaiR{7q39SC7jo
zjq#L~!5eR2o<1EZHx~^E0e)F#$LP^)yyOxJf$w|t;P1curE&d(Cr&U8a5x-Bcx%?g
zP5o)ne*v&Bu#Yj;F-D{Agg^o>tbKu=^duo6!3b|Qo2^L&{m`*&Lc5m{+Vg#tnb_Kp
z5;`Gw9*n8uxtLn_s>cxuLd&&l*Dj_^nZm+_3z<1{CXYPwNUVoctzElz@%;18lbM-G
zetvlWa(a3?4?p}c85tS%_CAdn;4(8adEtc@SiO2R06w3OjEoGXPMu1ZE?pY@{TsuQ
zB};hu<(J9I$})~km@t8R?zxAdLx(ol`!?kOcP4!9vC^yqT%?@5LKd&tLEecHa`Fnv
zEhr}UcrgV<rR3xllIU@f;Bn!NbI>Xwj#deAB*Z%zKCm0D65?V#{00*_8&`Q*WpQya
ze!rjXPA4z*>ctQ7@ln@aswljqX>_PVkrO?*X_`jpzyC#^Iu+B#jZx3Z8#s`ylO}Pz
zeS0HtDvHA2`}O1BJ$e|=n^#i8^|EX%hifUsP5r6Sf0pwCd5p4*VzW8i-ov3fcy9f3
zoEtdTn0c$uUT+OWD>_DK&oZ=<{P0X_NgkBsqxlQaijE<<laTD5@UlvGvN02DN=--d
zw2Srd1)*7)J9jRRKmNE8h?;7E+pu8+BS(%TKR+Lz&&Rpvo=a|Su5kl=*Ijopd-m*l
zd9TI_a8ssCVa}X6KsbmdCML3S<x1mwT(oEref#!p&@nW$%*;$CPMiopT3Q-iyLM&g
z&YfguhyOqQ!w)~K*YF*wsRp<+;d76r78Brvnnf<F)Qg<x%PI>C3n?inArJ_#pj|s&
z>(-4Tv)Q=TrD;5>C`<)xwOm$dESKE13+ag`Fn|1U)OmlKHf+D+4vt=MfzhPgY&N55
z8h*c@BEO#}`}JdWQj#&21*N6@qP$f=OA2v1aZ_JC{b#8(Sjt7_i&$=64uGu5OxrMx
zQ6-~{@D>*r*W|;SAP9{kH#e8N@4lO?tSo#!A8Bc6tX{pkNd~yw++4bK>qdTlewCmW
z84&6#3^Yc7n>A||k3RZnl^gcl++4<v9n0#~t4T{sW9QDD4K{{`wq(f?h7AkvFR%RB
zM248`?Cb`ab!v(M?o9aHW6gZ>rwGlR9=h~Da``Nl&1S=Hw;M%HE<19B!8tj+*{vH3
z+J(bFu_W=7#X@HJvdZD*vvEHco{Z&^#l`T4KVbgLUy#Zw`st|-2YWLz*mKP_$SxOg
z4u?^k#A*#M_bVwWp`f6E=|B9yodXB5-{qoMlDO7x=X<}O4iVo^OCq_Gkb7Sq>tQr0
zk>Txn)AdGp1NhAkzhPwYNIYH-9*+mN+a3EoZ-O8+8T01NBP%P52@@tTW5x_V{`g~K
zHmj-m=9_QG&(9|<Ev?EdTSi6(ix)3u&YU@X`st?)Hk(u5UVH5|0A|mg9W~pMn3zab
zRu*Y#X=G<-vth%AW;+}6!3Q4z;n~s3pUdpov-$e#ugT8N=9_Q6Ve;h3u^3{bI}<+l
zSZjGx7($Ko@TSjpx!rEOUN1>WNhBpD;q&=uV>a{fwr#w)dNrMkD|+GmU@~!`)ygfv
zVMRezRVq*3MpnU8|NeL6o;|V5oEa6~4*&9(ESoovy*J!|qkP6BIXRi6q$Cm(6Y=?c
zcsw4wUN2s+msU<EGd69)6AS{7V={5I)k=OaNGKGlG6tb#(SI4BC<+fr5Am7xGvnM{
z+wWpr-Z<jp<MDdEQ8RBXaduV^gxc%fyEk8a@dcTgnN5Dr&8MG!3c#dEld3&`>7|zf
zMD4L^$~J7+U@Rf5E^v0~(uMT&bO07ET-c~%t52DknE+gO-F4NTpD<wp0H1vFNu!M^
zmd=#VJ=Vls&KXFbL9<vaI2;b*<Ksz4NHBt&$Kzo@NeOe7FK5z@9XM3gxb}UsnX@bw
zW|!})(?gWeP<;7vq~XJ{+;}6VgB3l<3VZZm^@}gE<*~<*Qd5oKn4Fw!EPK-%a@%Y+
zTrL+LPk2_PEAZ5&O~~b8ZN1sd-6j*kV9>b17h0ak@b<L!G_TuUH_lzP?<z75XBc5$
zgf~GDsxxlfIL3_|7wci1lCQrG_X-_6cyP7nd-kkoYqVj*hDI4vT`XT7UM(?Z%$ORV
zGicBt0M@Qu+bCnIZyPpjF!oi}RH)>fbIt)^<;s<fHm+DY6F&E*KrEp=Lq#sBG?`4u
zvTTGWyWNh>W}~R6h>QaV7;*S8ulDG{;#REyD3B!XvsidfRe3QOWRN5g%E`g}<daz6
ze;<^JzIuU#1hQ|wnS<lTVX;{7IGsi#ZoNvNzT{0`_NHl?@wcj~D2l@Q`T5+xZ5w~?
z6)w*4k<CVTzn`ZR1+&>Kmdmw3dU$(9eTA8hna1%84_(N8yYD03Q!(?V@1GRmO%R0U
zN)G}xiJU<!EG%s3;nZ0{LBUC%)2UM@0FEC&-oT@27^m_%q@<((C;xm~iZkJJZwf?!
zJHzSADr*XIMMXtei;H<`(<W9XB=Ablp8Vu+0I*7y86nHuv3xnxCQKl4-##=z0yJ4>
z|J7HsYvM%kdT~1(xLhtHyy>%T`b~Fa0Mo}}u~=}qT*k7@@wvI|*|(2>cIW`WAMAF{
zDk<UG@@vJ-d&{AJ=2>bMk2op{4V-`Md>-Hac+|2<hr=O4ydVgIAP8p+5#R&>BSh&T
z&TKXtAx;l+LkbJ&vuqh3bneW@ojMUPnNWZ^=bz8NmM-OwzxfRlGc!4U?zwEAJQ;td
zPT1}CsNkj-Dv1nk)!lgO!O~{48Ep_$Rpp+&d)e=Du_`eUfJqJq9ZO0$*J^E%MNQ5`
zdU#tDT*MuYJ5UJE==MI|n<syG60bYFKhopzM1?o;*$aXo2!e1X5K|U{K@V_xcyqa2
zc)eZ{6B9{FN(vVivD>+M@nT-R<{Ae6-~Soc9!yE$#t%PaaCSETe*Srsu3d?bk2m(!
zB_t#eA0Lmy;lOIO8he#~?xtH0lXknExVX6RO}op*^dEj8wY<QJUYT-#Fj#G26`^_2
zm(8vVuH!1lRg_8L0ywF~sXV*+Sz0+;;q`irpC!E~pa^e*AP9mWoGC<r6RL;|a(cB&
zkH>@8WFq0sH%YqvcDjA?2{SLch$kjaB>AVGjB8hQ>B5~uhVX8;Znz?<O6vRFs#`L7
zva#sn&_i63-OjU{H{&kfYj;SN`IW^&p{PvRtm)xxo3f3|?3Yn2g+qEmAb~%x`!nsV
z?To@UPN!3ZH$f22D7m@0#@FrIwT!->`hKaVULmwDPMkOagd2PdVQ0eU-q1vV6RK6Y
zZ=CJ#e<$(63u*o4n<S|!i9j4MFgu(3-+r6nYu925g#ZYcOw4QBmT{@6ERML*KAoFw
zeGHKmGd&&;Jv1$<GUXbJg~_5aWwWJMGTk5C&(+qe$uZ>s;0bzoVeJc~m{W{plln4T
z5#9trXi4;{ean_DtM>eg6)OPn`Fzdd##gVV`E#Y>^~#&gwHH`q<;f*WmQ?$krAwCr
z7^U-Dx-;Q(Zwf?!6RL=83lLhi4Eg-?aol?^_M9ACfETcK@6N$zo*{42B$ASn`1P7K
zOkc2o?s<8}>+CU`xyI!pLzdZJ{+g!~tn?W{tJR9r=`?0xhLo0a&yPPE&-=(`<Bx!%
zC?dc$Bl^!<ULcRFELX8Z-T{C^bufM7bb4q#jPT}ixkPvq1ffM5IB*~UAAR&uwdX(o
z{BxlC-dasjukxzV01Fl@sB(VSu3bh`^@}dLsL{q%-}GSi<(FSpdtUF`cjc8=HrkkC
z=}h_DV@(9OreOYjkfi88^XFIp+zuV0pZAx))ay`;X54%CqW${UScVTrUbha3@DGcY
zkihOo9^uCqU&K0aAnn_?r(?&Cq@<+KUy^un`EnlEvc*{52=J-d%sFN=vqB;K5xwJT
zqjF_RkH<rNd_312JI1944j9k-gWb-j<pobd<uigp)208sl?F?>)_g7N&FcY>HJK+i
zJ;9)|K}J(|x7%&>dK2MI5QLWIw%cw4VD;+N%$hYT>Re`KCUfS@0buIXsf|9i(~+2%
z$X$2c1;Bmx-N&w7yNq+Wxw%Gz>$~o{t69t_*5u)b9|mB?j2TsC;igQPLUwjGX=!QA
zCV1D?new^Enxu)TirAARShEHO3<y6SIuw>Jg^xdmtFMlJ-jE@n{|92~RCwV9c=1Je
z;DI^~L0@*L78k?w&trb!1*GyqApjw(mA%(q%bp1n!0pCvx8ra)j2miIRVgbgqqMXX
zzu!-u$;6x8y0M_rI{mXkA^xT)3@=|&S=-Y8dWFK$(ozZv3dqaLBk#lsrk;H^YZDRx
zaA_L<EiI+L#UjefH(`2s3kHKsFiqey>u1Kf$F@AirN=MD>-9!8dKZnl1wp8d1q&AN
z(n~KHk9Y3eY1~kE?b;Opuh&avW@fC07$q|^lZg{20vKb|#|-e{hac8k5EwafB%L~S
z;;pyds+ZTRPHt{4W5<p)W?b}TqWbc>^z?MT`synZ%PUJaS5u};F#>jadOC@TiL6|?
zlKlL9d_EtG7A<P9<$`<m?4fh#&MaEAh!G=3G{}3@)|v9T$5M+4aHakL-*4K@fg{Js
zD=4O*u#}wqLUNB669}rvvWZp+ZW28%5<D(EZU-r?eGEFgBi=YitcM?M?OGT(5GG6j
z{r^<-uvYowD({KLzI~_lR(fy?g+gc_eT4kG-(iaQZ3)29Aw$?PX%c0rsYZ25z5kZo
zZpUOY83C@ixR~PNVv352C@U*tV|+X>_3FiLmn-TuZ&nok5DL-y6sl2HrneO+DJkLj
z@#Ey><#Dj2gem>|v%ma(QdO1z1p=g6EMmr{3DSS=g25mU@*s0;bBuG7c1+@iBRAmj
zc#P_$BD@KLa60DBoy(nf-ubi7@%en@MJ%hPOl<%FAOJ~3K~(>bwFL_n@b0_s8cXkd
zJ|Ck;kLI3x?upuSRacD>;2?Z6|K~sdnXIfVBZ#J_r*rMK*K*r!x3!p?__=fE^2Qr)
z7@;LCEsfEmM>BQm)CQetYKj34&YaIZR+@Ey%PlBo>AGzGZ^bs&ZrhKl)_%#HESnh6
zGnL^3x-xuVH(DjcHNZ$ugCs=<xDFk{e=2X1&B%bPtg6B86d21TH*7$jIu&`*qNwvF
z9Xhb>?z_n!I1ro7hSTZ9?RMjKyKy?5#_XHPWHM&P{C+<rB_$LU6;V`FL~(I3ennw^
zYAWw_=|ZV28?W!tG@erwZU-Y|ol4NsZ~g;;03{_Q<mcy;mzT#DRps9Fbc)R3_J-#L
zgM6bXIK`f+CPxq9GeR?%Zl7)(ziQuA+`s33W9H4{@nE;xjq0U>AP7SJXsiGyG_0l?
z;Dm<NEE{<*UbBM_zFf_Q?FUZ&<daa<5UaNAW!09wyzt(C=-WMo%Pu&FONRBXhmoG9
zwQIwFr=(OI+rJ;mEBi#zpEG}c^m5CeVH7FJ%Y!GM#5!*tMC@5p+-|aOzL^7;UW&!x
zAl~7K3T}409ZUJlmL7~WO+%JtWLd^)wHi&pZ8jT4MMY#BIKYU*hk3O}4;Hs-1wer$
zF~wrxEmh@ZMPXohh&$Phx*o*z%9N_AqN*xA^YVCV(<UD8*AG>aSYfd+ITYf}U=XX-
z8g*@x6)Z*Fw;JvEezcN&C_aW(l8;t=6s_nOk~;~>m5k){fzyZNN<#9q!<5n=$?l2u
z=ue3r-sY-vneM0vZzGS4<i6ea5$}n|>-8GTCPjD?1VIo4L8#EI0^HiI`<e66Vm9wQ
zSnc_~-BTFQE0u(JCkb8`t$cALdR??l@{p5PNNzzfNA<t+i&(pLKbx};M$O!9*nWTw
z+YgYna1B#_HJtPNbZ)F~uY$gL`MT>){@lorcM`@vx3V&L;|<JDK8aM`ivvKDWe$!T
z$IhE>B9xGT%i%DVOS)Vx>~=d=tJT<77I{;xw;RxpR}OMTMMYSPi+OtUW>)xoywbBL
zKRLonS69h0Lu8rB!5~iq37U4&8MDeoP4pSSA^G`C+OdN<-Ma(uq0L5jzn>=*rOEDx
z(@OFQ?Ol$#^M8a6ZiJ9p^K*-ip%opgdcq`QYS#z3^I%M!1|zwX8gRs?Pyd{<)GQuy
zJY*anlskyuZu_m#>rY>z+f+X@K@bE%5QJE176ER@z8vO$yo9Cev!jk%EoKJvN@Zkv
zcZT#&Bhllk;T51&LL99U;^@`6P1Nz@g{3TBvxB7@cCmcpZURBYc+Ur)|Cj;2Qn@E%
zM3w6r%>4P`C6Nz5Tv61djw1KDg}(k8^KX8G>4zVpo>OqnIc&T8Zi>5gGxoXZvu=8^
zlE^09HQiL}=k*Y0Hk*wQrw6$qg@yF}{(C;?+?kI$b|hdjp#ZN~EPN6Q@kdo<Vnm3m
z>Am#OsE0UxChoeN9QL?eeA&J|5Uxzwr=*0-%3r6c%;u=Om!WQ$Pw3F*y1!URC3IjN
zp#$sSyH_x^?Ty@X406xWb${)8qKCId!A0EVxC@2wziYjZ_h#CbX?We?Ws~vo@loMT
z1UNwu1VIpl3Qa!1z4fo}d2N35zAv}a#)L5g$rzK4+i9!Q>wDuITt1=?myhT}sXxF+
z|F@3!K3_pmNf{8H^}F@y_qgSXUoh$F`rABQt+i|6nrp(9CZB)4cGq^Uex}d}Zo76N
zJ@N?FPd|-1?{CwF9k<>}&ZtpXtyVnM>~ph36aqPwo9W0V;3ks^v)PQrVljeTVPPSb
zq9ShFvxf^0ALf;wJz3-P0dUY{;zpB+w^Wr^RF&>0X#j3C8n@YSyWOa&ilQh?&Ccea
z)5!*(4+Xf<;b3uTDd$9tFIGYaH=-<mlhBc^)t)!C?Tx8jpYSqCR}zxb7hX2$P72S!
z6(5aSUKu*LG5lH)Gk2jwn+YA-jJoMl%;(*TsY7fVi0VIwo0ZL6YrmFaDO}++wK$b&
zTc(lhNXF~+5+5IrGotys2ycQQ2!bF8(VA=#lR!}6xp@ouYFWihkt~}SKdK)$Uw;12
z&bHN6QArtZfA&2eeY4J(kpmb$up84RkHcZNHq0AK5~QY9Us1A_MNEw4k_81Yb0+4$
z`~|73%s3yiTG^YC!R`qYFgcw#olax9q`uG1YPCk~b2}Z8vww=BP*zq}rN~KHSsDLr
z)rwbp^dQe#@z2(#X*{4P{1$MXBtTZKOqrXT%l^_*?jA6JgH9&^oy#jzwu@0wlhCnj
zl$Gxg+Pfn9glxssz7KMjp_n?J9}aG{r1=X7?OsM`?@H8tt3eG!oj0}XgL&{Bn3B8K
z<y$x{nx>(uD!T%^7-k<vjwuI#gg^qbSIwrgr87RC&*=3g8g&bTAT&Ht#H3{qMNH02
zO)|jc78LW?Uq6l7>o%lc8V_7Ql9bl9zqvhKhmIBSm%lG!@tPgRu`Ve|Jpa&Dv`wn#
zf)O1$gbS6_^l{WwZL(6Zi)st--h1J;00*P@3?3OdlAX8RMxb3g>~_1cT+-!o;cz&N
zeQqaP!dM$dpj1_Y!61IW-)J{bSXdYiUcmclX?&WJf*SFjT|yyVR20TV%*It7Q)Fez
z;^JbXy}%Y#Wy+vIM)k`f!60A8pfaVh<^z<K??fN8xiOz}C32tfNH%x<y;-mnW%Fk!
z>;3^{MNy~B1Fyq;?oIXgUMHddEba^JV~lkSJLK@cOK!!@-&X&Pp7bOkAt9<!w+L^7
zAP5al1h|$#1h_L()7T6YVb_6U-1_u;QQ>XEn1Rf^|H?)UZvbtRJj}fRN^TopQT=h(
zfn(e;{qOZs0n;#aXgIvBSyS_K9(g4EcVq+4sZ+z(J@_CHo`nj9LMY3ZBMl#p<<?uH
z!dp?-uB?9XMK=HTw`d(Z;`Mq-N=hOrDaq)!r3bjW&b(C?xtvnpW9RjHNlZ*6IXRhx
zgaleytxVamgO^sV;;a)VjB9t9Ok82LaxJh|Rm0)5Qjpa{oyB6o>2wkwACJf5p(pUv
zrcKD@&tGb>aJR`sFc>sKUxQKu1phNDI=q==<ldKK%XkCxpd0Epya8AonEOw_cKth;
z`&|Qa#jK{X<^zIXO^0A<{k~^4^zfD!$YY{;q7mL4s)OHe_&q(e9(cW8JRT1&mrKmN
z34$O9f*_oNCN%?>TTslcPrpY_ULg=(GWp0&7jgNBJ~18{e6{Qco}0JOSW=njaq;@o
z*Vla}ZvOo6zPFlu{BcEl0KLI?q%~{M`u7iqw}S_fo_Y%N+iyobCFt>xee=!ybn(Sl
z91df-q(18wxzDXJZlEJ)34_64)Urx_HZBkd@bC8Rnb)<e(bo;YrD^<DQFs8bRkN&8
zpXDnnE2FTm(C88O_vB=wG9|!_(o!BSFS625MNPDle1cz1kJ{^I>UbWOA$KBq+BL{~
zRy&TuBPdH>Mcuv3I3^`@!aD95q`1}%^Pc6OZ)vcUE9EQskL5oA$ePSko1WsAMZd)7
z^WpRPaJ$_`qizx21VIoQhnRtD8N>|SnW@Rlzy*Q|kNx#iBfPntHePz<S4|?k0gN4d
z7Oy-$!PtA3TTsl@KmU_bf8Zonp2XExhnGdx^e3{n+kgR4=d@6WP``dCem|jEvoN1?
zPE>f)WSIk3Udht8-{$a@SK{(`NJvO9X5GAAuhAaBY&JLA4RqyJ15T$CkH-@=8|QYr
zx$^K~-d?(tF^3Kr*A`0>PgpFZ%Q8z8#h7)Bd~N-8T`m_MkB9j9cqSe>!sv+E$fq0*
zK35df@)^DQrseG+F#n#Y@Mi8a9_!er8#TNENO7&PjC~q&`mdwM_s{$5rvhdrdO%kc
zg_}$_8Q~4!p{);bVc~^%JRW1_?NpadPG&MvrT<lDDNCz7Zz)Ub^?MWqK@bE%h?OQ2
z;GUbe&{#Gp%O+;tKb`@-Qe!--XuZ3(<4+G=WfU>lb>J9J&i*{Ak6dHWXE#(;Mfv=5
z<leopJn=+SPq(}Q16cn0>ukUGUM$JU_<TN+lar0*l6s#lz1m+aO6%)k%WO7dx7%^M
z-BHUreLf#;%w`_hx|J7KucmWxv2pDWCKDG}t=z6@94-%H`ed^Hx{<FL7Z=B)J9pCi
z_;COf;1;``O~GKbOET+1E6FGD#cwP6wV7lrBObs!<W4Zj_4YosWgc_`mJ1&-mQ-pb
z`2@fIJzC+BdV3E&yaj_n9^^s(Y5k{hZqklPT%LD1@$vD-o;Q8w?PNcHZ}AojSb!Gs
zKcGs8dyBUi%1|aT$#~u%1~HVOBE$)TAP9ocA~cBr_tw9@kE%BL$W0eDx$vgz)wvCi
z-#W&4ymWnbl{N<r$p~*-wjhlghxLjpFzwo9oG)$Po(<Ecv2NBZl&)RzcswWF=Vp?^
zx54_Kno3-Zjd+e!{<uEq0n%cz;BYvIi;IhzDU6SgXFy2_udZ0Z?b+El)QWQXZ=22Z
zu~>Mmyb7fr#`GCJyWMUyhxWK!Oxv=BHhw<<Crl<LSgjnb&k&~u2!1uaBD~q$STFk{
za<7Z){@V3G?tUTGD`pv$F13<;0t=q1w>@$C%-f6Fi_EdjF^*rg?<%f8biEPY;^N{?
zIlKYf!Y%A)f7G#QOaov#(~V<un8P3jF_*c<u@`v}fLY9{%eN*7f*=Tj&?Lk>!0p(V
z6BU3aj2YNumQB{=qVs!36*hVI^A)V!y8macs5_$+|FL6)9)1|hfC0$gd}Ewf9S*W@
zzM1b|dyV5GMi3VlXDmsKTrOF;A@=~_F+eN-b0hFBRYTkWU}41bUMqiGUm>o#A}5uX
zRmMA=T(@r@^Oh}R$kC(5wYieS6pMu+CKKx;mQ_lUWX$gAAuiQo;rAOh7$I<{*~~<<
znUX-DUP4^(+rLySn>5K-$3BgzUDNt`Hnr}BW!y7haRBAZDZhCxs*l|1&|5jYqrSuA
z_Q#Fm!*hmn-|qXWgtxlxKkPt<sK-lL$|_dTpZ-zDhcJW`QaHpR1VIo4K@gg|m<PDI
zA6JC8A^p<0H)BNX22%^Sj~~LQK|PGe4K)jA1UJ7Qb?)5oa>>8`6_kqpbccWWOP0R<
zHv4Y85l4Ap2tBw(7Kw-qZo0L=a}n?N4$v0(CgRxZz&gUAO?L+{hH!{mM*WEla{3ZT
zpU)Sytg?g2#Pp3DnXzu2F`EXkN|rg#YUTb=h=Pc{ZIP8Jy<RV8YZ|}ZyxFKs`9F(=
z`%NYkMX6JOQ`UTdy1in*mu2|9O)k9YOv&A`jCjC!9NN30YMX;v(3kZ7OZ^v998-+r
z1M&v&)Yhkr0Ie_GHJi<K-fy{&aKA)7$Zcmk0PU!{$FMDJS;eY4y`LZmf*=S&QxMYt
zw|47(mafkR!u#GHxPBzE9P><h${xD$Ladf>g~Scp4@C8gt1CUYg+d|J|NRfskRe#6
zOu>|sV?3v@M-Nv1^{;Gs>@iI3+8O)DlFRqJ=`$UX``k|Drnya}$MehozN6A{eV${>
z>3)+ns9fa4;cyTiA8#zHOiWB9K0clyg@w#pwv6j{@5Wjl))e3si-q2@%m)z#PRwSr
z5#r+G;~7y@#4Qm^Pv5fHm>sbUv$pgm-8yrh@l9sgWKHC*BcckMDC@Ea9o$&!*U>9~
zeye=TE%sYb2>)`SS3xhH-TW+Gw-=w!XDr{<!&_Yg+#9?>3Mt&eEhl|$TiVv?y#zrJ
z1VIp*ikPOQIUg-Hz8*iSU!(VVtE)thi|fY?G9J(V$KrY^XkzSh+q)O-*T2RxY83Li
zb;kKXLIOYh<~OW(`DOh5`WgG&l9Q83OiYaGt5w~s+sPazI>hBbwYR@r%KvVt9e|aW
zRl42osAZKtpAVnI!EJl?@al>c49w3ru03cnaihh;#lZH6nYhTxls6tc7*(0_5r>1X
zPO~y)WOy@mJP-3PD#zWX$vo%=<g{VN<J!)`>EUg&vY8B92E|gi&`fG^D$j0ymSjgV
zUayz<_;{R7r}4{#x`wyOOy&Rwc!p={^g4ndoH=&w+QrzhW053@S+kn{p4cTzme93p
zS0qVd$&$v~Yu`|Eb94FaZ-0v<NsJv^UmGx*jwMT$kdcvL{DM-FBr-BGTEu5p7cKpB
zkCm7OxW#LB7*!|TP8&C0etxWmQYY74JP2=GcrVf3LwQlfSZd2yE?HDW=$U6Q_v(c?
zGqd8nEVCyggJtvPkuz>wRI!i5#6+XApT5uSblL(u4jdx9Jo04DuGK4_zQ`b_7deSs
zR_XP6>87g8T)UPhHf<syP|@1q|IB9ko6SrEN;M6O#qzV2DQ_sROc`0#QvX~Ime1%_
zUS=6OxRKD_72yXa8B2_-P1crq=-ozT%Fv<BQT^h6jvn6j2lsQS?Nahgc>p8?68PhW
zKay%mt#x?2f-6qiDquR(d5zbY#H3T2ebc3oa>~yY1fgY_J9jSW>FF$7xG>g3IVt^y
zci6CDWM^l`dN}oB$&w|Uciwr-m@y;PLunA1nVAe5HjJ#SEYi}_7&B%JX=!O>Wo0pJ
z*f269?&Z!TE&X$krI-b{558P&d_7^zK%>7}a}y4qzc3zWEnHLU*NAKjpk`%-_qjdu
z3{qK{@toX2gIG3i9=q<i18b{RQ2|D83sBQOx7zq4;iZw!o$QH?th(ND@$vB_CMFsI
zHZCrX(Rq2yTegg=_wP6MxRpr~Gb|PcSS&20Vo#jM<1s2zCYS%SK4CJEVY8869^&-R
zWhBtvWa6Ik&nhy+Da+q9zLw9rq|y7l)s^J*VeVJaOkP?3=1B{h=s&YZgGU)-9m7FW
z_?Iyb)xisEU!aSrOStl9#BA`X{9OKve?_$l(Ax#*-r_B$F^$W)JgU+pKzG88+7EJ&
z%GR=0ETa^JGf-}BE*Tja+<E7n0Hmj<$9P0PZ^MQSj2%0c88c>(mX=0ZT3W1!RA;kh
z%`(F1m@%jF>*3~Q$&w{ZoH!AH4?p~nojZ5()mLA!bLUR(y6Y|gCQh8lu83_LXM&dg
zxyM>e0$grEF&nlY0KjT7lQE`g{|EJC#*gZ2^oHB9FNXt1@=tO_1%02JvVJ|%s8Lw1
zyAIR7ea88c4jouGV+QM=dk!rvEoz@zO>F@x-z2|IboqaY@Jw4}dhA$Ri|;-1y2ens
z$cfA4!t3=$Evsy8voU4I4qjTdinC6fFs|KYGI6EN#*MPf(TGOhl`B*3kY#>lHuJvU
z&;CGw($Z2Emsd-CU6v^>D>G*3)ZNP}s!rP6m<L|hi2pR|kKFfaB)bOy?fCwvVl0*E
z;Vmza$9VI2cF5tqpAOZ*bL*d@ht}h?!rRF#Whu9ED}xxszxY>`^Ln+(b*!s$-2o0%
zsZJ>fLd!RA-aN9hvY0So0;^ZA=GtqojrEXz)}xO;%IejtnK^SND^{$aYuB!^9#Wkw
zS+ayjAAOYc^mM-a?mK?>yWhonNcHZ64?Y0kuDk9cBO@c~-0a!2jS&9LH{Vpbwxv1~
zKKEFQNq}3ru3|~RfL^J%owisEquy98W-b^|@gLd$uG)UmYxL!3%HhLkcixHhyz`L1
z`_4G8xZUiSG>PwDdyNx=2UnSG(r=C{w*{!q9aNP6*Z)+WVH-er>11`Sj$4(VtL)$9
ze|M?oTtm}?Tx9P!eO6Nc=W|Y38859`#r@m1;nu5mN)q#}R?-~~Uboq>xm?7>#nD?)
zcx+2WIhOxft=wWZb5U6t#|jHcE)RDKurUxYDpsl+<{Q_T&$-g*uh!g1HaGIXiN<4f
z)2G!wPY-XU!BTFPZ)SxhymVC7WPbC*Z%Fs2hi5h;!rSRA<*m+8hLS=GD_L3Nb8hE$
zR<SCoH{63f2vB9lP7s8auXpd>eDTE>WM*d4rAsXS->P=Tj~~za_3L@$kw-{OOpNt#
z>a1P6cFdePlU1u$F?8tASP!Q`=*uIoyRQ0Q;7*t@0f0|F`J~at6l-U~=N@Y@32^_n
zVw>^x$n@^97(%@}uTN*=>t*X}o+giM3lMtgB`jy1h53y)qS^u+95;?-^X73NBLkPm
z6SdE+a$A7<xH%q6MVo-Z)tuMoEncs5T%YHNRk@DpmQ_~n9p`qtx$^K~-d?(tF^3N6
z7g8+C{LbZKwA;;(ZZ~mpaf~b|;HI5BE8f6vX9w`7q9VE$6&Z)OsA{-cWpN(r!Oh`=
zvK6_{_{RI@8-V%jON`!dp<~%-1<^|pHBB=bbx$@;W`T8qaqj+Y_j6IfMR>j5sJ)o=
z72YN@8Gr*EsIo^ca-ZDOJk7N7|LNxraj42tOhFLN4CBU)W8AoLu^z@Ln>=|kef#!}
z^)Tv9mo8m+<dH{WJ&XpkVZ#RU%L}O06jaVR=Ntf5uB`c&k1b70|J<8`Mh|eM{s3#Y
zRW!XG(!cqy?*_PFK-Z|20y%kwQRgG~xhY?Lg`A#_<)Md=3JQ$p6r6JoD_(w?tq(nf
z+`fI4eQx@4$;h?<b#)WrUT%+3a}axua23j@BaXdZe%+0A9zoqnl7uYFQN82zrKWoC
zxHe`pk8It_i>p`Dp`-*P2}~xo+3k$?dilM_L(t{o*L(JG!TyM*?D6ruZMBjZu@rNQ
zB%vq@%AW6yW2W|fkZkV8{I=_#Y(?%|5#iNc6*Izmcnb!D{D$A~f%OC9+-*B=<H}=K
z;_-Nl@MgE$jU~PHVJ>s4?2W5wpWM?t9d&L$`)hbrK@bE%IDLhMg(rPZN=mqZR(}4e
zZ?6%AlWFt-_x+~bMydV2-BaqNc*#Hi`A_b=^G=2h8^-Oo-_Eve;TgV<KmM2r6DDx!
zrI+%DKm37$h_F=O9Cj;xySFzU>;3H@BE0?hBa9!9^^!|4{ZLV@vMf27Ess6Msz3jk
zvUAQcW|1P713I0~pWWwny524S`;S!JCwEiC^YpnG{oEwNq3`rtKi5A!)J86=)Mqb~
zl9Gszk7qzh39m0-&h6RRI5Z7p8EiKG;qh=yVj^F=T->>44PA~N4Zo-)QJRv%kHMhv
zK0lhx;Q+T|u@N5RE-hn;fGKsL@pWi##cvDsnYS0U7x|m*Z^rSf_Fct|2X8c*q&Gx(
z69hpJ1VIogm>c^I4;(ped_AC7YMo#2l~-ONCntwzpM93Z#6%u_^ih8Gt6y>Jt+(R$
z`+4)tH<>+qHcve91P+IThaP&U&hJ^1^s_s%YRg^#j^-B`vlePW0nD6<`7eKosw^3@
zTG@N;wd|QN0VytyIEMqb+l|}p#^rKhx7!;ev_-1T!m_Hh{hFT0{wsR16N|-y&1S=H
zw^LYHNKsJ{*X`TKh{K1O)2$mzeLgUo$@lsA6VO9d8UNq^^6I6RQtWbp+02d(9gO$b
zWwoLd<e?nggta`Qm^wDkHW-!3od*+?t)K=79omdmbPUazfTAd5saZVks3?CkJZCuf
z?Y@tAPrT7MKC)4_AP9mW2!c@m8a=?}6%-p^C&WAJ^jeD-FJ{-SUHs`!e=>gCKV--d
zo`3#%-hcmnmM&e2qA0xj>Z>S<LPA19o!;+cDrOTkj^q}ED;2)?9_Gg%M>=vO>bW_?
zhqL{TI|#IEXDs{EgPUGeGO{>{xFN0`J-|f<Ijhwg733_%#XP-X0}H)gUPw<5FROI9
z_%SJo?QPrAbJZ%g4IPSRHiNn1UzOc98zuYKV^tL}nJ~5O-E51ORAF&oYI`=J1K}Nx
z%AV!WV+>y@UvaDRR^w>{@&@qK)~ASzi!*xaMTR%=^C}2}AP9ocFd99;6%>{lU$;t#
zJMGs|6ovQSf1igRemH8WR$gAXnebItU4_kN!(y@U(n~LqpPyf)yzBAf$NBfa|4mL#
z4t~F%^Ugbukt0VU%cs|bxowgM2+z7XHmye*JRS3@RZ-6=?%bJelP7aLJsq3PhS%vd
z!kg3StkQ&A+z6k(%Cm9$J~^w^irsF<VzHoU8Xmtt9Nr+jq|)g`>(GI%9XdcL1e#WH
z9#AETAA_X~(!!@q?fS&%J8T%Hl>USctV7d4J(0ur$`Y<~T!%uq&`$Rg-FbHNvv}QJ
zd_JGCH&cW+K@bE%h<2iU4}DAM=_fQDjUM1~@+&rcCe&g7TPPGFBO`+zJ$ghP-?}y2
zlWXwca4`mx$;2g>TvFxwZQHgnW5x`I4jsxbe(?)du3X6-cichGo;`W<%{OV=w)Rbb
zle|vsfl?k?^%<A!T8jqg?T{6>o9vrz;-^b4!ECqVb~<sDm#}v_okpOD+&iQ%!K{tb
zy?JiQH{CTYtCS=ORaNP`cP|6CZDUQ(p85q~v4q2$qJXM`$rS!m?nkqk0ip68a1L)w
zzORNNIeg*prfF<dH<Mv|oMI_FbDmn9%8X4jNOmOS^?HeqkH_hB8ijRQ^3RbV2!bF)
zimW`jWXY0hD^V_88g9_k)SJi)%}e74xV(yT>~)!evs$f;8Z|2FSSS=?(V|7PYSoI~
zy?fVqZ7>*Q+O%ohbI(1-zifjC52k<r{)`?yn)~j%kB>h3s8-|AG!3uYjvtBde>IMK
zCs*_bQymV1Za0`rcohYgrXkC6)ZR8pl4!4KSfuiz=n=uq4795h<n$Y5m!^?a!<dqQ
zn(8990UR~lY<D_^@3$rmaRYxkuUXwSk;^J2NkY>!%F4<(5*No=D_3G$wTks)$5N7<
z9KOJ00;@F~;uIx3J7+S1B(c>VhZ+i@X)?HK`UIM(xYmR;jRRIcSM{Gqjw$@x!-PNr
zf7tj3QZ1<>ya|FJ2m;|?wtDqyzWnmbY6DzWRu%wPUU_9>4^3#n8a=@26)2%@0j@ef
z{qz&tw{NFkzkVbo)qFs&4K4rx5;93dK~z({d-rY@ELecWVqwUTA;yj81s7bv`RAX{
z#~*)O>-P?YLRicu0;<C2-TJb(Q>SX5ccj{*&4V3i6$({*qwdi(Jen32Jaui#udPmd
zO+#O>8u_}irjb&^HEyUev?fbZjiEJ#=pT5K$;5uUok{K5g=g6g9)zqc=-U_0J1-pG
zAiV!g)50Mx6arahhdY6w3ZanJqGsSUO+#}eaNMMD+0|<};4T5cp*ongZWi67ZdDp}
zi|{50f*_o!9)9>?CQh8lj2Sby_~MJBLfn)oQ^?NFCM_+k$~GQBsEbAqaI##n3@s<G
zuwFylnl)=EEG*=*%PxyLu4x*1d3huzCIaB~dg<J`Gr@?`@H(5#cG~Y>>Mui6gB-Rx
zPWv^QGC#1drqb}u?FL?!!^<Sy<#Df5r*Jq^)o@s=97OeHmF2T>n-fzgQ$nbkhU7|a
z^x-!YP16Y3;#roQ&;EEn0M?L|=hi>RS)sG=`ofL6MR*egp*dKvU;!_^^pf#-=gyq~
zy!P5_{P(~A1;Y0PnVFd}8DC|yX3a9j1r^PoAAImZ;~r+zs8P+PN%F2;yO=U%it#u%
zHx~$hUt`CPHIC1oJ)16Fx-|Ou>O)3G28$OjX3m^B3>!9#^z?KR6BAjvawYls`S^T3
z=Fgvh@)v4B&V<iB)*3y)wMuYv;7GWcVO;~<Pe1*H&*#JG3|F)K-~axHBuPfsd)?Z#
zYst#WV%Dr#;W4yo#j<6~uv)EAH=hLs1!QMupY{*avE$+8p~>%mLC=3K;O0vQqL|J2
zy<V(VD;A3-s<LFE&4%Ax{YP-v9zAEJkF&^Zrl^K8?Z<33)M}0gOeXU5*`!JeEEY<u
zDcYh+5;-+o(;}T}a4(;YD>mB*C?V7k;7V-Jp*1E=(@;%T&dc^P`<=76|GKR_oc%b1
z$_C-_M$f$Ig?0o%5Sps}`}ebO;le7%v$M0w&JOo$_4%4k72&mO*H$~;)vH$<UwggH
zXVphxVPUo3Pkw%W)bUekh~1RUo;{nsef#pp8*dn&l|Jh>b?VeJE~K0(pL;Adet`2;
z1h&YQ0=4yzfBb`c?zx9sZn=e-GiOp(R>qfKeu>NFV$h&LQP2JO<Bz%c;)|n>xm;BX
zsJ!~>tL)vo_q2XfB1sZ?1%6Dj1+&FYQlgvIty`mMno*oYHkpt#4M|^ySXx?bkrGYQ
zAfoAbjn6rSW7Qo$+2hFXsk*O=%w~!$mTIp#X15cnW|pp0mMMt1Ci3<2tX6{6gvgL2
zakPeDRa5YUs^K?s499B-%(XG-hab4@A5Rk`L`c)nijIM&b)8?gsnC=%G&K6{jpw7k
zjv!&wINV;h(Wu*Ivx)E~2tu<kdGcf?Po5m>VVtte%*-Y;8(1Iu_U&8iVr<P-bNg9q
zNN3XL9xII=;5=~^%L{YzPCt2n_0?A#J$e+6#{<AS@4Q3%_U$=%@L<$($;`}5oK7br
zMvVB`*ZcO{Z~4=o{>0z@_BXD$;)+_2N0KCRPn2LXTQS>Qbm-WDjvYIql@~10pA)Ha
zl}Y{UpF1A;cWus{>iNp!tBy_6NDPIlJ)c@!d`bcFRF0i$Agz4tR064{X()<<-|wfm
zxR`?`6MjWOQ4}_$rt+VmLn(1a_bKeSdpDOaTEsc3N?QrcNJtWdigH>^fRiK%sU#n(
zY{F%gX=hKy;qw`-F6?%DRHalw5ClOG1fg*?et>gV1h~8tC8zy5qeqWs>(;Gkn#T0$
z)A9TLeD>LAJo@OPJo@OP3>h+nyu3Ud4hK`GPW{>0f~8BBa`)YLGk5M>uD<%}(;AN?
zNgOLE#$+}lNhZ2<Or>4Bc1D=cs~$$GE;#*MsQS6ER$tfDHV{_#ocau<C%dMm@8@LU
zPt&w;;Tekso6UyP?`Nmm&D(wZvaL;<sB4mrALpv?zGL8_L%7{;d_EtEYJ1$rk6|%M
zP<p)D_iBzLNkT3=j?H4iBbiZ?lCdWwV6)kbnKu#M1VIo4K@ei6(F0sc>x#AJYq#z{
z?bpf3$Y98jA$<Gow{+^%iJ?P>B1sZ2zx*<*SFdLC=FN;9JC?K0KKo~1=ezH|<Jo7Q
z<*m2g;@or31z^*rO;z^Mor)iJ9YK;zNV196$qB^8RV)`h-Pxq-j{V%UbbY^1T>|Fm
zTvOj6_vfCksw%3g;#U;@(54Naw2q!da|Qxjy?#AocJIb*x8v&4h4}b*;^N|P2ioEA
zZ^kT3$o_m<itr3vE>^P%vq?fqZjaUNHiDZ7Z-O8Qf*=U7)#w3k(Agc4WfQ6zVsrLE
zju)2VjXS-njj5@r+;GDURgR~pr=L>8#FZ;o^7h+r^WJ;!(K_PhecH5XwcZC;>JPAd
z<8D9#2}TU+f%zo+t?GMyaDBdBO@ZoU?{&I+^BU@XPBw!V3<i1CZ03`M1mk(uP>8WR
zck-(pJ4i5@aJ6k44sC8XE|&|Z(}|qd8urPUO%hs3%L#A*QfV%-Bw>=l>}id;yy>~v
z^Ck#_AP9mGdyO98ym1Z&^h{;dmc6KIh{bDmaQTQnjXez3u3gLRx8KhA@#C34e?Fn|
z!Xk$cALjV++AoP)wPi1XpaMX*4y|aN7=O}hn(__t>4d?C*sxk(uUTD?Q&kmNmN_dB
zK-M%=Nn+TMBiyuY8>wYwIO5}ty<cv(8;8Sz&1MS+^Hv>E<nldm2RGKs7@G?1$TlPi
zBqU^af|zv^1VIo4L1;o6J-`7BAJCOmTlNC5bi=Mj4{(PMA7<jjiEQ7#olToIRXKn2
z%{SNjH5aYgZhSp*Q1`kFuSqzaaM_#!Y2@ScN=x}<+ctuQh4_k#F`Lae6BCW#=5#u-
z*=$%WmWpMBsRK}D8A2+dBU{n@1xR*JV}D!qFIbAYucBPFsng&X4n`0JK@bE%s4O-C
zZeTZFc<(;|EZ?}BQhxx4z43aEwQ19aAAkI@-d;~tLoDC4+ju<c+#dDz+Cu%PE?i2I
zgvn$=mSwsErDijd*Nem9FqTT%?RKLLL{!siy9ZOdK7<ae3x~Mf%aD6rT;)BQ8}-0C
zPy+y%lG2deNiiOgAP9oc5I+3y!;^0H5SqS}loWRF-c6fI1=xg^EhcNDS|!BMw|fcz
zfuO=i|F<p{!>Bi3e7Bk7g{45aNK41I2`9Nih&4UDnayS#4hJ5Ohoqz=TD59LQc{x9
z^UQ9yM>SuMBzLZuoeJ$;+1TGgg9z<fVtj4tGBk!G5d=XH8d94!ZAeNIzocvK%w{v4
zI(5QcLl0b`Ws2G6mdh@vsPg#U=PM{GDT~!m>Ld_Ucx`^gP49%!17bKDp*AE*!eX%)
z0nX?1;q`ini;KhIa6~PctZoJ`a(SV;Z#4u<8*}*eFQgKRSUxGI4U6Gm1VIo4K@f!M
z#4NyFGORb<I<x|ysHBXyKl?sbL#dN@KVLy^K`{`XeH%ZjUyMg2oGN`5&T6${x7%?z
z95pYQtnPYu5~jAj!w=K|%I41+Y2*z<{qbuwe*plJryY_vHO3<n1VIo4K@cj7X?eLR
zzZ!0Q{n0n;ICQKahNG#y<AtSUEnH(fo^<t4WLZ?~YfkhKr|*S3mEaah?m5QzT3PoG
zw6dax8fwE*11KxsF&>)xjE~`91VIo4K@fzR#58T3-={MJdWC<>9|$V^<?oAPIh<O1
zIrCd%>1VeNt+?p?o-rPgaJo*n&zanFG^V7q@Po1<)U_Yh^T-;9vNp@;XD4~uA)j?g
zj7KC0f*=TjAXF#j(?$1Wj4-}lyk-Y)e6lolgQ<nAg=_fYyUoVq2d*C#!_f$_WIpd!
z<7;KpXJ~~-VmO-G)BFV}n?5xjo6o%oOmYlIBnW~a2!bHgB<2CGSLZg|a>Xx<$MZf}
z#y88i#c)I?w{(3rf6M&VcszboKVv3QIP;h~q+@DV-pf!8pe%hgwgajq<@-0FeCekt
zDGj;nh}aHD5ClOG1VN}#%mW;R_l^x8*v)wS``5o@^Ui}Y98t}79XQ65vp+{wLjVjq
zyCV<ZaAAx`CB&L}@Eyk2>h5JItKN&@XilB7@e|Z-UmK6jL+*^>XaqqJ1VIpllW7tG
z4q)2kadb%u_ag}e6(0NRr)=GQIL4!jw(Gz#?wk1!O8wzR$0@CS%((XoQMg3Fl-wQj
z!0U|1%Ifz~cYYhY0iA---W4d{zivF1&%UH$CQ%RsK@bE%Xp)*t@^IL#Jpa&DBzjx`
z<Q5cj_j6fIW;x~3_1WD1%-@Zc0s45|PFsveCNvf1b8m`j?j8K^3xtkrjp2xDrseG+
z@Xd1&QUNff^v5#v?ii0s5ClOG1VK2NCKKQQ+9rAU!@ZXqA+FRP;HlaFj(K5|tc7cM
z^sk>9Gj9&Nl^3U8O~<wgF&&rC^jI!@1Sz3Y_<<TA_|<emN4LjxOqFSQdkFmdF{AOg
z<Y|Xx^zTIB5<w6IK@fyyK+-f#i}fHXJ9Mmosek?_yAB*Pj*S}BgNJUs&<J;p;do&w
zFK2!mRc$h*wU6f?x=MsMp+;Ka5d#0b-zdwE#erqS15KhhNNDeh@XT9zc*EkrcFo^J
z({4c!1VIplW}-<3I0(<aJvsYxmafk>j#({cZn*SZGRCAg=+ebNP~qLrSCF-EjnU@~
z!Uaoa+<S#sHYuD`=+I_@U;n-$!~y2?Ut=D0L(ImcZ2Tm==dFC%Bo+tOOMZ{3ZSR<k
zNe~1<5ClP}ohBRL08}-^Yx9@z?&m9_j(g)A+<f^jxaODr>$QN0s)qRDyUn~de~Gcz
zO*ej2KOVl}LQ$|pIAvPl5dsUILd)A@9Fx<AVIF!nlGE3C<M0=teE&vNwMog-4(qsQ
z#LSx@2!bF8LNn8(1DtN{*8RLTe+e75ABZ~cuv@ucKvxF$OJiuiE;#JgTEBLwKftOj
zds(z<JIgoi=6GRg)cI~5TJga3qeP!K;q(Mc34HS$p}i5mgpjS6`~M2L&v+!8yW!qj
z4WO*e3ODI4@AC%b1xrT%u3_I>5ClOG1VLyJ%_6|*7O&aC?0+m~@1eXZ=d2bp1A3*>
zzh^3m9v5wsJhV!1ljw2buv-ZP6>{<l$;m4sC%=%Kyh65QA7c5&-2{S4mDfvY?PJo_
zL%Hbuo{jOX2`yPjMOpa{%DSwm!;;;DJa8iB-j~;J0g;f3`s3FqE8mG)!U^G40hXb6
zi-IMBAP9mW2+dTp3UCl!=J?gJANb(QRZ&Gw>Pt#%9}`9oVEm|lV!5PHuR;emqO5#}
z(4o!ICoB%+&Vw;^JQum+d0=tW{>6i(s0Y>&+O>qxzSU^{f~eD`q%_P!?i79A1VIo4
zK@gg`W*6Wh9XOKDH_NxNV$+@~%PVW6TZdMR9Mqjr=k^fQC4~m3?p}tn{7tmu`>URm
zt(e;P!PMq#Bv%rWI~nZpNOljBI|;4mSU8;dPoNbYMJvrmJF*RR-)c|;RbEc=v<vsA
zYXTK81wjx5K@fzxYt{iSQchkWi`VQR??eeXd4=Q_6q9?rn1Z5Ga`FmE^tedyxbVg~
zXq6C0tAscb;++g1*o{^Raj_o0aHa{VsN4U8vSEHyk(2r&dD>y_GamV@OT=<XK@bE%
z5QG+_#RND(Xs)z^gQz>dCA5D{)#a77U`k5E)MY4g+AvXFQV;||5Coxx5&=#Snh>q%
z7@<AO&`R>rijSd{<UvV3n!f<8=opea3CZpWFROGXhnHD8eV958Msg>`dia7M2!bF8
zLIV>4P7nk^5ClOG1fiJ_WflcN5ClOG1VIp*2@&7~K@bE%5ClOGnh6o$1VIo4K@bE%
z5Sj@Q-~>Ss1VIo4K@ge=5#R(t5ClOG1VIp*2@&7~K@bE%5ClOGnh6o$1VIo4K@bE%
z5Sj@Q-~>Ss1VIo4K@ge=5#R(t5ClOG1VIp*2@&7~K@bE%5ClOGnh6o$1VIo4K@bE%
z`2Y6nfCK;l06@_H*X;=Og-i$>006**zySaNOb8qR0KkO60RR9@2pj+az=Xg7002w~
z8~^~ogunp+089uR006**zySaNOb8qR0KkO60RR9@2pj+az=Xg7002w~8~^~ogunp+
z089uR006**zySaNOb8qR0KkO60RR9@2pj+az=Xg7002w~8~^~ogunp+089uR006*5
cr#ztC{>xM800000NkvXXu0mjf0RRC1|27;+{{R30

literal 0
KcmV+b0RR6000031

diff --git a/image/20180117_000349.png b/image/20180117_000349.png
new file mode 100644
index 0000000000000000000000000000000000000000..123efd335404981eadb3d6993cfe7c1520f1006d
GIT binary patch
literal 34851
zcmV(-h}?IHP)<h;3K|Lk000e1NJLTq00T(?008I+1^@s6I?=C|00009a7bBm000ie
z000ie0hKEb8vp<R5p+dZbW?9;ba!ELWdKudX>eh4bY)!^&fNe2AOJ~3K~#90?A>=*
z6j%2L@GtDrQ3M+*7Me=z0*M6^F)CPMiw2CESfePm1VJR~>uU>YqEQ1D5_<qk&^Jo4
zM^HqH5K&ZE5Jgm^i<D(|=l2J{9a!0=?y{8gc^;o<cV@VAM_`#V_uO+;7=~d$2qA<J
zLI@!Q0HCVu4iG{JA%qY@NMk}l5+Q^TLI@#*R6s!zA%qY@2qA=2KtU2Agb+dqA%s*w
zK@uT^5JCtcgj7I55+Q^TLI@#*R6s!zA%qY@2qA=2KtU2Agb+dqA%s*wK@uT^5JCtc
zgj7I55+Q^TLI@#*R6s!zA%qY@2qA=2KtU2Agb+dqA%s*wK@uT^5JCtcgj7I55+Q^T
zLI@#*RKQhs2V^NK<|F(;3R2Uvk)2<NjO=&F&U=rH?03k>euoYQt<b@s6%6!r&{j_e
z?e%qG)KMSSeY&GfD=lSrpAbR_A%qapM5!<g!zjBGVp)0bar-_GS0f%H=J5*%g`!%w
z!QrT4aPO}8bg&sdwKPWugH{UYDItUqLI@$GxoQ+a(yi!3{23I5xTk4yZ+k#bBYg2$
zKTH_WSMF^SLI@#*5JH+Cr3Ohc2`}J%<`&|U(xvVn(9;NmExN*>wKkhtCr+~yr`?HD
z@Urs@5tHx&@w{}YBT(kuI$-HnpJGUVV?|#UA%qY@2qB~iQ%aDO_&fs#&xYZ4EKg#)
zx*8XQExN+iswajIGDTZGom#h@`>qJLq7!jDE*W?KO##1DAhCb2MOQdGj)aA=VZE+_
z5JCtcgb>m^HF%J8<U%+OoePuLrmL+12RlnR+F3zYTSIQ=Dk|pV%+>oiaWMh~g(VXE
z=1m@o@4mE=+qnoKgb+dqA<aXB1xfr;0k;1hg5W!k*liq+DyEJah`E!7)M?bHrV0v6
zaP)uSICJH`#K_X8mge}+;_=YZR9D!!2_b|KLI@#EOM?VSS$XfV_Sf?gbB~4(G{ve}
zwlM0bujtdWUS;NC&#4=@6`ja#Gcjt1UEfbbr*?V`)(=7mA%qY@NaLmOASpR56RUTf
zMMm~JcAJBpC6+sm1c#%XwQPL?ZsYfWJM8<mdOFy;d=duqG*U``2qA<JLI@#^heCs-
zti1P_zwrbcAaOXVaQ$`+CXMW`s8iNh@SR84{(A_Ue%Dq{2ZuM#q7fxR2qA<JLRvV5
z4dw7l1z7v*c{V`O)z-jX*RL8yfCK>c!#=`q?hfo+sI0vAaQWpg6czK8+%rN5A%qap
z6dXT(9NymE3TZneBm^5bZiGlwd1)J>cnS-Ww*MZ&&OzdERN=XDDh6A0Rn+O~q_0_L
z?EHQjTeu-PEfed#E=pZzi4Z~vA%rL%!!QtuL=XrB5DJCL?v6}5cI?2JGiNYu+BAi<
zKXT+qWMyT++1VMTrKJiv2a!!7LDG>6;SyEsT)!RD=mI1$3u8mL&$naW-;U)~Dp5`d
zA%qY@6zl2Jr<gf&CakQiFmT{N^z7LazyA8Gvb!bK(W6Ik^ypFS+qVxLJ9bpaIW#mh
zuxHO6ym|8m>({SW$T^5?au1RcpJzw}84h-qjV8rTmN7$mW5Lv6?EB*vBM_7DLWw;h
zgb+eVbC8sjgri4~D!Us^0*AvvzkdDDzkh!`dGZ7)DJkgOxwEpnRmp<~58&eBf_?k;
zp+}D%3OyH>%f&Ch{DNc0j^X_I^9nr|ktFxR4KBa@h1;<_0A*#qJy%XqS{1w6^4Rx3
zT#tML02t8I2nT+gspK9JLI@$GDLZ=fDCW(ZhXz`fvRQcf@+Afg7=V(J65P3S2mSi>
zQ+AhFLZJ|2$BspZ4jtg@>)T-G{q@&hv3vJ!+`D%V9XfPqu=BQLa*bYM5?-(Y5{ILT
zRkLiHOn?Lc-+%Kt)YZ5EfVih=66+}uLI@#*5XFm+k4IKk7R=4fVPRpR?CwbL^YcS!
zXec~9JR0=8bLPx}P$<OCojV)!ye*krBN*>9x7gQHM-6Pyg<|EQt)32Mjkjjsd!4>T
zMH~nrgb+d+(Cyo|0RSI;^bxpRu9ACGuCTBWKmGI*#*G_?K7IN$=(!CH3@~@@TpT!X
z054w9l#qrXw;<_ObRt{LPFGt4b0-avSJMsZ>v7g-(@F~fkoqcHq5uUUgb+dqQLO9N
zuLFR>s>an-SXdb1<KywwS6@LzMWw;d@95}=f`WnuP4jEX<Q63T85G67cCfQ#*B@$X
z$^yKh?0f%^XeIWB5JCtcq~%CYPe)2h3e?rr(Y0&is*HT*%o%8EYQo;$UMc4{F)_i%
zAAgKfr%q8x@CG24ASo;FJ>s6G0RYt1xNx+yl1H;jGj-GecI~9Z=NU+QlcVGw5kd$d
zgfxFKF)>I_Pe;Fg{a|Tn$!^cf%R^ydq0;)5o12RpH*R3iph3{n)2sE@=jG)|UGs@y
z806;W)~F3FEiG7BSm5Eqhv4yeweAC{9k~Qax9^vKqXt`ag|4=SJepM+bu}(N8*IkD
zzaIHiiM=6&5JCuP86G@%008LKs}~rC!SUnAv1-*SOqehMQ>ILTySqCwGBO&xU(cRB
z1CPhUlqpkcHBTxiC<x1zEyMWn<1uU2Ecp5PvHPxHzmA0q7h=MM30S>)HE!IvQEhv+
zwzd!og}8b1W?e3W)Ph`Q!(EMd%)Yj@>M4&VmF|=N#_W8gJF&_5X5uGG?hzq`5JE`v
zcKY;b0D!f%HI^+~hK?OOV#SIT(AL(*>({R_dh}>qyLJs%u3V|ph)!L_$HxNz)YQ~!
zbUec_*tv5j9zTAJRjXE^Lx&ECh={<~Uw@6fygZnin&SBJ<5;t14b;@suy*ZQOrAU$
zH*em=;K74sw)@E^W%r}W$;tJ<C{m?*2T4W6e8fC1ud*?GkZFCJY!p5lYzB2TF8HMa
z#63+zM)o^&FleRhZV^HVA%rwbZ{ECNM~My}K8(G4_u})<KWFzF8X98p;>FmuZ5u9J
zxPWiI`KDIwmzI`-%jMRo=)#>lcK`t0x^=73@xTB6J5p0qap=$?cI0XD<jF8LHpb@7
zn_*#Lfy0LnqeqV(SigQfE?l?(0C@QDVU<CWx_a4kkjIZ7%RGk2N4<lj@CPYund|{Q
zjT%M4hWz||96Wds9XfQtx8HtSr#7@S)iI!F7eqcx1pwTR<zecmf%5DoA%u`RN=r+_
zo;`c;^yyQSl$4;bun;aTE|@%dGIDZquzmY>JbwHb91aJns;Y2xb!DHxl7^L?osHeQ
zcOx<~5_~=%g@uJ!wQ3a{9UUPQ3h~P?zp&NJI2;a~ot>37F`g(_XlN+X)6>D>aIj&+
z28jSkOiQb*0`b$QHJb|Y<jE6+g@qv^A_D2@>Co2J#>XFjjGjGvV$!5ZHSXK%*RP?b
zriR|VdslmGT3Q;;o;{0Gr%qK$%~Mxb$IF*5F=x&k^ytw80MM#cD{#47*x1-$!h{J`
zwymkD2|YbM+`W6Z#(gJsQ|}-tH9ebsJ=jA2RY;18icnBcfcEX%S9zR3Ai(kC#}OGB
ziNeA{96x>>K0ZG6I`^R7UD+V%ZB9YG+9HGyA|FXfNpN*_g@c0wwr<@DH8nN-{PWLn
zaB#r6bLS8k7zk@?Yi!%L4M9Ocm_L6$o<4nw+qZ9{b?es3?tY8%=FJ-{U%nh8MvTDe
z)2E@Or3D`!AIzRT8#+2Vh>wp)K|ulh{r&O$`ExipIAHed*@%gWsqqtg(tL<h+U)G?
zFk{AyO8bREAtE9o0F;d?RV6z+8yhxkz}>rd@#U9a!pX@A`uh4PE-uECCr_|%-#+~O
z^UwI{r=Ku%=+G+L0?O_)H8nNSu3fuokNxA1KVWNXi?(gsN^H-|%R^31SuwDR!H|oK
z3%>Z`3v}<^9opL3Rkp3Ar3FJnLp*u%q}qOv`l)x}hV1<EN+SlXtNzB;#hp8MaNxj!
zYL8P<QNc$aeT3PwXJgHpHPFz|0K+i#I(NnNx{U01^=gX{LP-4;78b(8!vjuEPH=E=
zfQE(!R8>_mZQ3-bsj1<cZ@z(!jt=I|oeQB*2oDbrWM*a}KR+LQK4010Z&8FoA=a;7
zk8$J1VfpgqXx+Ls)YQ~4Wy%y77#LvDqD6>~j>d)!8_>FSYi!xF1&<y*LS9}Tva+(2
z-F>12!NI`*00##LsH#@JMJ*^OKxAYjfU-GDvLq)b!`|K=SFc{hsZ*!m?(U93g9f2T
zj~?jVyEi6Jo{XTNAXr;lW6YQ__~Va1s_mOdB!a4{DmWZYwa1PhKVE7kQ(Rme($mvn
zW@d(-J<I3ttE#HP!os5300}6Y6Q!%GTkUbA{^~uFR55r^#GIXyk`fdZ6;*p2hr_{;
zA!Q5Lrlh3QJ3s;?uO}<-eZAWwgb-3cr%s)Mk&zL`j2R=by|AzlB9RCM1qGNrdp3Zw
zzY8Nrjs(LnaCLR9_6cxSRu&8l43x4+WOEc06okUULd=^tPhz`3AOM%k#j97ZFk{9H
zXlRsG#O>IzBXo6jF?H%x^y$+_X1m43#o%(ewW=^i8ow7WULYwc2^<bbqV#t~QBhHN
z`}Qrmb?XLmb91T36c!fZ+i$-`LP7!}A|lYMS1+l@ak*UV+_@7kU%tfR#f#CcTQ`gz
zJz8e}YI9#{WhH$noX3wJgU{!~+}s=;I&`RUdljjusMIJ>BlTDBPnhfq!GnPU<|C=7
zsMPuomOKI^0BF-ni+!DyOF<GLgeX&KX(?{qx`pq*|Gv_`goFeX78YW_fC22B0WOz|
zy?gh9&*!s~oux@jOM{P(4{qPSjevjvdP*w?B9RFG{{Hy->#r;Ad-LWEGBY#LwryJs
zA3mJj?&;}?6)RStTeohNDu{_hBAh;b8rQF1M@B{l1OfrNckhl_vu0t~uwe?n9-?@6
z@7_grb~gI=?++s*BdNy(1qDGQ5@Gb{(a_h|mwL>;eftm=7KU}}*5RX%KC1GZDk>`2
zxN#%SojZrst5+jDJY44QzpAP#7>23WJ!Vi)5CCB8*s*nPLm&_+b-k#Tq~7UviXKT)
zCOzG<Ac<i_xEtb&*RNkIxkrQ$(sFS)9Q^mc|HXg-11jzN_uqd305&!@l>#DZ0n)2i
zudr;{GEAR79V=F>z_xAMkeZq*b+JcMdkn+C(a{kjM~<wt@6n@2C@n2TpFVxiv13Pe
zyQZclOifKI1xO_&C0M?EIf8?O;ppgy{rmT0@#4jZiHX6eQKPVV^Ja)dB1K;kQLxz9
zSTGEOzJ2>jE$#j8-8)>oco6_FapFX&574u+vT*R=LFnk{;H$5`s?m9S_wJ1;Q>Gw3
zJ|5@Jos)SSm&*m8&qrQfUJb8E5}(gUbaXTT)MyTrEF~o+$jZusrlw|{+aNVVK~fdO
z*Yi3d6p2wGu&}Veo;`aY5D1jqGeQVyc~n(ZVQg$%X|94uB*H)c`~#rsc?uQj>FHtS
z%$fM{#~-n8-#(a{Hjm{i8Ve4Gg9#HRNS$L58X5`!u(Y(S(V8;{4;}==FgSYjC`OGM
z1tTLPeDTE>2n-B_g@pw+Y}kN5|NK+#*FYMMKp?=iYu5mj&F7IOJUkpvo;*R9E?r=2
zYYU*PxYv;*M^IW?3ZQHu+LV+Ov~AlK=H}+OfB$}!=S@vbMOIc8o4R-V_HCKRYHMqw
zxVX5+RrNk}{rYvhdGiKlW@b`9Z_b}TU!%oj3kwVJ=FOWb%Y+m8sCT+u2ZL5@prnYk
zgfulZYrJrmyk%s+gMeRzw74q(fZW_%tX{nuzyJO_yuH0)V`HO~ei1?lDVLs}j)a5+
zXliQK_zA7Hwl@12{{H=Y8i{BiB_$<@iHQM#8vP9|DJg-UpC1ej4Uv|XCXt4vudk0K
zOO{~Ck|o%?cP~2^jWj)(nVD?0Hd*s|&YnFB0QmaruhFJW8vww~n>TUg$`#C=I~PD%
zkOY+deis!L!P(gv0|pF`SrFm&?b~p5b!CI3@bGZt=jThUf@y7SjX(eV6FeTT+Up4k
z3BmK{&oOi6Og4S*!Gj0j^ZDr2t5>D@ktHQ1IC}IbHf`EeZQBBY03wlyf}{q}Xo93O
zXU-rZBBIhnOdgMiw6ru77Z*!x7l}k@)v6U%uU@UN{PDbkB5>8U&~xOsNRPdQyv%d}
zWhE*{j2MC0vu9)H&Yjhkp(KP5qBv1eQS4lXu3alHMIjQ2s+`|S0aC+BNlC%er%$1)
zt1C5a@<T;MMR@b(4Z_32VQ+7b@4ov^Vt?=6y}{*j5f>Mys4kNRaP{g{<mKhT+S(eO
zI(4eFKRY`c*REZIy1F{P{PIh7``NQ+@$I+YvcKDznVA3pU0q#pxm@Js<-yzAyV~=M
zOLeEGr=zg2P->7Q4&KD0R<c~UZ~@b&PlrGtfU2r07A#l*fj|IXUta)_I^XK_>C-SW
zGD83U{j2Tkix)3swnOBr-a%5uVh!2#r~uctZCj}ym_nftB_$<NE8VE6smZNKgEYDC
z%Bt$=bu!1OQM+KIl8UWcx1yk+Y|W&TCr{$y#f#XuaU-0aovG3eA%rMFcz8G%hQY95
z!`Ou;#rS+awrtq~XJ_X+SCb<06B`?gf`S5ATU$%L$@}-;e_?27$bPT%^z^V`!2(>n
zb`76>_F1Lli;Iidho+?Idh+B67=}TgK7FKqFV)o4pslS9E|-hGeft6c0s{lVFpR{4
zv*L%=1qB5V2n6WRp#z+qouRL<U+I2PRaF)K{{CPX1{oO{003iSW0?=$jg5`bx^-*Z
zx^)XHSFV&<VeabHs}KkT=+dPNoBn&?zyb8{-ydmdX-G>;lQ{nN?c2C`@gjcy`R5uH
zD!Xvu0svsdh!NEuOX{cIclB*61WEN-OK8-nQBt>GyLJuQ+S-^iXHK2luB(dIW7w_@
z)-IaKuEXT#=LbMC1#jQJeNrc>5<&>6znq*L96EFe`uh5qKYu>BTrLCx0j^)a4ggXg
zw29|2$f|@z6emAFAF8UV5;vVUZ{7p|3>-L+E&VN4T3U(?8#ZA3_U&wtq@tpNb?er_
z)zww%gUH*rZ$l&!!OqT3aTh`qPW*Ers|0teR;}Rd?2MHwSHj1~2P!Hm2oDd(_U+px
zelGg;>j$7Lg;qyL2mb#4Xy3lQ%=1o|FafHns%)B@wY9a(Aj#0s5W|NL$Bi2|P+VLL
z9UbWvofj-vfWQC#8+LYfc<|r>&Ye4lw6rwr-@hN1FJH#erAx7S^Jetu(F4iJ$$0wo
zDgOK4|JG<^NGKE{DJcm?Mn*Lni6!+@@4^l3^~-;lDlRN5FMK{<X@wFhu8ky4BQ!EH
zg0HVHu3WjomYD_0Qt)hTZ83A^%t}uQ2qA>jpNEGB)~;QPl`B^wIXM|XS*l%ZY%Bnv
zTeof!$Cs9t;_%_aShQ%7(&o0dRR8?*4~7jJ277yZ_9=Z)Q4zwz!T?AQXm8xO0bN~P
ziA6TWqy<PB85uZs>=;_NZVeX~7dc-6X-F<EF4(neSCtj%7B60mD_5={CME`4E*D;2
zUg*)Ihr}^``}Rfe-o25Lk%5?)m?{G#0MOCVfrf?#9zJ{s0Bk`BX*e7XCQqJ>{QP|O
z=UAG70|z2JJRE)d_C-)o5c>A*i~aleLswT9)22;Bcz8I9i;Hpn`gK@ZTH@frgEH50
z`q0alFLC+uWqkG3S2BY%B0u#Gl8ic*Kb?z7cv0Wx<U;&(s=j{|AM#$YuMJvDPWl@?
zdNdw9c!2HOw@W;A@bmM7g@pxv`spXCf=37;awML2GGW35n3|d*KR+LP_wL1t6)OOg
zEz~GhTwII|8#dshk3On$fk>hlTeoh-!-o$M9UYDA>}&vKli9^fX?%EtC!Rav?Cf0Q
zg)-N!U5oVebnM^1U*_VYq-mHuc`|<Z;fHGP+eVBSfn&#xVd>JPQb&i|v}uDCD^{SS
zqy(o<ovP8fqobp7@#00;*w|pwq)AmCJ8jxD=<DmVDQ~iL>eLC#moLZ3lP57_#texx
zU}IxrY~8vQM~)o9#EBDYHLpG-Bm_dC5DpFwHU1h>cl8dEtow8ahf~%}JTIM{$D<4n
zA3ns*n>TUf$Pw`QeE9qO<Jz@rH7cq2p`v0w?*5y?zW>y+^2*L!E*ERpu0>*EqC{1l
zf`S6LySt-bzkaxS^=jQNrWXAC{Gg(u0(*OVna7x!nXwa>Ra8{ibU{K0X)0E(T#0Vo
zy1~-Y6288^Sh8dZ#*7(*pMU-tn>KC2fddDyfB$~?`1oMKf(0-zFo3J8tFpV@B8hJb
zU0q$#yLWHI#l^wL#|NiQokI8S-Esc>dG<jfkH^FE<;yW{+&BywGNeZBZ{NNhXU?3#
zAAkIzlyrR3cr9AA2=nL9hnJTZo5m+gNl6J-ty+b4?b>1g{{7XiJ=DH^d#qTo0=~Y!
z><DQ?5eNi0bm$Q5?d|dL#~(N7xm&7w2T5&OX<=~hvT8y?p$NC46YJfn57o3d!<#p6
z@b>Ln3>Yu~K|w)Sx^yYty?ck$)YMv^GxA|7_@!kZ;O5;rR9Usp(9jSkPMkn!Xec|O
z5GZ@9IcCflg{I)CsHkA(%$e05V`gT?t`zO*>4}*$XHuX<2x(Hj`syoOy?Pa$J9kEL
zaWUN8-7#<8JOIFk4IAL=>kADH4RE<!czAeV&6+h-P)A9&ZrzG;<Hq65n>TQAalz)z
zo3VE7TG-jy!QbB>nVFgR_S<jq!w)~e)zuXfCr+$XxlWcnd-lM`#|Hrc0TdvSO2nyn
zvuDr7S6_XFkdP3m$EByI!_m<Z&!0a>KtMo^=lHBzwF<hrx;3hrCr^Qafq3}vA+~Sd
z-k|4g$y69Ql!rTeB?dpAC|d;VQ%iGruAEZuj)?^Y1tBUb3hURems^`PvFX4i1mAfC
z0Ql}p8_b(rv$Zz_0s;2#-;Yh3HX%1Rm))+bs|ybg54gCv$nB4|y}dm`LPEeW49v{T
zU}k29;NW11V|MJ=0XH|dN`a=CnHc~eDJe-VeIbO9rt00hcd)Xu0>dzfjEsbyo}RM1
z)GYA%d^~#e2qh&Y=-s=w#Q$qyVIdL{5+D+Z(6eXH8vmakJa`aCjvT?^!-v^P`XZ4C
z*REZ|m@#7%avk+`^ypE{n>SCP)p$u|LZJ}9|Nc9Ce0*SLW`+q9CZK1}o_PQMJuY6n
zi0J5On3$Mg<Hn7Z<}+63?Afz$c6LTsSQvXhrAWoa#TYVV2)_8@3vAxJS>fj+W#keh
zWn{m@<W&a%0P1R71pl@STAJ$h?wqm+g(6H`;l-v7`gtxu_f7`2YUB0m*I2V=4Njgs
zDY3nG@7~zAZ=c+A<Yfg(vbHZ>x)k2t-t?hO2x;*O3kxxL@L(_ugXrjJg{{3u>gVLi
zlkoTVhqt%4L?y6-f&xsNHVv0AUshu8WTPNSxk^e(aQX6OynXu?91e%gsu?wE6uNis
zUgvgKuU?J#_;>^b1u1;QdfBpNc=+%kf`Wo7EptE=r{3vyKw0It0X@q;u=u3{oVj{m
z9?dGvrO<dbKr-s6U+Vw~P;LrdMLZr4CMG78wu>vmR8^sc5JH+Wkw^rgP>8IoEWCgJ
z9)*R4$j;7&P$+~@C{%X$NCkiW^%qW^I)!c9wn0lv3vb@MK}JRf-n@B(fPes6CyB_U
zp`n2<zW4(3=g-Ht-+qg^bLV2-ym|EskbtsGop$Zo!NbEtPCb?G#EBD#jEuyoQ>Q3E
zYG85+k^ta~&-$^iPh5;ZL1Br!nr=}1QUMN~D-RqT#tyDmdp0&UxPSjXcJJPeHf`Fl
z+m&4fueL+Wgb>o4<mBYQ(a{m3Mva24tu0=@e2JGYU&7Yb7N39qd819;YKg8~xq|P$
z`wsv7^ABuoZDDF^ie9~XvHun<SRnObAR&sRrltlTA0MQprQz3Ke^tmi!otGf>+1`D
ze}8o8(nTTXAhOAAd~m{uzVHu;M&k1f6cm===>Nju>^M?h%{Q3i7bDp9k&HU(W9q1Z
z^=^~P<zm&URd954lt{r7SHU}W?3hAQ@CYG<NT;u_kJG15E4v${8u|J8aB*=#R#p~(
zvbC0^F*mPVftC<O)6vnXajEgTu(7d0U|^ua+9y?$+ei`sEdA<J_Vt-7_wgz-PoB*y
zT<*If_=iNZ@4x%fhAnR{4|Pew+p%MZMCoo76%}?7MS1AlxwG8bB7_h^<f(P*)`*LX
zW9N~``d8D+c!UsAQ*sTGhV(baV2iSH;QUen_MEEy`b5gK-|r@yCTQNR1I7&Lt&sCn
zmx8xt%N7(D7Xv6;W8%X<2DM2mFf}!m8dTl7bqfF}MS&1P2qA=!56Cr00w9rMcPly(
zJ^{DoeF}x}4~fR5(0KO!s#&8HdOmRqUP3}brG;qMuV0UT{rXj^NLLqQ$Bvb{M!@CE
zmtkjTSMT--A%qY@2x)HQ9wb>98%nGx^n1V^T)F#L-lvhP+p#?C^SjBupE_zFJ0hlN
z6;tpA4lJMll$4Z&apT5e>eQ)t_Uu`m+jnts0Z>-*TWrUU9pLeJ`0>Xd>)b9Ogb+dq
zA<dQCgCwAAF3+cy<&!A491cQ!Qo15eRd2~@nON_25kjE|0ASsxJARn+d4u=E#>NJb
zk&*EB_LfM&JAeLsr4&3ddwY9!o)VA8Lr6#n`(9ky+r-2KJRT3;-rnp!H#ax%cs$tH
z*fi)h5<&<egb>mc$Yn8EX^M*ZSoq&lNKVTH0JPQ9!Orie!NS;35vQw@<g`qz@H{P1
z&F;viIndSCP-?$2Gc)1t?hYRxABpW|W@gy8Zy)UK?UmFsLI@#*)CMgkOGwkCupkKl
zUS;NC(WX;u5Td224)^(X3M+_E8@F2T*<SzvAOJ~3K~!UTSnqWaMa6soWqmucX-=IM
zj#ZSqckg2P^5uw%ijvqqWy%!n-o2Y$5S9=^>MAWQO(|=&5z<neJ$n{w)~rEFN{X_(
zLP(3Isi_G=!<rA)C^Sd{fVih=@Ywf1Hc$e91yhG%;nd-ZJZ+WyL!z<I?<SjKr=_Wm
z-7a5ZKu;s3^+^_iKmZ>fAGo`_BR4mf-L9#r2@eksxVX4LQ&UrkJtTxQWyZ$F^_urc
z2qA<t1tUj}#Ely@ue`1BAPFcNQF8g^FE;fK07hB&!uQ{Nj<$L_iatFn_gxY8``whN
zVrSG*AG^Mv)~H61q@ff%LWm;Vy?eLPd`Civ`~(LF!_(8VRySva5czA<rj10AwCXfS
zkOY*?QCjbH5w~M`>^5~ZF6K=97>;&U3Y`bUFBRbU#R&L^M6>H40cAxRwk@Bm^f^ei
zK`D5I5JE`PL35G_X_^`=NCE(%P=rJ0!f^azgv9nXt+X(A(ojqvJqR3*{0i;~g(6%E
zjmM#LVG`+nKv|jZALe{6*Yh<LO2H$95JH*;3X%wEni@1n5{pTAfkWrQ5cf1qV!M{6
zIzAh0hG7FuVKdMKTAJ#$Zo8<MkI09qxDojjcORr6_g#_1e)Db}uxi$*23rS7kthX^
z5JCuP+$cyQq-j!0kR*01IuTx{Zz1(ncBOslYFrGq=!*X4UC_ax6*?HSLYr1v(9_jI
z2ZL6~$bN^sf+FO;D?&#0J7nd($3xyL-2FEN{L;#mnv6Q?<GU|y8bxJ2d6SibXK!zh
zef##o%*;$lJtKq=LRvNok_c&<lo})fWhrsNcOK!-ph$_r4)S8uQ6COt2V?4}flV^C
zuBNI=!E<qOfrp0&rQi`l2q6uOf+RwkCZz{S6{Wq&!Iis@5%J(zrBuAyFz?m@w$?o{
z>f>IGzG|JkiBs^79z80t_DPQ(J+OQCZcLdnMTxy5gb+en77CKe6&Dxdz<~p>va*7W
zjg7LqBNw^3x!AO66WrX~YPALrY5W>hkW^7d_B-5)PDFNoA)8K@mHQrf1!d`V9SmAQ
zPge_VT4}NAcm}Pt@u{UbIvBK4cK4MoDk=)gmoLZNyLTnFQwkm-gb>njC`bYd3JS1i
z&mR2t+ix&5G{li3M`~4yxiNeF`ZX3UT7;`tuVTrPB@`?*Ck$!U4j(?uv}@On0l@y#
z)YN2t{P9PosHjNU-6Mn$x#976jFXcSqpz>ee%@JGSuqC=98h-GhzyyTnT)5WCu3@A
z%6`vGO--3~>(()unVHJ&o?IL`a)fEgw_ESty<==_Y#3c#UFPuN!%S&uX@mD6Ha3>A
zva(`4Jw0o5ytJQ7J3Bk((xpo>zvjk`8;qHm8DnT@$h>;>N?u)WFm<`+=C0-b*0vxy
zIXTRdB}*7Cmn#u0_2|)q2?z*KcJ~M&q~0!Fy2J)Y`uh5eot+(HWo5;F-Z?lpD7%Z~
z13VtD(hZrNot;Fm)Eok(mK-FNmX<OTCr)IzTrLw76x8777vK1cf2L{@BxPo1vY#DJ
zPEJf{Xei_B>&t$=tXsEE=GUgAq%iH;wPSks?#;Y?`&OQpqEPj@=H{$r{?@iok&%(i
zkRd}P0wn;9y}dn?n3$;S?h!&ron&TavVY8-oSY=~UAlCsRyRnb;fMnwD=RCBU??^=
zmJOcl?Cg}-L-}aQLDJm0a~S~4=FOWM{M@0Tp%OuOO+N$Hty?Gcvm`V$lx-(8G*sr-
z2L%N&02mt^8>Nhz)kS@;xw&eYzqKtKrQi`lniKJpVk;{vsr$t@0H&s<4cs##OU0Wn
zX`@9IgIgYtr-UBLPfHDwQc_YFE|<&n?%lgV&zqT<$*fzqj?vfGXFNSUYxSUn$KzG`
zb0;2cscvN2(b16s&?K^T<aN!>QS+^dO=McQa3K;C6R~8;5^%X(0A&?twrtq~3kwUJ
zKYw1yJtTyXnmcsp5P-7JHfhF<8wUX3@pwp1PHwP%5!wFy^G^VPgM$OwwryK!|M>Ca
z+1K~(-D|LZ5&8M;x8EQT2rzy6^aed|US1xeqoWZO6$MvUSBamc>Rh>U1pr`bY6=q*
zlS=z%%$NZH@b~veR#ukGb{rfW000LM9;{8*C1hn~Vd>JPFfcHHii!#x9UbB4=U3&|
z`1$$O`ZG>m*W4UYkkmr8Y10PY-rfig566%pL)h)lo;}0VsZ%j-+&Cm9B`L9ogb-3Q
zJRT1K(5FuysrxII8ct77Z;(Ebs)=vp1`i%A^B6ljI{?7*=g%9YPeeNL&AOSH8B|nM
z*c<l1z(CmB+rz`dqte$D7Z=0F#|Ho~VZww4?XQW634()zrQYyYCm<jI0AyAG9yV+k
z`#K>ZL1sJl_V&=#)kSb{FdjdCT<d;_+wk`GMovx+fU+QE=FFL}x3`xX2*t(4Vdl)4
zwSK4|uWN3OC`fAItgNgM9v+UvhYzD&yLRmM;NW2N>(>wK*RMxGL4gu`NC+Xag@uK&
zuPrPrsy+VBojZ!`4ymD#kPrYs-@bjTJ@)$b>x%9Uks&TF4(8_OxP19C_U_#ahGCGI
znF*jQ_z4LKLAP$*Dt+Dg^XHM9n~Qes+DSZ!ZS2Gkhb=8Ft3CGN!-q2WX=-Z1-rgPn
zsvZ52X2*^l;PH6y_4NhAFyQfcaB^}2Q1-iHWo3mOJ9e<aQea>pY;A2}Wn~3NN5@*7
zOJ3L998r)&092oXSC?OMLI`O{($coX#G?|VacSMUwak5^MvZE~o{$g4#l^wa))oK|
z5fQ<rt+j327S7Jj>~YdYaMRM#0LUJlXspDe(t3J&QulZ6+?joymzP&%TjFa^O--#;
zAF{Ht;O6FrlP6EI0gs7^3B0_#5E~l{D=RDH<mAB3%?+lerchB)VMpuy{rzioE<nE5
z+}u!*L|C#?@Y2%KFmvWij2Sbg&cnup5JCuPIu<Tmh@6}pczJnM`2eC~I;+^rmoEW8
zB15G)s7(r=`2XzLvuCwBN87e-;p^)wbuQI_0Rs>j83|usUszdLvD=-ToDdZiRi_lg
z>L{Ykrh<YbQi(VP@5qrO601gEy?Pb>`t^gmyE~=e5kd$d%~W7uAflq8U}|bAHGNB*
zwp#H<y&~~QQcZ#+@jR!x{;QaB+n9*2UHpGh8`Y)EIXXHbGBOfOS(R#dd3m+yU`A0W
zNFp-LojVr^2?<!WY89J;ClCnm(@#H93LYV((W$EPl6W$+tdtU>9QpbAGWW&A!~iJE
zav%-s`0?Wa%B!?}Nc_DSJ9ezp{o;8`-Me>JK<}D{9zA*hs9TT(G+cE%A{zxsq)Kht
zw88G(yK(>ieTgA;O2H$9GzJy(<*TZ^B(4x8s{$TrSf-|?0D$=Tc$vrK=H>#Zx&j_i
zjLVlV0|15(A717De*OAM-7kKyT9cB|;?a=0{*#vOS6{MH<SLF@RabOG94OW$$j{2k
zYOv~dV)D4==7xeKQX_r)_C;uDC{CO>K`D6EDJ_DK7Yaf2pC}Fe4W+@G!2fF%N>0o|
zv9}#cPRs)TuT>}w-h|Rydm)Ja6T+mMV2WGTgh)c<!NkM_`uh3+WLI8_i;H7l*Q5d-
zQ9N;)mUu)$8u86uOS>^sw&dhw_QqUVVGTb&KX$*Y-zOs@BLL-rLQ^3w@KTe}m@Zwq
zRJmV#?c)E7+W6&{UmC2sojk9(x#23i1F{qq^AY|a1*z%T$j&cBM)o^o=e<Wp_B&)`
zze5LuR_I{R3I=*QXsf4#_WHUo>ZlLvKHbr#m6o!*-)zmEJsT4zPQ<27o3MZXeh35t
zHU;nG$&=W*b7!r8L7M}nFbAU4yAUS*15x_FfJi9&*n&(j1ycTSsB)m%xj#6@!=Tz@
z7*uqd*MwI>6lLt#vGDizM?gRT7B600X}@?uM_CJ(l7?q%YYTsWe_XzN8Ch9bmA)_H
z8*zPo{aP&sO6sqwwZz0JU}6IX43K)9IL+?$>(}z_oPvqx^~f5H5kH90*VmVM?PB6<
zuWgW&oSckp+qU7-rAzG3zPP&G;>C-xaN$BkMMc5Q%?)mDZtU0T>+9F4x}7|)xw&an
zBS~3#@A1Ez|6+ybX^e5&2akRK!=ZCwIC~`qx1tjfpOlV_>~{cwjO=%aPfEwF=tKlu
zkHw*LVc6jHHzuy|!V1sRIC~|AJ(kE9rQnqlrrZJl{0}HO=7`dpdmu`?UuA$)C6N%K
zwEHLx{jF@Y>HH56KE5p94inN0iOUg(goIRD;oi^B58mG162}qcn?8Ly^!4?Tlaqt>
z>(@)9WyQtCu{Yvt*REAo7l{<JX3b(BgjQ8nUmO_Jbv}-=Oq@6oKv{Zj#Sv(+8#itM
zsJ^fQP+sA$wn37KiHSsjRFNX8+sX5qn;R8|VHjn1;#PDb{tSvj+*A4gG7acygfBkp
zhY2HSxL#3Co;-;)Yt~3SG2(K$aB*>ghldArb#;~4JH-&C{|mw0KOlM|eGY_br@m0_
z+#f31`hZS5sA%g$MW;Pfbla7UB)xwNrZ5M1pIJ5vmHuy8TT%in)pn-felj1b-K19$
zB7^`Q9v;}XZ5x2H`7UN=W=Kj(V%Gri_4RF$f8-mpz`#IueHVRweSG}!$H>acLR3@~
zfU+AuFE1};c2O>l9zBYA^X8!u+-}vFii!$=ve8#@F@U8@m%_xv1U-86fSa2e)~#EI
zty{NB{rcG0SPU982mtWn#fv(noXL~;dOSTn;p*yI<+0Y*)`*IVVy|5+E-nrO2M&b3
zzJ84Y5_5BNBqb%`#EBD_J$rWjFG7Ljb<NF<QiG(JgctBWa|`iF(uZ~j^fba?i>@$e
zt<9#^iPP-FX?NljyzKl!#3Z~xJTDzWp{P<@=G{7A=~tg(NPlBRUsj8ho0}_<f+uEV
zWYnxu@I;wB2<{z&C^bTI2S**MUHXG#VguFgL&}1qT4IXxAWFFdQR+PipGN^gzQlgj
z&i%n1wg{^2d)DU?2x+zg0|T*l?_Pw2ga9bJ@g6&NES#O46*9S-)L&d&9JX)Yj?0%X
zv-4c+?Cdai?%ZbcccUo=NlTY5Wk+DetgNgM92|^Uvt}VAB&6C04<km5Kv-B94j(>@
zg$oxdy30}}Cnsaqu3hZ4n3|em@7}#trf`ZE(ap)pfrEnsoSmJKmX?MefBcc1Csf_f
zrZ`A6G&Dp?N(wYJHRXC;@+OaKZjO`^Bqcu2z`?U&xE;%r*siX|#bArBu(j%m;e$-k
zR!^taZRfr#!ma2;+>T4e-G5WSFBM4aA8gST&W<BtVQeU)1yUdJ@$qnSa;mg$!RXPW
zv3vLKCOrXH5d9|v_l`+!)X)XD-xP5APlbwx97oJbiy(;q9|ZSL10|9LF}RjrgZuHf
z@;etHgb;;kia}CVRu+~mTLyoBf9UJ$!^z1B-+%u-+O};A0|Nu(<m4bWHnz$+Dre80
z#f%v<FnaW8T)A?k0ecVF+uO4bOR6I4dm;|5D$b1?J9aGG-Q8<6FK7Mw_1Lmy3)Ze(
zi|yOD*Si18P~U5Ajv72jI&vW#ht5gfK<jF2z`@QEj&@ei)z*;Pxr&PUICJ$rPF##Y
zL1Br+zIl^};=3>D$)cjjO2Kn>cE-ky8=Ka;7eYQtZ|;Hc>9z80svK}WngFil*L4~-
zswt+V0Kynw2p;@TVq}S9JPc}|y8>!dq=XPc8ndPpB#GyO$x3sqn0}R=on2*H0)YU=
z#>U9Z%tUy2I0g<JDEIz0Mz3GLM!$ajkei!}l#~>ury7#FYp}u%{89ln9k?VBAaOXV
zm_BAO{5%(6;nd-B4UhmpOH&=+O#B1^zbwYA@zzjRD=+4E<U%;yem#$(Vty4Zkh+>Z
zd$!btX!q>d0}BfaoIH6_$vvzYrZ5Nm3$79Yl4|!)pyB8PwGqn{8Xy6HiiR$@Ll;3~
zrVlvA!`SV@lshQ-YZaJxZxnidLI@!(!;T$0;O*_rmeiN#^y$+8YBq_V%jLq?*B4wa
z7c*weXc5bV2m}JmnKK8OnVC3p<Ol^wO<aQnNm+UCv243Pg6}+Hw+$a?3csJ`<A*t)
z*D0;8HgvT$;OsaOexCF3siir){Z@1$7XJ4XUS-nyG>Raug7@IT1B@O$n%(~T^=r(T
zGY2C^jHq%UL1kmIpMihQS)w=txBpbA+i!%5Ugs*lQvOt0b%dJzMsTglCx0^8&%pm{
zB}A_p@Bbkogpj7;`t|DofN|r-N!_27mBr5OkydJ78XFrM`1<<d*|TSuH*X$_i;Lyc
z*+y#p`t`Va^(uDn-reYnHIV8lJV;7T%f$SRCnSn9IM`XjbLA8mbyVzA_z!hzrw7lK
zQ?Oua`4jo%v`j48bV?zW^+=iCy?f)zl`HV|^_6(45*8MQL4yWi_3G8^%Ib{;Q<ww(
zC6Ds;j8r*L8@USH;Y$Ejj?((YwVqR!X2(%y`&oK<3ymldLI{zI{QP{W+t;sOkDQzw
ztXsFPR&!J)PMio|Ute6kdKDHH782Fdnv1BYC=4As6npmU!N!dnv1-*SWp|0lfkK0%
zti1PFz3VKyUJ-|*3itVTST$=DI2`3I(X?>taBN&Mfla^5%6kuwegC5oB?WVIbVNcz
z0@kiw+qhHkgnX0+Zz>OvG<2c<#ZTZ^NPoK4&^SFmhx+6lY^onqm;-*`2B5S^$vq>4
z5YkkwSg`^CuyNx?iQ-FfadB{TbcDCJH=LZDWS0G|%Jk{e@#4h`tX#Pgt5>gXJb&-y
z;Muchu(h?tkRd~ml9Gb|{O3Q)?h=s`g%xh#mkO|KyFWXEq^qp~&y`a#*rKZ<PFE-K
zN$FVo>v?45y$1l87`21XhFQ?kR9AA(n!m@7A7lCQ<+ytFs>F618yk3gdn>gHUg@<R
z<#Ui!IZ*%NC#ZJrueAQiB6|B2{0pvZaHQJ(6R6v7RO(0<A%qY~O{s80SXdbL@82&`
zl3iTo?3-`Csj_r-O%)dxqqw-ZX%%p)#_QLwVQ5HIlbaib1xcF@Tw>=SaX6~j>-trr
z3XsGSQeI=(c7L{j!|;Ko@LV}XsUux2iJzYz)~s10u`0JRtKfZD=38y#szx({B#kiX
zCQ7fAmlx#@asYS8d?ogX5JE^rO({qsgp^ZAByi+HxI~c#*Kfx($^Z!fEQ}4|KHrXg
ze>;{}sYE$ZoW_)bCtfI4jN5-|qYjV&fMYgNqL_o=zCT3i|0=OZgb+dqAx)p$gQUdg
z84^K;gPkQNjck0WN)?S6(p#dK!|{s|h)H;%#2&RQy1Kg9zJ0sWtKd}(kW{;W0`Aa7
z3O}bjaINQnV>*I;UunTx(kT7$#~%m?2#`x#si~=Ob90k9;hGRa2qCp2_aN!u+42Bs
z_&`%EcN{72Qz*p3slzeKx)=LiS))nG$;nVrQIYs3s}hX8y}iV7J9g}7;NHrYGOOT;
z(*K1hHKOc|DhFyxu3}ePT$^QV#XHffcnDMOD7i<Ci+FYTd-v`kEG!I}nVCxM&(57Y
z5g8c?dwYAiwAa0RcMKjp7)zHfZ4qmc5JCtciYC_}DJJ0sZpZQfl+8n0HOsb1&F%UA
zo6p&bcX3bCa4R~o!TT_F>{x_`hJs-jFbo4HCnwCDIkQrrWM*cDq@*PFIA331xVgDC
z`9KM%J_XOm$4Bnx6x{uTea-o3LW8e^R9`CE`rr<n&b}Ai{R0pQmDr=kWzU{HaBy&d
zjg1XPj2MB0goNt9NI@=KxPZXGK<wDD16o>Ia%<PY!2uQ)7FfG>t=!rqgb+enD!E25
z-e+#HucwY0*x>6R)mK|R9n2bU&A#_KeG5XNs6qRXl#~P;8=LYzczFRRoA@c_=jR6=
zkB7^bFSFYm9UWn3X9qVow+8F0B2|@ww`kEK3>`WYQBhIVwi6s2jM&)NDvuGS+$mo$
zRznwD%dhLzcV*!W_!26bdH?_>_eFVyJ_1))S6se)89jUUM7wtF(6eVxrS#+N+qYP^
zZXMRIUyoL;TFJfr6)RRCGBOh9&!3lj+k_B8NJ}EOAn8_gqC~mxxs!&-tLX;y^*C#^
zX;t=gH}zGvL;(tAF*P-ncz^WhQJ9*V!o<WxV*993qX3kp>@^n^Q}BB9=)rEkd-pDe
z4jl?7CnuRHct8F06UL1jhoM7<O04<tAz|D(_BFTP6n6cgrbb0W7aYr(?0ew@x=|L>
z(b0jXrY2HTQ(<XoiT3T=E2SUXw{M4;nHl@LDsQb?wSu#=Gu++X@&5gLg`9&BLI`OI
z<Q63T8C3pM-@(ojZS{2I)pUa@3-E@r@BKrfmDrmyJRVOXAWBL~f|;3FrQ^DF>jnV0
zckf<<^{t_ZQ}BNL@keNCY62)r!8>r^0L;zJrKaGCZxV}(i{b9>F11~zFbASn|6de>
zqYh60sfxLP2Ey$#0Z=Oo@<o|EFnQ@p?os0r6%~bof&vU0GzhAy4W9=5{P}a7IB^2Y
zmMv50d8SO60zRLQKmYtwq30olkh+SEjaBN1w?H7k{{8z=TwJWQK9I&wE_Vu9dG8VT
zv}~Olbu}&=?X2X{tkO&!HGo}EHt~4|(%$4KtuNv^MqhtjeF|8`Vh7EUrluw~Z{Cat
z4<1NNc+bqtl$wIKV8H@5pb85M!`ZWEE43*~z01B<?b07A8oCO+f(F1*2gkU)Qll_A
zREeEwT<+d2`(A(k`R7VG|Cuvqpr@yYVZ(-1e{enM>gr<5m@)YM_uo-kTB^`<5kg39
z+`M@cQ>RYF(4j-|`0-<<^&>Yo7srkrgR!wO{_~&zD6A+HY1-rxB;CHxV_y%p=n7qJ
z4S6)HH0o+xd^Wgzq~?0$Q>FAHIXM|_Zf<aLa*~**)Y6%mnIR}B2mt{BRi@ze=+OhK
zR;^<9ySuwXAP`8jB~1E<ea$gx9{<OxT`k$yqSWR$s#q67p%9^=p)fEoP|AEHfk1%2
z{`w2n*4EI~Rcs)xqN0KsGiD$rCI(4KNeVp|A%xV_o;`bDYikQGmx~7v9w@cQOuKgN
z5E&VXojZ5p*s)_6I&>&rzkaQ>{*cB=E<w`Oi1McawpPlS5G`+?^fzW---%Vu93N9t
zQ<$2Xvc(%}s=1FSiA|X@rP>rcH#ax5Yu64yS(@U30|&|*C@qp$cvZD~)0{{5A&&7d
ziE`jffpW`THwL-6xwwD-K6>@)g>K!t;o-xF`0cmfuzB-l+_|Ipa_Q;m>4=Su#k6VD
zYIJ;JVj}kK+lOC&{T0ujKWDec#Kd6p=FK>F?p&3nzKxBIp{}lu8#iv$yYEd&a&j`3
zE?o)(0|Rzx1Z!(+96WeX*<B;mNKQ^>m$h(obX0bCh@71~c@nEvuZE+eBhH*TBX!Ea
zhvMSmU~O$(<Ep(`Sy|YzV+YL4%-G+5dwY8X1_sLfn%T2w<I0sQNJ~q@xN+lX2?YRw
zfq^hEFsO1acS}+4AgQRBkC?~h3$G3zWLm}1O~+@0%_Pc!XJo%?(DREwK%_kh7MK72
zkoab=bLXa2zPdgtrr?Q#A)q`3Z``<Xm^g7FyM5E9P3*9`@OczlCR?>r-zHnIp%OJM
zsCMeZzGc^cYUEb0UJVr$6$~9ZlueD3m$0xf<mcyO*sx*PwQCp7oH>IoUAn-`%naXr
z^9|hG+`ur5T+dn2lP6D5SXju;8?4HyQ>WnN<%O<YyFy1t2V=&JVbete0s_#dPam8;
zdlp}Q`6b@Hlm5BXy?b}`>eUMo5l!QJFAsr%fv~c&g15If0Km@94pvrHh>D8Bk|j&%
z#=8+ac<>;stgH|c5&{5}`qa!^ym%4w=FNkdnHdfrK3whb;$Uasz=1WYVk`a{dwYAh
zxw)}RsrdT(;@-V`m@r`iJUl#PeyzA)v9YljH*Q>|jFXlkIXM}Qj*gfxVFGe;lsC<!
zQDN%o+P%ljkU2Y;A#-*xi#PvS-{u;X<v;ne*Y?-7`wezpJ3BiD0K?<)r0)0h^pv{a
z&d!c8H8pLBE;dSBE|&pN?Y|#?{E=Z8hAE9Y#T0psWs1DUGNlnmmE3#zYKqs^rcE1(
z@6*DC3z=81Udg5HEnBuQ0GI&-1~9?F!4msCJv|v!RaNHU!-q9$tEi}m$<NQP)%mw=
z+s3G?t22)tJ*x7!^XJbq>(;Gf_<TOYFbpFSiI}lt$1>*T=FG~KD;c3s$lSSehfz~g
zV^mdDnFkLZNNq<X5;4Pv4`+rCA6~0|HdUFKnT)=^J_CSpa&nT`cj?k4_Gik|(^E-3
zB+~GBJofLMzP>(VWo5+xVC?Mdl-)JCI&$O)BZu3qCTrlpfeZj9JUqPGV?#qj8B<eJ
ziN6Ik`Mq7YZk^QM|IpA-ww=(>&??)QK7Bd^fC&f)sP=r#&4B|4*w4_K{(rRu^&Uw|
zP0wau54Px9-{!zD4E+53uyEl*eER99Sg~RSUcP(@kw}Dt2M=P>q)C`QeL8%6e8A`P
z>wUhe4C-BeJ#TXwW(aoa(xnIq2|;LRXr&V0Vy>>P?6G2getrlE3Bi^vTN<RFjnU@K
zn`?C3u3fv3mX-#lu>46$vl&JDe=0iVqiW3irjc&9dGls=@n8V(@$rF$g#~u)+Ewo-
zd*XD9l`B`m&dyF^pSHF(L?RK=($cDI<Jz@r*tTsOR<2x$l`B`m-Q69#ckf0<Mn<*g
zPft%r$BrGV9Occ)$w5Fs09;&Lpr)qAZr9MzKvGf?CQqIWRaI4}tE<D@+#IV{uSW0Q
zy=As%XlRI-n3!t&)*Sr)`|rrf$$^!XRi*Ug@#Dv1-MV!EfJ284DWiKt2JzoJCnqN)
zCMIIWj2X)A5|NK&2^;_bAOJ~3K~%G_urS2N#=^|Z3`2&<PHE4|%7TZ72PRFLgzvul
z4wo)ns_{9JlasM++cp4zi;IiIJ{ubwSXq@76WhOkf0gabnl%dm@Y`>{)%e^^ojA>P
z=gyt*^74YGr>C;J)Tq=uNXpJHWM3P!)~;`J`1$9bk&=>vUAuPS#*G`u&CSL9`SY=T
z`*x_StHa;lANu<GShQ#n;^N}!eZH!6FeqQ_u_4m!l9Q9!RFM%QMzA@x;(vaAe(bRf
z!yqIigxxoD=1hc!hPK$0lFZCZ7#SI1<Hn6JH#e{H*y7@1tY5z#s2Ds{2r8Nb72Wc6
zfSAJUDvoSCoSmI<|Nec9966HRmYbW4HEY(OU%!61di83Z+I{ij1s*?s3`<K(%$YN%
z(*7GaZa`gKU1k9D_U&6ZIyz$S-o5zjv(K<|=T7|g+izI0Vg&$T!h{L%_xG=|52dB0
z(ACw2j*jf55u&4`@yREjKwrN+U@s{tL0VcG3=9k~XwV=4fTg7+Vq#*jYu7G`pz=eV
zJ9kD=QBjrsYA(dV&%%WZrS2a$ZXAHJ<rJFJI&w|j)TvVu8X5{OFE6xh+g91#Aqw#8
zufGC7wf81@d3lJAjz&~e6kJ_hF@F5`8lU6Jl`8-sb^S;HZ1C;x?~kmkESc@t+uK7|
zR~J{WUPXL-e2veq2yt<7aCCHpii!#h3=FVz>C$TF2pv3lu*&O`=H9(~u(Y&9L_`D}
z9UT>3eYL5ncaT&uc&Hdu)Wx-H*N~Hw19x|Kv}w}@91aJgMvcPd%a;)q6@_{8<{>L9
z3#U$<f|iyRw6*IWlvSnT^<?EKeqlxv6B95DBlF*fA2J{AZ^;$#Y;A2ZXU-gK+O!FY
ziHX%7fAZu>6ud1TIcRPpNziOv{<^T~<QDhs+ZQ)(+^Dp8@Z-miF=osdOr1Iv&z?Q2
zRhthVK16nQHpY$}TPdh0C@8@F`}bjFWF$4X&d$!p#EBD;ot+JTe}4=gJ{+xEw}zIM
z7CLq6gw?B8WAo<CShQ%7)U~?AL?RLUKtq<#KKl&cefOQjw$#*A#K*^D%$PCI)6-+O
zYiLwoLA0uXthwRw$||h(>C;E*{)(TC>FKm~SYxqx@!}T!cdMz{v113Ut*s@BqWJmw
z!NbD?*4EaQj?c`@WY<EPJb7}JZJU^wAUHT!W(G}F0s;a6KxQ$BiZ}iV2?;XW(bUw$
zlqpjH0LP9Ut93u*B{?}6wzjtH!?&EA9C&+sW5kFN@bK`E8VDUcco0jLEJ0pgUaijM
z=;(;8Tes3f3K?WShOD9N3c-UxJr<A^2n6u+^Q*Mzr#J=X%P+qK0Ceiq35O3KMu!d^
z@X<#fNp0)iy?fyE`St$rZPTi3QBDEB2&t*5Ro<LsW@gHzD$48EujR71Sz20Jy;GEg
zLSeNjNHtMhTr8K;ngs;~$jq#qI>s;zUcP);tF{CJ0p7n&g_c&?O{<Dd`)a<TX;INE
zzoCBh><LC18&`33<0S3(;QaaX2o4U0i;D|9JUrN{hE=(B>lT2r5tt9f#Khp)vu9Yi
zaG}(|W9!zfh>MHEqeqWqp3C0e9`onV#}7aJfX_brOlq*DqM}l5VTg(;c4D!yu_!Gq
z#o)n%s|>KDQFJ<TV^Q(xs)dC`wa4GNbBAus38@8fQ3M{3hwa<9BRDu1ZQHiRjvYHN
zbLLC{fP;fWrLU`aA5v9naD9mjSxNhh|IovS53BtBH#IetXj2)ME?o*!Q&a5Ty&E<*
zHV6v~!<H>u5E2rCZQHiN-`^iwwrs(eF=GG#XV0F+k|j&9Zr!>%1(`&)dIw4J8c7lg
zg_t#KR;6#Sc*s-yB!I)=uz8~uJ$m#AK|w)CPfy3OW5?w3gi24hEJ%8t5QZrKD+t){
zQq5P8rlg%#`Aw&aZgWewE5DwOy4+fizBFdV#l_gNWeZN8Jc%1OZb*zceMlq{AtE9I
z>gwuJ^Wp#g`)@D|gD<}LqSC(P<YXK;Z~)V$O{?|~kCT%Vyu7@yXU`s~`RrUS7sbWJ
zC@wCp@dyvYF!<-6f1skGB9VevQ*YnCg{rDtR(WVLs(Kn~XJ^M&Pa}lXj5t7wii$#L
zXsE<}m8+{O+}zv%0D}h)uJpCyhpd{KnhISXPCSxaakRanimBAqjkJjWp2*_?aa{xk
z2IAhmdx(mPV*l>g*w`RAI2eI}ftWpeHh4T98=Q(+Sy^H0)~(9ua<kTG((N=fG%DQ)
z<mcxjA|e8omX_$$sZ*6-FA|B+sZ%FRnluU8+S+otIjC>?AZgs*6qJv&HMg~dDqhda
z-1?79HZ~(ij>O-8|6OH(1OTsIy+TY(42BLJiuUa#M+@J*dxyXO{u^Dobit>eehL7%
zeEBk)t{D~<hQh)^3?Dum2?+_v&(D{7j`;X^v})A~?c2A<_3PKAj^OC&>EZS3*Ld~n
zRgJH)sHh0nuU|*^?%gY;k%WYVR9oKr`Sa&B8d)KP5Ltft<rhRnMOC|~y|lS3;y}aD
z&`@FhtBKl-u85ZsQC5)j$tR!S<jIp#`#gU9cqAq!!qd}}9r4oF*N3O4CxU~68@j74
zLcK?lIvBKK1Eq}YcXACZo<Dz%XV0F&*47qUT3S^e+qZ9D^zGXhd_KR{X(_UZuZyFu
z3GLQxtGu>0ZQ7tsn>O`6r=g)?jZ%oJV`O9m4u@0kcB;DxtqDy{O}TtX>gwuBtc6t3
z|Fw7jaZT0xAHZJ&L{JO{Tq;9T1|?r5QHP>Jp;rWd+>+E7rlmJbA?;!*DB4x8KM?R&
z{s2KsOO0{Si<t?iH%(9wrhsUmu!%;A#`qB^2!r$eV|Pa;<M+k}zMqfB9&Mj<cFudk
z=)BM8^Lc-U4<Fv_MQn3=b6)}K9smHCM}PFF-Xx~x>D{scwnM=%KWqG)>g=s5EG)#T
zRjZn;mo#Y5AcTa3w7EdZty{NHUS19d2L~7$8Y*oQiA1<{>lQx${BxL^nxdhh0Y{G>
zWve9p^2;v(fPVe@;oEP&MPgziUU=b!Cg&(BD#G#O$6;q@ht$+m+`4rO4h{}V`-~bj
z3f0xsC@pQih{o~b$8ql5IjmZ>3IhiYL}6he^7HfI?(VKs%t0oT;n=ZbY{j<b)YQ~q
z*sx(O{{s<1NHe5TX|q-1fYyh)Du&s2rv>g6JznaVBG3^Q78WfQt+24LKww}XTjiK&
zmQE*0KmRPhuzR*-Z*6TYYHDg!Ua+Wh5wMCXd1a`V?OpMv$4q>?@k6y8o2b_}-+Y6p
zs3<&s{1|ud-o>xK{)&c%hGzG7adCl#H4pW7{+A?mqv8f_Qqw45G-~=i(FAoQ)HO9V
z*s^5{LPJB9<|G*z86hYr2rE~vY}ZYMGiS~KkXN94R%&W00N~ws-vuD=ow2jC!z-`6
z0zh7o4v-J=t*fhJhiNpPTg2gTP*qh04u=CnLqo`9GWLCq4IMfZdU|@zRvs!SD8PaR
z3s6~EiD}cOVc@`lh>3|o@7}$e{GI#myYFCcZ;!z(%rkrV@FDKry{oj4^7B9{l{P!%
zE<HURK=VU#2qDUj9Xkd<K9oyU&&JK0H`(ni4Ruw=eC_8=c6K&GLPFSz&H{k|bLPxx
zu{SR&Dhjh^&7vX<YSig5X^o3Dly<TL+;6}Arc|=_^5x6u-Me>_34h0rAIA?r{Lra$
zwMBX5(^wQm9Efh3F=GaTf`V}G-aXvCd$+{|3HaZdN{uVpb(6J(+KQ?AgMHq(9JnsK
zaNz>%?d`FC{d%PYNgxm)H#ZmS)~#!IFKcRQDvXSb@cQeoH`z96(j*ud7~qdT{y=JK
zDo&m}sZ?D~QGlVUstWJC^A3Lc=_jP6rQynzE9@gJEe%JH9tD@nMSgxhUVZgdm4zDy
z4jc$OJ3F@0)3f^a?F&mwOH7_T8G{E8#=(OJVQ6TG-Me=qJv|*)u3UjwEXLlwdm)iX
z;OFPp;^)41?;ajJc+lhqQ%}@*zClZss}w89H&+3V5Tfk-`SSpP$&)9yxLs9cJK*V!
zGgSqbG@-fC42^rdTI*d`46{?mO}~!H&d%<#>UN}MolcT08YM}cSxZPL6vENb5!<(K
z2OytZmzbD{{{8za-7&4JtHZ^M7cqYP_>KqNM(QkYPBd@cym@UJ@-=<>bhx>>DKEI%
z!+MgK>P8FYc9S)rp8feXR}Q>A+}zx-dGltK?;kySG~(mqarEd>{P(~A#p>0oVP$2-
zZXY{#EDQ_`keQhYS65dI8Z-#Kd-rbgm^5h;^!4@e@Zm!^IXR(UzovgH`t<1oPft&z
zr>Co|+V}FyFXP7_f5f<P<M6M4{R{f~`UngR#77@}gs7+}L`Fs;G&B^iyz&bE`Okm0
zIQ*Dl7<~Wz_jvvF*Pn}oz{bXg9ge8Dv;C~bYwFQFEkfExBoYBo-TNw$NZ5<`;lqck
ze7|Ctou=paC~gL|WeqgNNP*@k5;|=T5%l%-1&_x=a&j^lhCy<2GW!`fZ{CbCW5z%z
z6hbPMLMoNA2@+MeQ@>6RxBCnCX~mMp3(K}wVqzjnN=n!-<JVt*jiEz_B0oQ$9a_gQ
z40i0;fzhK!cS)Atcx@y~l60S`scDlx#s&rk@bvV=sZ*!ewhbFL0020qPwzlC{C>S_
zg6ty9gFN<mcUc2!(4avmDk_4RnHfStLg4G`+u~xWZLxm+`WClOpFX|WA!%>C@dmuS
zyzuXT{~H@NY-m#Wp|P*O{u;HlwOF=nS+o0m@WBT-aNq!b`Q;atm7whH?Xh<4+9vHD
z9v<!L5vr@J!|Btf@!osyX?!g?T`_s`WW>hCB0fGIixw?vvOOv)3V^&!F%3l_q-_*c
z<5cnY_h+9scQdAOqETF2tg!+Pio`%Mr1n{gn<rc@x7mbFLD5U2tt3e(6hbT(Q*}EX
z(dnKf>ldG1fL+V|wZq48cX!A5@#FF5pMT<?|NJLvYHE;>kbp^(CLt&&2-~-BM^I1@
zjEsyhfByW=hTSGN#ZN0ynZNLSTx@hlg@uKfGG$7WyU3F!O+rpij?$g`xpU{j(a{kA
zpl3Y-(32OpXn2sTRP3NztE)!+JrVm-Z&3GGK|3KK0q4)3$DKQOuz2y}PA5p6#o=(U
zYu7Hk^2#gt{PWM7-S6tvs|XJd$A%3XRF)Z67%^f5JUl!Q9UZNSa9JrSDR}VUL6e1P
zd$J`<mH?2?D^nyy3PPa}k&%%~`w>DqE-WlesmG$Zc{0}4)@(tmXN&Ntlj25KSy`D<
zud#w+SYTTU{wU&XEt%33cXxN3Jb99;+vy6Xlgj>l%#5GEm2sXI#*Cl8l_~r4afgp}
z_wHThn{U2hE?>UPwly>~FhBqNGjsUxVdl=AJFOn$(W6Jqz<~pqHEY&%I1Ywkn8(#m
zm^c5vopGKQ#yHOlV;)HV?9}my`c+p~GaEK+V2q567y#_!rI%h}4j(?uFbu<-KYyNW
zH!v_@^7HeRj`8GV5K|p7nW>JL%*cK@t&NYNb~4E&_A@>Cx1YAd>Gtm2xx=`*xiJeC
zEMRWjxWUL|GKOIornIz_`R=>#m^a>dgW0-uYnzUB{rYvr#>R#zC@9cKto8Nv%;d?F
znJrtkXyo|1EI2rr{jT$PJjTPrgW>UbY+FoBjJ880&)BzbALHTS!9El}FD{p>)Gii_
zwH<1w96WfCQN!g{m-F!OV82f#B_&KrNeL4i9L(_feCEd=e`EkKd_KR$V*~^QFaVgj
zbLY1E{EF{xXlQ7w`||mG1_0yj?XA?Fm6gT*PPO)X^v556Fa`z&jFFKMbN~MRcE{Tj
zBqt}c|L)1j$=VJ_>pFd_)~uf~Mh+Q(jGK2+U*CX>SM%|<+Z!D^*1&-S@xcclD7A4o
z9Ci(pu9R`}E^6!KmGbNcTG4Pj9dqv7IV@ee6nS}1hm{!^7{J%p7a<`b?A@!z!=Dx}
zUfg888U4ZI&`^{K0BE?I4t@J6T@bxyHAtRLQq{BR+=9wPJ`6B1F%id)AIFXzJ1}_g
zVD#(P54UdJg1Nal4j(>@H{NL5-#iBg2l)B<AuuoyadB~KU+neJp+jI81_1#9YCUdu
zuxZmKj2}N9yLRnDQc@DcVllW}F1)?Hv1G}TPA@J_)Gs?bTjc`3Wo2bb?Uj`spYKdM
zZvOoF>~~4A{05iH#rgB+*`H5yMH>`8`Q#Jq+_@7cPMknZO--AM??@yPY~8w*eH|Sg
zjbX!vwOAVaz<~ow#SWG%S%RXXBCJ`n1^^Hd5z*>=of9WcKqiwxAP{JMZ6|HW&dyf4
zX4<%MBSJ$%wbrYq6V#Du#htmz_P7M@j914YJM77mC(M8W1DN38;7%Q9UF0eDGktyH
za_es(UE==z`^?<AbCr6I@V~oR85tQ$`z9nLu-luvGt^M|2ixmX9W|X{YCGN&suSvE
zOwHG`+0WEac2C<8^*Az_jH#`yWf~e9I{f~{ix)FHckWbcT-UB$V_aNZnA^8+tM#~q
zkk09@JxL5B@1f;#xoj_uqBq9d+nWKv?Ay1m)niPbKAi!;96Wfi#r+gLSFJsoBNmGp
zKR-V<UM`o*czb&@Sy@@F##mQZ$M!}&do9t^wdLR3!^1<{VQPh1ZezYV>S@W_wCi_J
zUDI^Mc}=@|^(r=O*nou#7oxbh7~g#J4VEuo&Q8*AkNWxsq~+XUUr!v}w0tn>S~8go
zd-m*sy}dn-967?ao0*wm_wL<DO-%)#&sTa+<6fqqpdgiZhBzjc(0loRB|+<JA-i!>
zGasOf)ZaS8&aL8@_6NsofR-cbdGz)5(W_Ul4li1*udk0CJ9Z#1FAx9u&wtbsQ*m)I
zwr}5#y?ghnEJ02PA#EiT3gP7B1gTVtO`A5Mw6qiq!$2q$vb`~iHRxKJhp7-A9*&n@
zdI?LHE=55>L9_cMCMJSmm{uRnv9Ym1L_`D|Z)s^MghFAPdP2VV;tPmGA_N2kG`W`O
z>Duyd{=Ck4;xH}!#<j!ZjWNi+Ew3!*_uiZMVEPz!99An%Ubv2sujO6I)-Q4q7w)U&
zh@NjEkqCZ%er!2Xg}HO*vVVM4si~>KiWMthW@d)9Yu7eg2%tXi4C>BrlfUR~g5K|c
z15R%fmHX<n`dU0W@&Q}UyqD`I&>!};mV+XMkmuW>Lx-?n!Gabq@O4E>N(x+EUBTz`
zk&%(1a-Y+uPh;A&Y2fjAEhasUWo2c-)zuZYwzf!4PKJqz?)*PCF)<NSrcA-yxpQ&&
z@L_F-Lv)DR2E_mEEeH1b;Zs*o_4tXp4&9|{>tu*N{&Y@<_vEIfdP&zPFE7W^rAsk(
z>{z7)X~>WvID7Ui4j(?;;<#ZWBO~nIy&D@gY-q7kn*NZ<(6f|RiougA)L)BH+h^!X
zvTLzyg2XZH5B>j}rsaqTA%t`%moHxi0L-2}yV-qq?b-zZSg~S7n~&@0=!k@b1QZq)
z!ok4-LZPs8fvQ1CNeTS?{P4HG{S5+v00$2q)OJWj$EYnyn&vtTb_3-LF;+c(f<q@$
z)ph7D_3f!E?D|O7FLL2E(NW70J)e#oIRblod+gb>2QrzwfQFHg5jJetfXvKHOqw)F
zt>-fs^LO^SEaxPc$_HvazNRrX6_DkeU|$=I{*WziP6#1{v`0mS>LoFRLLriplECNl
zRjx_a5*HU2+_`fH|M<s0ux!~fEM2-(9ieted3ibP?CelnT#U14&mtx!M(fK?5Z$BJ
z(n|jCJ*`3)cQzCEOS;#(Gv$@lh)uf6zW#Wo3-tBXTYZYOEH5t)?(XiGH*X$_i;LNI
zPft(e=H_C}nl){zj?-Rx1NqSF|Gx@l^|g>)+Nbt&Xp$`T0Pv&=0H9~dgTAesb^{`W
z5Yp|;nl%etE*FuJkxIQi5{U$1VPWv`@d2OD@9-QIGcz*;1O(vDojdsClTXwYc8B6f
zO-)67d_3IT+_V-4(QRtY0G!_#jFI;8iQ=_&GVDBhUY&>6xIMxP>@Y#QfmU#L9-`%l
zo*y+eHTdF-FEC=n2%I~2j%~NLwnkiB91;=|Flf*qjmBUwZXx@;{?28{GP=juWZCt2
z)aRXHUmJ{Hti@;uA%t{SHa0d8i9`?x1X#0X4LBSQI2;amJRW}f=_l;lw+|T^8L+Uh
z=+t?PjEpd3h<2~Bw0(Y}`_$e|vP9s<KEHT19|z(usrwWf5u0=sKPKN`UkAKDQH#+$
zUlJ1&VQ+7bjT<+jrltmfe9fbPfB@v?=3>^YSzQu`-d|pW!KgXxYnkW>>I*J($+<hK
z;qDd4Qunj3^@mP-+9O5?A%wJ(qDovrK|zxWXYCzgM@V<3_9V%E@Jm?m&RF*KSMir|
zHZ8A(cWB?GEHQQqFR-t@COWb`VnlO_ii$9M_H0a<G6jW&g>1XCvokU?GqGdGjxMi&
zV=($d=no#pzOMUe8yX(uc4-W4#grDJ_G}2yP!9mmvmSw7F4`NuKnNj(5Ykg<WWvqI
zGhLL{PTIIX0XGVM*TkthO;S{XFCtE%zP<qf;577Ad_M25T8^q`lgVV*x^*k;?d@^w
z*fF-<%*+h?_wPq)YAS{e8>Y4Rdi^yJ9P>f)7xlHMOI(kJKW=L+9#xpqLe&1S5~!;N
zAg^ZEYw{W@)<6g$gb<<z8mmgMZqZcOSX%;+&re$U<q728DQ@LmT}x6_f=@&L%`Sdx
z{UR5em%c;A8Z;;^Ee#_^jKGQ&D^OKc#kTwU`XWC+AHKdiuqIV6V;D~T7dU;m008E3
z8EU@|)S01o4R^2L$$tXaa^Gyc-EnOvLI@#*5FMnkY{1ya5L-Wc7Z#>{0RYm9NBATp
zR%eFZUCI)}_g_cZa^H%0P5SiKa%4SINl6J7E?kJQW5?pgji+<Jh7B8r<m6=R-@hN0
zmX=zKP#LG+i|93Z4Vx&Tt{Qb`L$qGZL3TYJwTbK59whWKhT*i0;F!_yP(lbHgb;Pn
zXqU;$mZsRW^ldg#s;;TUKO=t7dNGICq^k(}@&wz1WNc)J9m{9p)tAk+8dpzs;J^Xc
z+uP&7fdg!tiHQk9LPC(4nF$vc7cEBDJiV8P!SLNLpANl)yqH7XnT=0-ak>aoQ-Qkk
z+vKIm|2GGTW7;3RXYGdG%i0^7NC+W>5YiKAd|cV^*Q~LB?fdM|J3wB{VfF5lY%fk%
zDX*-?#{CJ{dGsfC4wChYTpV0K55r%x?$TJE2RClqfUB!37A{<fl9Cd(ea4I#$j!~g
z%9Sg1e(^R=zZcQ_-JQ^Tbqw29FHXjjBOgGPaTv^#sutd@2KBX&WgNzn@BXe-=3CEt
z1Po{HrXD0h2qE20ad9zHQc|=U!>LoJw0eG``?_TE&C8aiIPlN+G2W5Kw*8cG3-5jw
zjRWzQ*tLl?rM6Cn1M!zId&PdGGT%-^U&X=o^QZ?&&8n)Zuwumuj2JOO>5t%`L4)wa
z4?iG2J|5QA-6$#TWeh{lwJ;dr{j{yV7BbNh)PDDO$gan;y*p~tP>=fD1bH$hI>Ig#
z3&_iS8&2CqbC3ujgmfzf1qE2PY#9a*9*pn5|6Xfx6c-o6&(9AdMvTCrLx&)f$+Q*=
z(On#dVVJHuS$%y2qK~KG+f!GR+RgeIWB%J?F>BHYwH8gNuW!JQ$u|&vJf%smmDfZ^
zd_M25RHQ-8PMkP_rAwEhsHli-GcYi~%9Sgzdi81;85wCYy3T9({W@gn-=N|C4do5J
zjG;ex9Q0lt4gFWg0KJUcfAG3$)E8x<L6U-odm=D36-t}+EO{^(znIoRB7~4`<j|o*
zSg>FLy6|#KCmlO>3_d<S;Pd$i4-eP+Q2Uyi8f@LV72CFL!?0n)kdTnj<;#u`-PWZ^
zlESszUlDyg1=+WYl-iAr4Dr@TTa0t$!Nt)A#zuziK6Z6YEi!K2#rcfeNXxl{^2%zZ
z?REpL5b*v)S_etZ3JVLdbm`J2-PdkzZitMG>~Skw*WbAeS=!fN%71OTQQr`Hue<@h
zmxhAV*Ag6)zW_!rfMa9|j)^6hsuFnuRP!g8sz1O~mw|bZhx&UWpuV=r;W(!K<?A=u
zx@rD{5z+&sq@-Z}{P_@z#n`uRA1#2X!=zFvzWVAbL`O$MEEWR*csw4wy}j|-XP?2s
z!a~atb{-{3z`1khFlEXVxVgC@At9knL+!J(v*GLOi`lbhBQP+q)%{idE_rx(;L}e(
z#nh=&n|+^1B*NISW7`#5Pj>qBY0RBF7bj1i)OsSTZCXi^6fR!PN5sD`;_m&@Cff{q
z8DOOS0E`$i02Zcw@v@~UtjtYdVcHkQMuw=Zli^`$B_5Vm;bB=N9+p<(ruaV6uHQjz
zUDIw;>leBBc%}>7oqN{By0*z=GHlth1)DZ)LQPE#+iq!Ti5)w3VD8+xT8vJ^8tPGh
z`@fK79|u!fsP@BiO#8#&4KL{b-!xkPh>$jrN~PGoeLFU9-psazhK9E30*iD#i9~|Q
zlP4=(&;meGQW5}pvUKIjm2RIXJ?}|UT3Q<1-Q8hgVuH-fOuY2cOD*oNNOppPf&jGb
zJ1mt-;pyoKkw^qTKR?WwGY3UQMez6cM_E}Jf`fyxY15`=-@kL`PAprt46|m<LR?&2
z`#)q4AdyHA92|_;*jNBSa&q!>pCoBDU4C<v9mYHIka+nQe3y^`Nzv2E{k3&6q+P#*
zwCi^|bq?znx$vGm5?&J>X=t6AUAS-oetv$)%X?bZ-N3*AzP`Q)2?>FjnVA-&>jHZE
z&>u1x`a>pzsrViB1sBlp>(!=1@!E4pOCI!WT%gZ$rJ@Xkv_s?GBOXsa|5b7EO?1yz
ze)<3aAOJ~3K~$5!zdyucG5CBw5)%{IWGFj38#8Clgjg)b`|rPx#Kc4`M@l+Fu`Xgv
zOiZf@QseJ&du-pnolTG;A|lv!Yinz`y1HWX=FONgWlFOb{Q&_1`0>XdaqQSJoI7_8
zlO|1S*ZI4<sHiBcTD1ygWnEjjSJ!F1Pf=fA57S(SVVdhO6g?=z*|a=d$ti3y6t6w(
z23lc)(`%SG`gJPGpaI3j#aOXo1&$m!qSVgk^RavPZa6zTYbi4A;h6S^!KgXFs5xM&
zO3+Yv8O-A{Fpo;WJT3(umw~CN08>>0j)^5WMyB#1cqV_556SDph2EfX;F##nT2X{_
zC$6rp;BvX_U1v{EPfC(>SV~F?+hf!?K>~o`!-r$nu3eZmZ5oo2k|2>tU}IyWtx!oP
z+_-TADJdziwzkIf>C>CtPtgk;85xO{D_3IJuwj@sZCaboA(2Sf-s9!Vmn&^^ad82k
z&xc4P!k#^QTI?D5@WT&r?%X*<MMXU~Ns>e&fxo{$3JMAk5fOoV_wKPhcti)1q{ggY
z<YK`)W3k|!v3OWoiHleBQTpd&JS?q*wBiw@<&RKNRgH(Gm9R4J2U8PcnDsM;m3co{
znfHVF3w`kBC_7l0_tW-A>5*hI84escfK{tjp}f4DZ8tMB!`iiLv1G}T=YA|N0B}q!
zp+D?xZHGa~b0s)97$1G~5nW7o6W@LJ9RR@F+gs&uy2f)z($mxF=h{u}-Mbe6Fl*MV
z7Wb>DsKC{$S0NIK+WoUWd-f~<`S46t@0~q+Hbf#3Vq;^mckkY2hi}f9F#|?MMmTZe
z1d57^v|5EXJ3AX8At8v3jRlv>g+L&{oH=t^O!A_lqA+XLtac4gO;1n9s8OSE^ypDo
zSXgMiEW57J*(+Kr^M07+K2qCZkpB^hL|D3XDbmu?l-dOX0e0-z(P|euA%tjBOY;qg
z?vY3&0DzGroB#j3hldA}l9F)m-o360i?kptEDUjRaS(|_0OX@bKL7l4<mBYw%$YOD
z$jDIIzpAQ=9dR;q=FAq4ZDV88;bE2W@$movTU%R|+sBO?$3D-^&22W(FflQKr>7@Q
zoH&642M%D}x^*3jr?Vsy2_{UKzz%&YD=R}}WF#UZBM}@Ntg@g<R8$leFJ26HclUNB
zNdkcY0)arS@%JP&Nr$wkyu2JsmoCNFv164IBwJfsoIQKCO=FA+A%u{|6hrNX4I9?#
zzCZo+lcvKVEs#p3aB_0OmMvT0>+6e>k`gcsgW0oZ!^g)5n>TM}=K(fWR8)kjD)}0J
zZTUHOR6#)j0ASRpQLXNK^XAPKw+|ma8~||Z)~(J5)<ORM{^0R=NKQ@$!!SrrPG*am
zY~H*XW5$euP$+~{Duq-kWfP>};9%-;RWqIKNg~=O6bi9y*)kLt7qe|fMn+h@dNr0W
zU*7H4JR*b;qFpb%@ItfOCQh8lCR0Q^8dr^bw%S=>U?4kxMOBYrVPPQvc|j*l7IIR|
zJv22nRk^)?|NiXrii!%A`zR=e*fn13u`8WEeH!WM=}N;6U0hs{n3%|x<`#>^@bU3c
zdLN(9r`~i8pq?bsL|$GV+}+*b<Kv^0AbEOvA}1#YYu2ox1c?wr2<hP(SB-0FK1|~w
zZ3>D+Lz{DZ0JN)j#nMt<JV}w@b+s{L#^A`2BPwH_I&~`Y^YalJ8p`(EDT>ul1xU@H
zBuPhvg@u8`;V3;+kw_#>_EU`Q?yQ=c8hr7^7Z@>O1kRm1$F^HrTO%eW1_=oX&5rpc
zgb+eV&momco2?oLKxvY{y}f;t?TRF+I}OQK^mu8jC&|LXqQ!-8Ei5b$7#N6xf&wrM
zgVNGc1O^6n`?bV$6(vbJASERQ(b3Uh7>0cSXp$(Uq@;ky;~_LOl-<w6!vj1XuhWTA
zVqzj392~H5<3@H-SOWtC1Ox;iH#e6i_7Oq|QM*6?{Il6@*REXyfS$kRo{l<p>=*#~
zP%c$H8;bcod_KR$i*%VxrkMbHu<Yz?2m}IfI2@Rpo5SDVztzffQBhHlN~K*C;q!r#
zBpu-5;=)cmREUX*0U)0jq_A=0MtFF5D6KrLSTt?x)~y{ncTrIhe0+Q`Wy%z#7@VD*
zk&%&s9Xocw#KfdS$0mdjLR3)<7rJqy`Ng*tOHH&?0gq_T`Sa%i0Fx(AZgIPllatEr
zieYvoB_$e&uBqmR$TdzbS}P!-m|~#q^4}9COh9aGEP$ug?Oa`5v3m7tm5Gp|ctdM*
zu1Nb(lBA=a{ens)5+o%hVdBJzO6@i_HXZ6olF4M)xpOD%?d_EkF*7qW?BBm1si~=O
zbad?a2OxwHLYl$n^8q~VEm9>tJsp5%E2EL-DN22-Du^JFNZ5;bMMb!0DXwEQJ-<g$
z`K>M2L9e{>N{ibS37s~RBwt@&s&1zvsJfkwdUnF&@4x>J02nxMV3U1qZEf3C0Vpjk
z4Ss%p$jZu6YM(!UKElJp*@=sU5JHG1DDIS>IdcY5skF&(Eum0|va&L8x!e}#Xb{a&
zRE<-`-`}5oK6L0%mHRYKG)hWJG<I#FNDLH7^|KVi0=Zmnvk9Gowv!~GPzbSDOx5jl
z1ob58s5NWWfXCytSWQNut#=N}%geEF;X;fZJ60({8Zu-El9Q8h@Zdp8kO(1!Xxyw>
zv%uwYQC3!lFTVIfX$Vnvb~bwvzH;SCZG}jh5f&DvbluV1b&9pMHCqYy*_*QJG=2JX
z0P<mJ+1c4mwkw7Owq<Vh)vH$l$ghjE!QI^*Cr_TF>UKJUk|Z4z78VAvSd2r54yo;!
zhYlTrot+&H95}$XnV6U$BqRhmIXP`g#t0!qSNZ$<!_(7~eJJiKM@L7qZB&3pcUV|h
z;K-390D#EINZ8rg!PC<dPEJm6baX^nSsDEN{FLV4lCGr~;uReo%?|Bay?Qm`;^NrE
zL@{hq6*Dt4%$++I0N9~<nlN?hR5p%~kPxM9+1c5Mjg1AD%T-ySud%ACDx5oa4h9AW
z_~@gLG!}15EG#TqydI<Kc3q4iIwdA1h5^8YhK4G&CnqN}0GODVm?rP>^YdePJf6zq
z<>cfrE-o$%0Hw!_88etWckXE7BM?GJm*eqxP5#b3``~i9+76REBP%P5@%Hv+xLhv#
zbMo-;Q2GD5?&{#dgG_h4+)`YRJo_EW%F1FwLqiz=jGv!hi^s^!%wzyCmX?-GU0q$9
z&MOv+89zTi_MAK(kNNS(A6tA+R#q1KJLK){%_Ju$GchqS?B9j9{5~B%e3-pHdLCtE
zWifm{U+H_8m6fIKu(YcCeQSF#MIxl?kB(R@R+&68jQrxj!^1<Vt+KL`S-Em0V_;yQ
z^apOxpg~N0e7wd!10jSELZ0fbNfN^_OmJ|pQt}}diy4Mt7;kTH1^}~f-@aClp}0}o
z+O>y=hexY7I$HX7R3ul5c)46I<L&L;<_rBvlO{0$n6qckwrT&KqAmaC&t79bFE|YI
zzeRa;Om$5yQgiO0=s`J3D;}YuvKkM|D)F$i3ib63(AU?4mAMJ5xcy+-&lsjA#;|^o
z3#Xy4!mOXMw!?2Xi9`Y(j|UGAk7mb~+S=N}*49>OyW)MJp`q-sgcB!DVA--|N)=@c
z3=FV*`EsmXyOtdzOb8)_5Y0Mt=nxhxSO6Wp+-gE76k^-9ZAeT^Y<3uzxw$#Y%F2+H
zmDOr7gtW9YxVyW<#KZ)dnVCAdxa`iIJF#rpGR&Ga3vqFA+75^42%Sojq!o{FDN~Gd
zSMqQz?^o2<H?;d0`uchpIb;Cd9BGR;N7=#3yq^XlRX+}g10IjpWWA)ughC;Fe0&fS
z6T^<J_w@8cQc@BahCyLrA(k#(ic_afDZS6d#RdEK@7LNyL_!E5<ayPdlBATB6u7#&
zg3sq8BO^oQKBrHg#<XeETD@jz?9{1K@bdD4o0}UF5)xowpgYBtMIsT#jvWhUXJ?#0
ze_p3zBif}CzX=zw=Ht5r5wdR=b^2KK^$p0lc^4Ts?_%5G|6=%S*7)074w&YuyX!23
zg@pl-m)qoUI8C-I{;(<%BOf0hw)`WH$3tCR9ky)Qg7xdyqo$^YeV?VJC3fuC!A_hc
zgb+dqY0l-#mjM8?XU}eSpIy6l0RUF4SkdO=PM<y<k&%&DxNsp{U0tzb#|}6<J9jSF
zPO7P?!OopK5gHl_TU%S5OWug~Y4x|^TJEoijJt>%1;4A@KKwOnjI<vB^B4NS%Df-U
zP5Z*iydSL0`{7|}B_5VmqO{_X{J(!b#<kpEaYOvOQV&%2?IL8~E<$Y5RrtU6CY;|G
z+*Kd1%>n}h+g!m%AP^{3Xu5FW0vsG1ke8RIwBO>zixCnM0y8r+wZ=*aA%u{gt)ikr
zWxG%)L{d@`_<TMVEn3vBWBU5~!r9pw+qP}Pgb5Q66cmJY>(;3u+V(3iFNc$p699Qd
zy!rFz(^Le~gjR;z<==aVsADO(l%>2-nPD#jjI<ws3H;YEegqE|rhVIe?DEQLT)di(
zOW6{nUB83cI+@b;k@f?yMBoPd!MZmlwmnKpO0aC%GPZ=O0-w*v?%lh!eust-LI@$<
zYq*_6B4NvEM?^%hH)SOf3632*hM=Gz@cH}}=PR{Ead9yU3JSEk{77PAA|_3mM7>9(
zSzVqa9sE8O(Z^Gi+D!WNhPTHk2t4>O>C;<n=c=x$Mclbe96oggRga%2ZCmipSbRLQ
zd#(+%Z{I$wTD1!0<>hRfnVA{Zu3d{IOP0_Vo)AI^(GlG#Ndn{v(blb7apue!h{aED
zW_x&ez{|_4-91QzbXQ%LB-Pf*5b{+L5-<P4w(0BZ!E2%;=D+RSp<bi5s(Snchfby<
z?rf$~&(fQt?67XpR2Ul>YV6$VBoc|Rbm>y0rKKsg3j_j$hlj)3+FDDI5kd$dM3wHA
zBoRX7x+F=GRy@MWFHb1VJsR)GL%{nJVErOj)2C<MFR8%Jqvvt)YChX$V{M78pS_Eh
zEls;Dj`k`qFUR`z>#=9g9>`=*lRR5nTkPJw8=jt?T8xemLI@$vp(Kfr?nzJ6Cy*4C
z;O}b>D<w$Y9-|QYj~QK>AOXP3mZk{(#|(VrHBKqMh3k*1rLvwT2!%p8I5=SE&Yf(6
zWMpK7wQJWRCntvzBti%wgb+g1OruGXwBiw#Z9RsErIi5W!|PW4-2(ydPlUd{#`Cjg
z`Ff4V+Qrjg*vo*8bM@|%xL=~Wnu|6R6coVS-5owYJ}4@Bn!rt(GzmF5Ias%D9aUl>
zgb+dqAw&Z-mZ{X%$*}Uv6KsNH(x*3e1-^&3-QLjDDci+!-2Y+kDsOf!l(gazmT&(L
zs%vVs8dptC4c4t&2L}fSoI7`pZMU|zModf$&YnFBTU%Q#Mo0)Dgb+eV&!({?Ddejp
zc8Hz6z8*sV;f0a*12lEI4jE?KAK{<9%NA~s6qVqMh*L`IEOn*C#6&naI4CU&YhYl2
zfPetx<m4!=k3<L|gb+dq(F~0wNe91ARjOha_@TSbB}fYPgI~g`zk9H+FJ+0FlqlD<
zqM{=B`1oMTlqo1EC}7*2ot=@Inu;AecF>}*gb+dq=@DvbYLJ(gr_~s4+_<6D^Ap{t
z_9Q9)-b1A%!`ow&&J3|@j=S>^rD6`>p1Oi-xxZ@syfT>#J9qAcgM$NvLLu93W@d)S
z$VjB7rm~B=5kd$dgmh=+<>lD9b0-E59*j+!Hfb%6qM{-=IXS`0%L^AST+mt^M7OCu
zNs2o5G(j5g$iq^Bo4QY-5x!pIG12LD_O+&alhV@C;N;|lWy_W+Eebn#?p);O=VS5W
z#Tq?7A%qY@NLNWoNnw+t)vH(I;K74hi^ba78aX*RFfua2gb5Si<Kv^W#0nvRnv<k!
zxxeC4mV9+)eSJLyygxy!RqWd9vk(5tR=mr;U8J<0lDd?am&4D`4`auUMOIc8+dgE-
z5F{rj<M83bu(Y&P`*{f=<av>jk^);>TW~lWL`6kuI~>vm5{U$!o}S=vI5hvZ2g=LK
z!;~pgU~O%U{QP_@S+WEM1_ny|NTpH;g+d4f0+^edgTvu~!{NZm$q8X$VUS9tEuKRv
zl_D%GjQ#F&I2?F-dgAoy(<=A3wY5b|OblXTVjvU>;pgY4w$Iz0oj!dU=H})|N$J|D
zC%Q<j8BAo{MfSPZM8_^)2dT3xO#9;fsZQ+ch<{&HYY~SdM~=YG&JO$b?PJ@FjEoQx
z5`vtZ9Jsi+sO?;Y5c0f{N~Ku6dNo{KT_G0BZ`f5-=+4p(M75}>DDe4wBqb#QfYRs+
z()|?|7h}SN2>^hYm>89Fti!^>U}<RyA0Hn8z{!&*k(`{2(9lqb#bN{n1;NwPv)M#R
zDwV?1(-T2KL6|&wGLn;%5fc-G^z?L0n>G!rSFdh1K7l}hfPerTIB)>#)~)OO2kxdM
z5(xwX0j5oxhO)9UZHJ>1)RrV&yqeEevoq<_8}r|GR@b4s)SM|!FzaUw0JwX<RH*<(
zN9E<^!PV6j^XAP%Nl6LYK4ZoV<mTpL<;s;!?x+w#2x+^NloX5^GX|SCZw8OY1CPhk
zc1WZZiryo|@N$}i+cWw3`JuSD7?F{Y7&dH}%6)$N=_htyp->1H7Z<p=xF9ev5GPNb
z1OSLcB7F7LS1RAXefxHZL?Zb4`5_`A0xm8t5C{b9dpB?1++xp2cz8JYd_LB%U#~RE
z=Xs&HQ4t#(tL;#9irSK-?-E4pb8nAP?D|99jXc2{%f60Hy4vAm)zs8r)v8r+aBxui
zat<0a2=Vdph>wrQph1H=6D}cy5CE>Ot|%=nMQCU!3JMBnJ-Kec-`^ieNlEbY^Fw}q
zK4#CJt?iJAniUon;?${Au(Y&n(=f^n8#Xj)b8&G2mn$Ecq)4V3lSm}kym>PKVEOXp
zP2Q_WzW40e)9iT-3=FVn(INoA-o1NUjkBjv+^7f-4@X2q1VTeYwH=a9QA?5}t$2j&
z+eH8X!(Ijucy#Z(L0%Jwvuh{i-+PFn2kq~6JaOU#?CtHbWy=<JGN6Hh0amVDiJY7q
z%$PAltuYfq$nz{XI2a<42!Vlt+75-Zk(ZYjl9Q7W5fK3k3kz+BLo^^NDhe{03^QiT
zXmP|$Vqzi~hH3Wqz}(y%0AOQd(`4J(vu6PSJRVQwc17|X8ynl=ye37AM~)oP`jF4;
z>}&`G0&qASn46o!-`~I0IYLoUQLWC~dRBURI!28eg)3LCKp+rc+_-VAzv(%mmL%y?
zrkH&`(tZF;`t(-EVYSAvmjT`y`SdR2PZ_t{{NBRCLU?(3!OP1Fg@uJ|yNinpGBYy~
z5)uLv6BBiYO9&y)y-k}osk}fUx@*y*MKl+;8wm>wgOih!Qb7fwP>9v5SHsE4smcB|
zH8nVJ-~a%?+uOUt=grQ}X6G2rnKP%!_W1aC0BE-NxbcO5Zf<U~=drZ3gqxe2Qry}g
zkw`FM!UT5cTUl8dA|oT=>gtNst5>T`grcINuz2y}cF(~S2n5))X%pR~Xogynq;prE
zE(kV(|C%}usdZ!C7|cGuoF!>>f0;~%EnBw0!NCD1PMl!dEiEl^@ZdotCnq;M7MBo0
z2q8olNu^RaIXPj=mM!r0^+icZ2^faK?Af#7<Kx551AJCdQ4u>2+tJan!{_$(^#vd=
z`k*SQE+{Af0E`+ns@3D&ym_<5?c>Lf2Ov+(w8h`wA3Pop$;ruJ7zWA7$?)*-03e@R
zHD=5h2!%pOrBX<xQZ_*f4i2UpMQYaRY5~<XwYZk|bm7(UBYMVU*|$d8!myVCYU^ak
zzFmZerIoNU@27I#l#~=KT)42w>e0Twz6cKwS6Ru05JCtcM3*V5#)(8CBqt{;B`JY{
zfd~o;0sxF0IkL%ni;9Za=j~nEBqb#U2?+^^jEuzS(W9H3yD>#Clc}kx%I*F8_h+BC
z*3+VhvvKTQ>GbK-NKa3PNF-tt9v2rEBqk=}^y$->J9jR`Vli6<P=U|qYjttno~qM5
zNvSz^*fQC}U$a(A!G{0*=Ra7ycrjdEUE%BN%O)Skjva%yw>PFwpN@?iH)^!BtFe(G
zhQIa-`&zO7Q)4A1C0MXv0bE^Ol@cUJM@OWlregp8{gfaPLI@$GTWVZ2uBD-os^+pN
zrW~}VKvhag3OF1NTwPtUdGltJm6dh6cceY<S0qV|r%QCDF=NKy$dMx|W1c#7D)RI5
z5gHoG_S|u~T!e;(A~7+st3!P*bUI18`+F(-e5Cz=&K?eX_wGe@b~ZL_*nppZ{ux{@
z7w^6I9=`nYOB56o;OnoyhMSuk)~{c$@iC(#hCKZ|f0R`zZQHkRAMEVxaOlt>w#~%E
z1Uq)@Kt@IeoSnO833NgTA%qaARN8FSH~>n81nlkYn`~F~#<Zsw$===`$;rt`PEN+Y
zef!|y;la+w@%Q&{??-62mtJ}afcAQlEG#TAb?Vd>w+99WqM)Dv48x$bv=o7Xfi$N`
zLpq%#mHzpdeQy3jpH3a?;>C-QNF-Rhb}jz$m%l(yPY>hAk4H{U4!-^NTP$0)41hdA
zk;!CiwG&NgJiP8<X(a$4D=Q0Q$Bu=cpPy3o6M;a0+}vCQ1O(8UM}!bU2<g_29Xkd<
zK9oyU&xT@t51-Fhd6E9)$rAu**ENxag$27t(xOF+keHZ=n3xy<KxAYj!otGZ{W&^9
zQI%L*x~jSzX<4U}Bt`N7pxHS)Z6TA%aOB7leEjjp(9?SwR%xlcr|R8z-$n1<y<u!@
zj4!|Z5{C~T#=Lp+l#WqeUXH_u4`bW5ZP>JF6V9DGhx+>Z4#(8^^ZZu)5X+V=gOigJ
z($dn{c3WFpBqSstCME{f*47<97a@cYLWr(7fBrlGVDjY2EpAs;*$x0+c||^Dp}4rX
zQ*j6c0(PyV=;-KX_iJv5T;t@TwE|j-o8O8aC2h#g&hE16cBEyU?@6k7#6CCg#C)WN
zh6V@(0=)kE>q_m4xju@DBYJvzm^N)1=FXj~bax^zFAqzXE=6^9HO7t|3lkF)eEjjp
zm_B_v?%%)Pp_t7283O>Mg<1GEd>MA`+{xZuFfua2nl)>Xlam8aPtOh=pAbR_Aw(C6
zL?QsH3nEA)680i~`0(K>-><lFtd5~;inWduMH(7YRDP34TCYT`NZgvEsK%$wo8G>@
zzEs^#M|65zn7VqB3=Iu2apFX!wuXiVoIigaR#sLmX8(0{by&A<9X|Qw6S%s%0+3H4
zbaZrtySqC+{q$4B#l^KdCQ}n*$ZD%`=Sn<ewbg9<q)C$y85v0{x)VYOA*4rAm5?Yj
zo*y)H=unmWC=v~sOosCEa*Y+TQX~fH>FFxBD~1Jfx!h(GIt4{Sr>!JOC=^007E^UQ
z9icPB?Ns^gx8HE<)-AmD+G{ON{3|RhL_$IWqN1X}Fbv!N)?063+_-V<xZ3uzGVcci
zLt_jWF$I9U`!yye24~Nnr38r(LI@$xov^Slr5=mss@_>!TeBm66l)nZ$J5iZ#p|kT
z*RBD0+H2I<^y$+9$cLq=THi=9EKnd2v={^MG%;*XMLu<McX!9hlP9UVosQ^qlBBA*
zfx2A1dKHzGm3aH@x0Tu%hEW=mX=-YUL4yXNuCA`hF$@h2JA8h{=drRIjsJ6b7rD8)
zZTgZCLI~+v{{H^(^z>vOio43u(a~%h{r%Q0QBhG!KQqOAll1g-rS`TAqay03NJyfi
zquHTdt5>f^TwENRm?-87sbXnq$?o_4_usdAKCxJgsHmtW?b+Gc?9jeXKmD}H_Nh~+
zvT=ljgs6Nkm&;XIp|7!;ni`xqaRLDF;fEi#8m}fO3RkqWovPb)olXz8voi0;CKD|!
zxY`!K{q`HUTrT?bkypvPc<~}Q98Qy=cA1%(h>3|oczC!x1}iIEzI+*mhKAs9IP88E
z6%`PR#T_1_Sy3e)V#nd=Vboi1)0#(w5Tc{boH?U%c#v2uX4|=3ZdZpzT9BQcjijWc
zChcWqWlHUpmFm3#OWJ1s{P{>qN`hD{W=HdIxm=t-f1dsMG*`4iVbP*RIC0_xghC-U
zY}nB1ITtTpjC=R)VagQw2%gKAFJsG=EdYSv;NWJ<V;?whK&jZlk|j$}R8)jDYt{e&
zA|fJMy%tPNOhi>x6`Y-&;pphtYOFm?c6K&fMH&D$Zrq5_(9l+gDE4HX?n!D~tf6rc
zhxUq#i^GT!Bd~t`dI0j$kqHS2=-an1MvordWM9P>NTF}vzUbAfmr`3)R1^ve3$cCs
z_725VUiow$lA?$MA%qa!qqwu$(nC=#mFR|uh=^8yW(>nT*B5EpBoGJ?930HvT=4ex
zhDapB@ZrPR;cu<|Y&<<ZF=WUP6ciLFRR(@mL_`Gk?b`=$Z*RoL#=_Or6|SzXh>nhi
zKp;SJa&n7vZiWvZ&Mta;=FAy(T_rxBkF2b$HuWMOJ$e)X@Q;7|qt$(T5)Ow04u=Cr
zM@P0;2LL1`CBf0r5gZQZxh+uE>7FEuMoCg<hTA11B;b!f{$Q)9eDlpW=-<CTe*5h=
zl$MsVU5P@W5XQ#Fm@r{Ni^u!<=bsTC9*#YG_TZg&-sw<Gnw)P%2qA<JqHBagA+~MX
zhQ!1~Y}&L*WpZ-n%ozZHv$J!n#|sY+hnJTZ=FOXj%*;%fn3y!#$HvA6ixw@yqD6~3
z9Jh^)4I&~U5D^j4?)M6XLL57G3@$D%m^EuwhhylD8qeh?$~v7S{e}DVm%Z`Avh6i_
z@?_-Z=7M1utY5z#H8nLjdGaKJf`Skf6om2P$D^#Q4842z#)@s!=gj~B2Z%{TK~xnh
zl!nzk>(Zr5@b~w}zJ2>JbLPwr$0TjkGe$`gA%qY@da{(16!`e~G`m170GvL38f9f=
z;PH5E>gAh0eLBL!!?A4HGAvxUkX;;BR}>T!VBx}r7&2rC;^N}kwfHUR**g83VEy9L
zG2Yj5f9>#b1OfrZj~|Z<7cOAXph0kPaRG<J!Ja*PAQFji<HikmczCqB5Lik|3jX!4
zf8pz|zs8s`V*mg*Zro_~eX86PKV4tR{DnU4em^0E5JE_IaryFP08iH?Qf1e!T>yX;
zD^|4mxB&qHkV>W4xN#$7G8w|d!?jjHt}&rdh*hgr!NkM_XV0G1>LRj4_jGzrlGD&v
zp|3AL%nkAHO7nQyYrud3m^W`8TwPt2dW!gbKIYG#-)f?hk&%Ie2M^-#;lpf#1ORK-
zu5EWL)it$9yMBj#{pKjUb{~TfLI@$GyQ!$CP}wdN3XznQ1U{eN?xArTHf%tAd_0Pa
zi(zkXk3D<#s3X)4DK9UFtE(#(E?kHiGiD$&GgGSz$P(Su>7FFBe#RI%WB@X5-bH<V
z11?_8$J=gis3W#^xpwUue0_cK&O7hm`0?XtXlMY3!@+|G4^UQC*6!nF+`Nn0IvD`K
zZlDznw<ClQLP(D`Yt}4m*|G(Zk&$q4a9|4_NF)**J9Z2~K|$d2`5j)DXU2>fm@#7p
zE?l^Pl9Cd2hTbk_W@eZ+Z5n>~;RmW*Oq!*ZftPQNv_;0vy8wVo*^(|#k{&#GfH`yK
z;MT2MxPJY5lkM~8&u{lJ&u83bpHFaltux^fLI@#*=sX)68;C?AY~8vQYu2oRkB<+#
z&BMb3`}XbYRB;6bH#fIVAEUEYu3V|@5QvWBFls1k@vyWK?*!}v02uZ%K;qs{U~JU!
zMO?M5zP<s|KaF6A4hlm*!mBTvYdI=H2qA=YH&s<tC@Cq?i8(lgkhbgeoFqVA`EB@X
z^0Az?buz@A%T&i<wdTj<8*GAP{UVnVBti%wgmj3Bi3uf0gmgn{Ns<8IZ*MuU&kvuv
zf~v<))OF}CRa+-R^zjt-wfE$aT8xGeLI@#*5YpAumLyGc9R|CBRsevi$4_wRWU9Ij
z-KD-gb%k9Y$@)buye2woIU+&`A%qY@NLNx@k^}($@4d-Bk2{-*`z5MNNb0Kc%4)<W
zU1eW?Jky0OZ%zmygb+dqc|NE$18{z0Fh<%B03aW>w)5zDbsk>h_6RSq!vyUHTEX3U
zh?XNFgb+dqA%t`_wRe*&5xB9>FJ8^Zf%r@6K7~faCSApk$v4>70q;-LVl;#hLI@#*
z5N%O=l4L*lB`kPnEc^Pa_{%t(mZ$F1sMVz`F?I_tu&=!)I<h@tgb+dqA%u|Ui$*5g
zd_2<yZ;rBKUvJ!>fExwBYvNR$CMhbx7ZImWU*7-#a2on5KA-njEk{KNA%qY@2+<ae
zRV7%rXew;1Edj{qC$0SQ1aj{bYwC0zA}K1tr=kBwbxkb*c{RJuOW&bl4TKOv2qA<#
z$267=7#kU4>u2x6!n7{{Kw9w#pM=Ef%+R|_Sz`G9>nL09TM@5GpWa%Ij1WQyA%qa3
zO&o?{7)_oa`*sml?>@;UBLMJ`*Eslkjo0L9TNImg6}yEO*dcbtMuyn2d?tp!X05fD
z2qA<JLI@$cLE}jh0NgLB!1C??fuyK}ZJX%yIzId0uWV0KS17Nn#vb7Xr7CvTFLJT<
zvv=|8%jR7c2O)$ILI@#5cXdgU1OU}FwfG|96fR|n**3#o2ADT}Gz1=ejSh3Gt&`!~
zQ&$k1bd_BP36K|Q*u3-|8e&HXA%qY@2w`<uk^}(t^$mzVo`P>rT~TT`>t~GlZ;!>S
zNh8!+G@-t}0Y4_+K=knxrQv>nyv+CK^ZrUj8VDhT5JCtcO1d;jQn;4;E2595Ap3Ta
zQoFH{A>JBki*b%TxH#It*vPQm$F8oaMaIp$IG=GFX*qXLURkZQ-EN>20^XlU>mU(A
z2qA<JLR8X9lB96)YCa<VeGzx>mp0jE*vkMT?FV4QkO8nT?TeQ!O<`qj0t?f=Fg7wo
zZJi7cODplPv<eT)D)F$i5;w*7k#_wKYU^Z8j%WQM7az}bfxGjNuJ~w#5JCtcgph7Z
zt4R_d9}<^%`4@bbkfBuAL0zn0<idOMNO(<jq@i_$5JCtcgpgKgJxOY;=s_9Irsd&E
zPGOUwc<o^~&<YcrUc<!EuT#}JLI@#*5JE`1=v0!_*u&CFT)di((mx;LVQD3#6^|e-
ze}syvYCJ5hgq3+en3@>Fte-Kg%=^L0ydTV8=z}*$*}=-ZpSHs%gb+dqA%t{OI-4XB
zLI@#*5JHGH&?Fr~2qA<JLI`Puk|aV1A%qY@2x)|pBti%wgb+dqX@rs_LI@#*5JCuP
zgpwpe2qA<JLI`Puk|aV1A%qY@2x)|pBti%wgb+dqX@rs_LI@#*5JCuPgpwpe2qA<J
zLI`Puk|aV1A%qY@2x)|pBti%wgb+dqX@rs_LI@#*5JCuPgpwpe2qA<JLI`Q({{f6d
aD2^7ropk^J002ovPDHLkV1fYv0RR8Db)0Je

literal 0
KcmV+b0RR6000031

diff --git a/image/20180117_000612.png b/image/20180117_000612.png
new file mode 100644
index 0000000000000000000000000000000000000000..467232d163e2f0d27c187abd1b5eac88f793e62b
GIT binary patch
literal 35162
zcmV)fiKTXlP)<h;3K|Lk000e1NJLTq00UnD009691^@s6OaaVd00009a7bBm000ie
z000ie0hKEb8vp<R5p+dZbW?9;ba!ELWdKudX>eh4bY)!^&fNe2AOJ~3K~#90?A>=*
z6xY`W@GtCwG)2H*!$MPuT_CYw6r+G8Q4<YdNz`ZziY-AAiShMk1x++IEEtU?fF<JZ
zRRpm`P%MZL3o0yF5KCB!B4yd#dH>jV2UeE8J4-pA=izylnc2B_6qY%2&plU*VHgI4
z5JCtcgb+g1N?X$%AcPP?2qA=!rhtMkLI@#*5JCvy00m!!5JCtcgb>033cd&-gb+dq
zA%p`Id=WwjA%qY@2nQ(mB7_h^2qA<J4p8t#2qA<JLI@!opx}!TLI@#*5JEUW!51Nf
z5JCtcgm8d@FG2_*gb+dq;Q$3+gb+dqA%qaZ0SdkdA%qY@2qA<66nqgv2qA<JLI?*a
z_#%W5LI@#*5DrlAMF=5;5JCtc9H8Kf5JCtcgb+eFK*1Lwgb+dqA%t*%f-gb{A%qY@
z2;l$)UxW}s2qA<J!T}1t2qA<JLI@#*0~CA_LI@#*5JCtCDEK0T5JCtcgb)r;@I?qA
zgb+dqAsnFKix5HxA%qY@I6%P{A%qY@2qA=UfPybV2qA<JLI~ji1z&^^LI@#*5W)cp
zz6c?N5JCtcgaZ_O5kd$dgb+dq2PpU=gb+dqA%qYPQ1C?vA%qY@2q7Gx;ENDK2qA<J
zLO4Ld7a@cYLI@#*aDcDr4%9_qkqB{j((xoS8`*CP@H+b~vh&{Ib@p4l&VCDX)8;TY
zZ4OgoLzo#G;sX;SShO~QWA{#I*<4@K-6w<)LI@#*G$C3H!!VleL`?|u-r>q^0nS~2
zfP@FnAdyIGd=4H@8~wU<z$g7|@QJ-G%uSoCp{IlpLI@#*5K^ka1YehLrQpvq@kn}<
zq4IP0?qY$@hV;bf!97%dZbAqlgb+dq0UAK?m5}@lK}Rp+Zfd5|{k^+bpr2g_n6@xr
zQw-(lhVt}7c`9P|n*t;xKf_%?rqU5J+m7a#^VKKl-^)_nmqiF6gb+dqX=3Va@RjoP
zHFh0~#g#;X!ggI9KKj{pfU`pv4C-qQGh@RVpF8($Auiua!Ih*mT>B>-q7t#f{(g2H
z;O#LKc9w1GbPa?MLI@#*5F%GEgRgxj<FNa9tim=UgJy7dwTFkR1B?ussjRKSA`y<B
zyN!dVt|PyoSYhAvu><hkmrg2cix5HxA%qapbk(ciOH?Apy1h||yn3JA#^Y&Y{IEWl
z_IdwWjdE32enBzz|2Gatqi-vWgneRfi~pHD3i^7wYHOPiLI@#*5YqV7o8U{B_YO;c
z3s;!iHK>m@7EX4CMQanz`tc$w51S8P#N}Hl>^3WlR@nH%7iincn6rKmLI@#*5JDQ4
zdJ%l3Wn^K|#$$M${g&P4?rM*D9z((7X=WYh;1gG{_rz89doyE0teN*YdUvtVNPh?+
zgb+dqAq|_xgD+v;JIq*dkPW<eJZ&ubW&}PT+Dnt&0sur_y^nQ!qu4Y=Gh;*SSuvSL
zzz89P5JCtcHKv(irT-@?5o76Z;cVb#WY7#-mV8w&0xtk?8~7o%`?<4o&4hXH;PdNW
zC@d0bxMzeALI@$GAvkd00D^*o)N<~qs3@#hu>w+Q`6ZM{{iM<0Yu(-`c8(X1r;UIG
z<I&HqgC@IFP7j-Q*zm&_Y{8ARj4UkQaZ2erVT2Gu2q8rM7>0pVDuq}qhD0LKbayHg
z7#N77M~~u*FTPOA`G*c23ZYO4Z*Omul$5BY4We2a3%>T9j8mv;xa6A=^)B#|v$Jdi
zzZtIV_g4}H<x1fbLI@#*5cPWW=n*_UJ>lTsfIfZtpi7r7`0cmfG~F$w_V3@1{rmT0
z>(;Gk-MY0}+Gy6S88&a;j90H-VfpgqYH5S0mPUfFl&7y1f){sJ`+AdVSdkI^yW!jM
z1KIBnoVt#L<YyY}5g~*SLK=hA)Ku)>zhBecXb^Zj9(wldiC(>W;o-xFNKa2kyLRm~
z-K}!&+_?iEA0KSpx)q%}cUEg#d_Et){`xEa_~Q?Rhli`REmC(HDY)VD>tDE%C;%WU
zCm*n2oW`me)|CI&|Kh^UhX8=yT`aKkCr=Ich!8>uAr0C7{rfR}`gGKT0@Mx0^XJde
zyLWFC7Z>B|)vM^)v!|xJ#F9uPaB*>gxw$z)LP9ue_qX4E!=_D}aO1`en46n()-I_T
z&Lf_L<Y#Q)#p7vX;bi9q6L<l@4_|)@T^&9EAn8$t!g^qY5JCtcME&mGy$hjG2wPiQ
z*xA`>x;qL&Lqic069a#Le@@$-I&~@}5(zeJ*uZJKq-HpedV-E#W?zpV)`!ytlvTmZ
z*btLPIkMmHIC7baZxBKVA%t+~%9SesfDb?X5PUvg!@Vh0P*8yN>(^uC$dTyYy*sCE
zo0^(p+O%odxpOC;J)@~H^%bYV*X3I&Y;{8;gJziad4DdOSD8s89nrG6J^<j!i)@9$
zA%qY@2q8qhE?l?(0BWluSX;5NvABEpF24HeD`;tHao)a%hX?ZW^Epj-BsIfn@b%}J
zc=olst3A7ZRzo8T90#!9heh4eU~dQ^gb+fSj?BzVq^GAtS63GuI@GU9*+-8ag`S=s
z+}zwW(!Q0I6+ZgtBOE?_m`cyrQ=A1~!n}7#dXxbG(AD9?!_|SSrqyEnu-@$2Unx&t
zBjZ($hI>Q^A%qap_$4GHATu))J$v?qy}doVJufd01qB5f>sM}WE-qfYh`xRM!r0ij
z#_!L|%Tu~$8N)Eh&CRXWIrR1QVP|KDd-v`^AQ05J4@CVq3%;)0F8u-MXV(En2F<u?
zS}k;S_!!d9hW-A+%|{yS4IzXOLP*na=gu7fK-aEa!7vOC95{f53m0Pa=+PKAZXEpl
z{P6nqYtH-i`0-;11Okj3H?BtW(9WDWgSm6(V$`Tnm^^thLPJB@eHSiVz|5I5F?#f9
zELyY(7cX9{@_f$D&X7nXxOC}KZ7zeT8D}#T&s~4OzIJx#!d0_s^>HstcD~ou#58<8
z=3@=_h!8>uA*69Ta^wgAz|qkWbLY-Q>(;F?fBt+J7#QH?%a<5Fd^paZKac3>=vs|H
z)z;m+cL4x8Iy%)lo?#el*suW)9z4Lpg$rSBZjS5MuVd1rNyy8~gSE9a4jedu#fuk1
zM@I)smoCNFv14)R(k1lk*RR6!e*CfQel#sDt?m~^RF0G2tFTCfga@TnR|fU9=Av1(
z8`94Px;lJ_O2kNdl!4dTZ((lQT+`hmgb+dqX_Q{Qdc}@v?b)*jTefV$r=Nbx?r+nk
z4Q9`tjkRmn;^fJb`1<RwYjpmSk`nOw{8|;uxO(*}0H9;Xj@3GT@7}$5^5hA2@7~Rh
zl#Lxb7M7NlShZ>u?Ck8YXU`sV?%Wy6moLZ3lP3WH_wL=RH2Bihl}(Fz@Zdp(#}Lio
zB>0NElg^f7@7=|sUKHAR^X3h9?b-!%b8~$2%{R3=hrXUJdUt7$oA;go0InnoFn(Ac
zRd$mQLP#xTWMp9T=FNEY=n;yGi&0Qe03RP8j2$}`IXO94zkWTElas;Y@u01(jU`K#
zuuqH$x3aUdv1!vL+`M@cB9RCM1qE2Ra3MTAJRp%s@awO?veoT)JRZEgy){<QfM`}s
zObjwJGr{BW@bk|<D+FG0`uehp)Q=ujZ%W9+hYt}O8;k4LuOl-v69xtb_~@gL(4|Wk
zeE#|8)$ZHNmoK5Cql0eUx>b2>Mn(pX9Xp1@hYy!aQPkDd#q;OSF?H%xbne_40MNX7
zbMX0mI5|0C^ytx*o?A~(55~sExOVMYwfj!E!%6V<Br}_R-Oo<-RcQ(f3z46nj}Jch
zpwi>SVlfUJIDnfsZ=#@}00#~nKyYwyo!ai(tpgi;{hO0tr*jcP2vLpH)Kn~4vIOq#
z?pU*C4RmyL@XIg1z}?*)$B!RJL_`D}9UZY|%^E~TMq>K(>3H<$5w2Xhf)*`WXuA7N
z%BxqeFmK*G3?4ifM~)nUzP>(!gM%?;$`lwH8shHVyU5SaM_5=Go<4mFcXxM8nKA_l
z2?^C6VIYl%Jhji&)fE#bPAs=yB9Y+w_3Hp+qhOWE&d$cqKmUwt*RJ8qFTaGBmlsS-
zOi)x*goh6wV(Zqe_~n;huzvk|3>Yw=(sKc_`%FDOJ+x}os>)-3|NVD3J3GV7%uHc>
zUS1w@a%4r^$_80JK0f&Dv(M0}QzsZ07*u+0eSLkjY10M|A3m(IAB20H6x_&uQ(Ae(
zv_<7VFtu^@>Q(IAxwFdSw6wJF;fEh$%9JTsym&F1HERZjVd~U&*)+q~*>CG~E<y+)
zbyrYO0DpgfczJoj-Q69{nl*#Awl==_;tS~L=-}(GzlNcqA*M~628l!he}8{uWo6;b
zn>P@NM4Ik?lOh(2v3&V*j2t-<^XAP%ixw@Qqoady<Ho_%)D*L3%|b##0)GDaXS8V1
z0;^ZA#{K*Ek(ZYTp-`yl?h_4&jEn>TxVyVUTf6*iY<_+|Zr;2JKsG0=B57%9aC39R
zxpU`m`0!!)`T3!5-@fSFxih+T>xQvo$KuSHGjMct#E20i@cZw-SJ^kIR0?fvZSZ)!
zDvupCYLwE<tE8kPWM*c<#>NI+x|G&P(AL(5ot<5kffpc~b7o{@RON9*GdLOfDjSrj
zV@_0YaWM)D3#&Yi$K#=Yf7!y$>FMcp4!i)x>k;O?tMmB?A%xV;;lqc~zI}U)7%@U&
zdqF_~q*5vJ^Ybxf$`k;yzY9Z#41rWC#p1<_t9)WD6bfN#YO0aNQyZhm$Ve0v6kz)F
z=?dG$Vlnu9K3=?dfr%3*qFFOpg=BMca~K&J;fpW6K=<z5D?D#eQ4#ojevK;5k^1l1
zvu8+6O$Cp~Qz$WCR(yOs{{8n~bnMs>wzjrPk0~f9z&GD~gXH97T)%!DUAuNwdK{n6
z$A%3X@cj96%$_|P9Xoc!@ZrNN>|agpD;*q^FS+#K!2^gyBG}s6!ra`v+UF}vOG~R-
z0U*%~PCk{g%LFB+YMAe(rKMHlKZL3Xya1qObA9%;FqeWaLI}~Ml9Cc!zI+)!{P07$
zeaXqmC@3gE@7}%HIT?IDA6vF;fk-4`C#frwk&%Jm;9$hY#v(jCoSrJHfK)0)SXdY)
zO`240->X-zkd>7MGcz*`95|5O9vB#i1q&9SQ>RYl0xPLhiX%sk;KGFqc>Ve{#9}cz
zb?SsEQ>IiaWsKB+*REYdc6K&;_38x+3k#*koH=s_QmGWfhYyE|iHXu<wr<^u*w|Ps
zTeb`ze)wUfZE9(0Va19SIDY&%7A;zYxVX3qfB&_$wZSk<o$fKuoH+vkaB*>|^*O|1
zu}0TBBbDPM?NHq#Uz%iWBn!S6Mv7}uA$a-nrG|S%2q8@ukH^D*{_`L7?%liGzJLDt
z2LLc=(4caGma@R>#ful1J9jQ7OqhWA^XFsj+O>H4^r_NCP)W@(3<D1j4-6eTwA{XX
z_wJ#jqy*i&cSq~it=a8*dU~+7wk{WV6%`d>-n@B;jEsbbhX=N8+lJY*XComY0nX0O
zSiO2Rq*AH6FNvsGVqzi~hCz=WJ(QM^fBW_=PMtah02ni7jM4}5LZJ}5cI|?pp&`Ed
z>Z@wC+pSwSj2kx&ckkZC@#DuUJdV%jLnIO*FE6i}SENWJ65-aZTL4g}2L{E(#SjXG
z(9_ea^*M<8Q1Dep^6Pn-9D|hjDA?KAVe{tA5R1hc?inG3G(Fnd+OV{=EH@WKDwX2z
zzyAhM`8<%ajE#-q>FJ4|e)<Vpw{C^Cb>mnjrM}?tco;o;w9+{&v9YlL0DF7;YOR^H
zd-rZI41@jq_hZ<wVX&~Uz-OO*hKPs=*xA`(`SRrm2?<g8H4yHI#bTU4e;$BrzLYX?
zadCL~@FCi_Zx3f@X8^LIZ2R`@LrF;q0NDb~>FMb(Gc$v&tu1cfzFld%Po6x1P$*<m
z7_VHpQsJ=%1_mf9Dynvs#rIvfZ~?Dgy@HL6jndDX@bK_zEwWrtP=HsjUR7F-o@fpy
zX@};f&Dj7<9cy9f>FHH_K|57@o&6SKQ6Vytq5%N8xw%-hXc6}A-HV{0AUHWWX{29-
z5JF02W@aKeIT?C-dJ1W5l`$|dU_Zm(y?aL^Cmbm*E@q$pSLbhNad9z1LqpNFZChky
zWGJMgnV6Vh_Uzg4^76u#En6^o@?^F3o2XY-Ru)^mucG-<$BrEX08E-R2`yW;1OQyR
zbP3VX(U>-E8UR`F1;~EC3kwV3?d^@;y?a+!$l}VCD_F8*2^)OH#l_*xn>R|UqB=S{
z;?F<-gg_vu@_M48qVV+TQ+RrMvT2NW?%aV$BtqA&UCYfsEiNv`{{8#0a^=b@&n*^<
zA(cug_^PKGRPc55=uuq1e!X0}fj}TYMn(pTii#ArOQljYZ{8e>7A;a+etuqlA^5ub
z=rZ&hWG0?QUREXmSt-=Pg9l^ElquM-VMCSWP6;7|s84)+JUdsULx=K9o=BzAO6Lz#
z;KiNv^mIIW^aw^qMoQC1-&a^zh*z&(AucWsuCA{5?z`_4_S@Onfyd(^F)>kHT_zkj
zckUeW^77#5=!mv$+m_p(ot=&I=g&h|R~KJ?`6avk*s){y=9_QW-|eidEC7I!krDWO
zKJxPN5EK+tW&84y@R^yJC@3gU8hpuvLis3LMNXbPi3t-XKr9wRTU#67e)}!NVlg{9
zt86~okt0W7VPSz@y?RyI*Jsb3Rd^nvd7K1aWs7WN*P$YynVFf=4`PW#g5u(0rIn9#
zbaYf!Ttk`Mx3VgW#%*meY}iIvXg$H2HEWQcFI)5L(4j*(b?OvWtXKhWZ*Qu+L<k`o
z5EmB*hG8&p;6Qc(RymPKgw?B8!`s`t*44#`>Ley6;@!J<aCCH3dh__tKmVX@+qUf5
zp2o(;m@#7pE?l^PAw!0gJHD{65Dddmk(37R;lqbu7zW+DcSrN)<sahf=;*+}zyN$c
zA3b{X002ZpM1Wx!g@u^q55x2G^C1?CVQy{?Z*Omyn3$BiU)0vtMp#%F7>2>?*RKHp
zmX?+k{w!HqTB1dZ7Px%*G8QaYP+`TvbLY-MEEc1E`}S-a^v<0-(W_T4WMpI@BO^oM
z_$ybg;MA#8_~n;hs#Rd_<jIo&fWd<YS9vVq9w(82S()IgE^A>88#YYo_Vee@!@$4*
zQ>RX?^|@=S?De#1)e=i*d9v$>g@%R#P)tSKx^=74$;E^aLh3FjCkMNC?}mwq31-Zg
z0Y0A(u~>`?7cKyR(g%3gu3f{!hYu^Pj7HSw&6_vS*49?InZ0!B5&)o2pFV7fc{!0t
zgr9%@8SB@tXM-;-EiL%_`@`4QSLp-JD_5>SDwV?3)m42LLex(Fb5T*L_vX!;!`s^%
z3l=OuaBwiRw6qWx7l(E0)+zj4^z7LafGm~R(9jTJVPWjgk}{)5kA}9kHk<C}=;&Bs
z@YSYG8w?sW2p2D2L{U)@3=Nf6`2P0WZ}GqX`@e8?b;X@KcX0gpab#p<VB5BBID7Ui
z=FFLcRjXE^bLY-TOH0F}N00EI|NN&~BUuuO1gWX1u&}VG*2pp89w!AiJ}@c$AuYS$
zvZ{zgB8?TeD7&_oJe|_Q!U7>7A&8ESX3H4^vQ$K8XJ>eNdX{^tK?otF?)?4zv2^KD
zELgArX=!NyWGRR8l(Y9!4ogZ(uzUAz%$hYzV{?a_s=xpK8v_RpgqxciJE~AvSjZOJ
z=+mc9x%XVUbO}aAMoQOjQWki<di4r_{P72jjg8^s<D=p$AYAhC@xjK88!N3)ID7VN
zL`O#>At3>LJ|8=F>_F$vofVGh(W3{tb?b)LuU{h}A)(U13jhoa4biMwGu*p(4*=Lg
z9?I}|Jd7PX7H{6XVSkR5>C>kV;^N}aqel;%IdcX*di21yZQIy2?Be3$P*hZe3l}cH
z-rgR&cI~QgEwcALfBqb2&z{9sUwu_!@JBR@li<sub?MW@gyd&jG+8D2)3mz&vArjF
z!M-+ap*UG{`0(MlbLS4$ty`z?lq57X6n1uYSigQfRYfF(5EV*FN&+BzT5WA@jW=)J
zV9S;*m_L6$0I(DG0a<zSpMU-tAAa~@r3<GL^;olJ4es5$hg-L9Av-%8fNara`I0T~
z7eJ8D&6ziEUbPpH_4D(?ix)4jZQC{~KG4989Xl33{`g~+_icj*55^yV{DC=h<|rM_
zZrQRW=Fgvx;^JZ)K76=ZZQr_e3#U$<f|HXIKL7mlN{{{Gi!WeeV#22WRitg(wwO0>
z9u6HkgozU;Dx^bOT3TYwnl;$BZy&~t8B?Q_*{G-}NF)-tySrEWJ%n4F1YeHbJAucO
zHFZ~z$<C9~gnRey;nJl`*tc&VL?RKw!oqO={P}8??tEWikqFoRNoT+R#9sN6xTQ;%
zA|)jSQ>IK|x98{Q!_UtTJ$v@VxpU`gcQMrv8ym|`BA0*3(;?qyV`EdT;|L+7zFM$g
z0XlZ<2zz^bgoK3P`|rQUh!G?3%P+rR<;s-^3JSvZ?c1?;?_PZS?YA&BHN}!8OElf>
zCP{v?xn#)_bnDg)Nl8iAyLT@RA3lsuojM^rJe*xqO&}0p-n@AjIdUXE{`li+oqyfB
zbvSzTDE95!r||cekXf^4VaALZ*s)^=o6cB~;^JZ~T(}UeTD8KqZQH6`JL`iFKEV9>
z^AQpf!j9;2MJyI$_wL<rb92K-AAQ7W+obw93BFo3*GIo@vQ!U=M2gF|QdHhXb&G1e
zdi4tb{`)U__wJ1|XU<^GoH=;=_AQ<~c~avxZ{B+XQHgBi%C@6<rBxi;v}uEb2M;19
zCWf5|3IGotJiv$%Bh-?Ln3k4?!Gi}wAP}%Cu6ucT!PC>T+;F&-mKJPmY}n%h0s`Ra
z=}7??A*4b1>Z`AC?%X-FYu65ig@y3*^TYJ%(*XcK|NJvTLPDUcs|y~F2Y-KmEMB~r
z3L$C8nl)=Ma^y(7di4rEK0a8rY893)T?$uMSA>OyAuB5j-+c28e*E!AELpMyW5$dr
zSIMv<n>KAiaBwif!^0`?BIU?a5~oa=g0H^%3Q<u}N{`FT%!G%B2cABCiW4VJRC^B9
z!i5WAWMovWDvGKU5fOoV_wHfcx^<kkOKL`oQD-T@GLA(j;Fp84#qmC|w?)8$aVk6a
znKNe)A0Ln9%a^O{oYk>%=V?S<y$=BR?n@_3A6vcE$i-qYwr$&nl`B^wH#e8vZe(Nx
ze}8}Y`1q*pW*{vs4c6Ay2nYyZpY{d@2Ey0Zw_E^gV`BpVNKH*uOJ4{fq@j5G_AMM7
z9KbLPZr;2JV`F1Ycd1bjiA1=6|2~R~i_xuHH-&%Kf`S4hCnrNHm7+_RF4g`w-??)q
z_V3@1J$v@B#TBGdDbAlij}aqAsO389YXAQIm_B{FTB|dY@+1-o_U_$_;NW1`*w|q7
z=+WrXr3>D@dxuk}PT|(ATd=aS!ip6u(6M938lC&tv19P|_C{=MEPFqtPDMpU=-<CT
zKKtx5tXj27?d_4;<7DIuP)y0Y_D?zri$p3r_sEeWIS;%f5-G0TDNQ*X_EGgFLIScU
zE(;efL~?SnMp6;qw|n<)rB$F@TwJQPP#__MG<G~5k4?$0?tCLsHC<g@^y$+FAAkID
zx!}sczyS94_HcA`tajja=+GgYK7AU;jvZqIFF+Q^ZP>6urF|z2ACJewci(-7n3x!N
zdU~R`xES~E-^b&}kI}t*ckJK4AA9%it#RN5023xmfTyP?yu7?Pncx58k3XVi%a&NS
zY?<2IB6Y)A@MUh=9KE~9N@R*k#5j8HHdjrn#p#&4?A$er)+XrG*0jdw&_pVti;D}a
zt*sU2I0ys+SXo(>J62vHsIrPZgb>o0Nu^RqBoYXPLKGAfprD`t+1c5UNF?lhBvL;d
zKYkpC4<E+5b?cz7ua8%+Ug7oY*Ld~n6;7Nup>%C1LI7D2w$DEM3^QiTz&GD~gK5*I
zVfysx=+voGoz5E=7>HJ_TEXAnUqwAt?%=_LxOwv?4j(>TZXH8X|8N$30l;TNN}oa<
zJarxU1;t!8uQH+%F?Js>4M^Nw>Q+I?$;k<~Z{NnIO`FiNWlMIuDykx;rKKqp(EzHS
zMp&CCJ%kX_Smfm7z|+$c!-frmv$HcYGBWV|`ExisJLA(&KZT2ni>A9s{@>ZNXEA&B
zZ2bNA-xxY{D6Flm(Y0$=_UqekzlF86wWhmCniw4&9RvplBO@aNzy0=`TH1(>jYUXE
z2*Sd`(7t_pwX{K0i__q1^xz(_?Pv}F$S)|y{{O~t*}TdeICY&}-^-%43C0gAzZOYN
zsVf!H%F2o@qQNi>TwGkBrKN?yz`#29nGix6GZPaNgoTCS@4x>>YHBK^QYoZTDFgxm
zE?v5W^XJcNx{Cy|g_?bQd>|AGQCL_Ap-_mtygcOP<smmW7kPPkC@Cr7WZn%S?=v(s
z#Noq-v0%XhwVdC{$q5k=5wNthRLl8^>Tw!;0l=KEK4D)UjlPW+S$SM{p-yt&79uR_
z7W@5oUpld6^i`oYsfdArf#u4{%NG}Y-;NzS;OgoMUtiy9_o-dGcD1`0LI@#5&04f*
zfq(w_N8v%Evajk^N+g63b>cku>fg%}{p@6A=S3xAY(8A`^|dr<Tj(V=UDCFrIY#vF
zrj~Z9N=00~dNqoQiU7#gNO}K{jIudga>IrV0{}Kav$nQY8mwKud>H^LJr^N_5JCtc
zq<T0Hz5u}6V<`Lj@~spEpSYrlZq!&<)GeHjxyydPaPly<wpUpy;_~Io(X(eyL`Fu|
z_`HuFKL$`5RJpjgC|%>??AfzQs~}^(`gs5VAOJ~3K~xe#2qA<JLTXMU!Izz78-+Eo
z_MW(k=xYx&(Uoeuk|@B|&`a$1<A?QONAT3GY${@(KBe=^Qd3hga^y&iA3vTAsLBcr
z4TYPVTe)pPK|u%z2w=DQ`1k+-=FFMHZVL<ygg_v`Pe1*n;;SKq5JCtcq-o-8k!59k
ze+$RuTPXklT^&BQ`?;fsP5ql+l$Mc&ng2P=u1)6Hy%RS1Oi<}uuj&$u#Rv`#hM%9G
z!UD~DdV1^v&3bxz>~=Rdw{oLeF)=Z4a&l7GCSQEHtcps|6G8|fM0IG9WkQ+`jRs$Z
zMIy}n&tarxWB~xoj195jhc94f*+x@cDkm)?3-bexC{#Dxw{j|s44P@QUs+jM@bmLS
zaB#4~b{iWTY~8xG+=v$;gb+gNCknm@X*x6-d;!3VtUSzGd6*4u^!0S%H^WtJg)C~~
zN}>SEcbsBJy!7>Sv2W$nS}mxoF4wMI!@PO(5Fa0}uzlRPaoDtJ6T46{A%xUcMn*=h
z*BT^*RPETYV_3X+G1Al1HQg0LnlwE<J+x_~-a#OZ2VVe?^e6-VTmQ=jU;yy#_<@)?
zevroc6c%+0TSG5FB9Q`+1zwwczC`aX78>hQMQWOgNC+V{VQFcpbY3YTgb>o03>`WY
z7cZ)}5_`P}z5v+>n9r|&u_=fEFwC(le)#%Rm>C;#){oq`h1eE)NujEtMQamm{Namw
zHR7cVr6LkS)ZyB-YwXe%gb>w>jEqD;K!DnB`UoMFYuU1;LUB8Fs5ikEAe#fWe8(wV
zNffZ#banWcI_4vIxH_nHo|ULXj02~xBP{9`yN(wiE3UD2-dK&#@u~?*MI?j}LK+U5
z^F>J0QLln80FX$e*nK<}2TomA*xs_aKBj#>027AyRcVz$iA0LiF?X^1c&tL&BOog$
z|Krq8HB!~Et|%3e5JCuP7%2E6r0J-4!IxY@@-yr{9*d+$84BC=^>i_$pA81~v4&G0
zE9mR#*7)3oMIzk1_XHPjKEky->BxOssIcF*qd68%9>&=^Ug|`th=dSANc~2^7a>hY
zy$!zPF5gPQjw6@x<VAM5eY!e)^t0=LUbgLFZrU8?rp?i^xju}I^kHt=9IvzAA}_xX
zxo->cI{PhzdGByf@B-KVNr$MUeB~~S)+YGwOQ(8KX;IZGN=0;YbHmoHTVZ2kqoJM=
zLI@#E8wFp4G#&Lm_yT09fst45<IgiU6$)~wibZP^xV!Yj_+fn-WQt*RRhEkA<KqK=
ze}76vB!mz`I7Y!2Ax%ev2)@e7c$I_bYY%Y!&f{_^i8W!{(Hzc>T`=sUuJyi(p{mJK
z5%=%kudsGc=gyt6Y11Z*8#hjay(5GWLYfu|zDgAp6=CPjop5k)fRmGxrn{pOxw*Mm
zxpF0ZeSOuwh7_s)8eH&I*6ZxIxO^)G*>4Kiv_fI-JLKid(hSW_o5R>hA1#~fvuTN@
zEe!C9y)Dd5n`^rJ8W$fQk9qUv;o7xp3fn0akq|-%;SL2~Kz@EcHgDdH?c2AbO`A5@
zw{M@?OMY|Z<;$0tHER~mojZr`zyF?su%?b7P2Qe8dze<OS}_3FFFidy=BJ;2VhRfj
zHQhZz2vHe<K)`r;c`+s?ChX^(gM$OJbLUP?ca2maD=Ui$2nb-Tt*zPrGiz&WX4$f3
zOjcHwrn{#S`}XZ)n({5#+qZ8SCnqPy$jFG<vu6)eQc|M!HnXy_n2?YV#@*e$+~+|+
zKtPp0TgrYeU0q$7)2B~Y_@0XwFETbZHcXo~ZI~A?Ua0z#)UGzyOv-Dzzv)ClPEHQ<
z{rBH9d_G?x2<zOrGjrm^2~Bs85JKwg^y$;=O_qs?3FGSO$~ZVUu%CDC?(UlIB6*KM
zASidE=j!UJ5QH^`0IVqoUnM0a%$PA_7(SoRoH=ublQsha0u+AlV`5^Mn3xzQARvJK
zjBs#psPJbiD=Ulr?C|pPVq#)qn2?YV_PxuNEvvBY^z?M5RjXD^w{G2-fB*egU6-hG
zb-8AusA>MDlM3Cud6VhizrR8N27qyMb7N9cQZ(H?LI|mqtgI~dCc(?gOJU#X)2G?b
zx`2QH4fT*HBM-FRzY$JMOk{&HS65dJ_E0sNa_}{6+B60Lvuf2U&f1j!T)qEUz%UFG
z6BASA=fSdN%ap#q?0aKkVk&I^%$YL`0LID5iIY)2RjBJVlTuCdH=R_8QV|Iujfwn8
zw}XR&(*5!q3u|j@j(bKbQud}!*$710pjjXgXrPCx(^P}6^z?Lw&*wAUx^?5UU3u_T
z(a4tkL5;G&ULX)u`g12A9ja<1-NVC!0ni|_i&S;ZM5gi9RVQ^abLLE>q@>{c@4pA1
z&j%o@K(u=GYS`J?Av`=>!#yN~km}pLdp7{tXPYu3M~(yl2m}J8rKNG!FH*5T|NIjG
z;O_1YGc&Vt`$vr$#lF6A;|6E_BC4}}`*w)MVoaDYfzx&)BO}2ujMASg05CO`Rl&Bh
zvMRSPIyxEvU~O%!bpOPO69E8WVPOyog%$R}-Q67kuxr<@nsvSmp-_l9bLPO*)D&7;
zTJZ4jKxk-arSAz14XyEKoT{#w$WZV_D%7%NO9TZ4AucWs{rmT4w?BUT7~{u}$H<W*
zk(!#S!5$JqNc9K=0suhw?%kE{FI&<&Gc%KuK9S1FZxH+S>sR41uCA^CfTvHNa?&TF
zoID7yv9W=cmKGZbL_|cu&CLz|{{H3OQ&d!h;NV~Y!06GVx$bg>l9H0x&x=WuCY9TN
z;=~C6sIVgRz<~qV*U8Dr6}IE%<_04pBSc0<;=zLlwd$*zn;U|Hf{>Gw13(u1czSxm
z&CN||fR&V#1W!-T8b7R1)io0t3cg5{92^`F7Z-;;d-kAJt5)px$jC_a?Aa5`moG<t
ze!d2KNC+Vni;azCU)$N)ReAi?t5?<89a2qEQBeSZ9zA+gdF+J?7u4MyQh}tTB-q;8
z;_TV8*s^5{7=}SsRu%wRP!$ywg^nFNmU~}#csO!%bJ40*D}@KVnj{no+0pTkkPxNo
zjL9E5+uPe$dA@u1?p3%?PfrhSZf*cj<!F^Mfq{V#2m}ZT2?4_}5C{bD^6~;8``vMH
za6n*SARB~5L`1;Z*%=NF4)E~ss8L(0x@ICn!568vs!|ba^Wi}VAzZ2`%?KzRMIrS|
zixw>^+&664Fb;b{-j|e=1ZQVw0KoO@*V$B1Gcz-Idwa9TDI0Ol$jAUt@n{N{Vq;_B
z@9z&=TU(f!nIR@7rosS4J}PExY^-#DyLRo^*Lit)m9{It_9suC)TqBgp%A{lzBqK~
z5Zg~HD=X~Su>*;TiEwamKu%5$e0_akZEX!LEiHC*F)S>sMr{GAy=Fqe7pb9&QV}yU
zGT`ayi4h}4)Oz@w5JCtc4adxxGm(>%gB?3|RQg~;*$C3}=g$E^A)|(Cv9Ynx($d1<
z!Gp1O?ONpI<S3ofR1-CMzx?0q@#DueYQxOT3?U&Q3iBT2diU;)n>TMFBqRh54i4;g
zFE1~|$H&+C`jk<}IU6$yzDTXeQxW&=+o!Nf`?+)H(6eVx`1$!!Dk33-5Yk9RL_{Dy
zJ|5QA)=Ec-<mtO*1AwyRBVW}CzU1@BYWr0-^|&lMJ3GY0#2_Xn20M4|gsZD7f`WoD
zc<^A%nKP%l{}i<*zjpb*MNL$dI_TlyftxpPf{|4=$BrF4C`hU&DEK0EGHu#4Bqt|h
z;lhP%Dxz2{#`^W^DHV|rQtwn&iAz2Sy`t0_q8V@Ays2<sLP7!nSyl$&)`0^D0F+kk
zd!PLO#>K@&>3;dVuuh#isiAk(V`gRsCnqO3IXPkW?AeHnj6_IC2ml}`C<uXpfog5P
zbLY+gY8QL~+*Layszt#Usk4?XTVm6uO}KsgwnAzFr6LkS>VvZL5h|<1C9fD(QAI?;
zEo*CQ0Knb5cPl(5H#ZkR<rNW$dYnCb76344(4b29_w3nI>3;bG+v=1imyh1m_DfmX
zV?{hXJlN4X`4Sb%RFo=Mc9gBEVlnanv^Eb9ghC-_)ehxUam|E+FQP&{dh|d{ObiYl
zJV>dCRVgWiL=Xe<tv^u`vmGUoD<S%8A&L)9Mp2L}iVseP=&yw+iCl@2%UdA6^(Q2$
zm%tR!L{>s-%F4<LCMG5TDz3zpl$6B2u1-ZnqJHulVEG7&GV+^9y5ZwiT3Q-=!>_C$
zN@!>(yT78}CkqP;0Hpy)eIj4CN?vH9EO}v`>Wm(>Z{NPs{qk#<|6A0=ufP7vS+zq|
zUNZssn(jbd6c&jPcPAZBGP9BWrU0+A-y%Ej9bRX@#p~?1FgI-ubJON9H8zBqu^~P%
zF@i;F6F7G7gqF?qHQoJ2Ys!=<7&B%JR<2x$ZQHg%EEcn=h=&dx!iEhSYW$1e7%&An
zkUqHvN$TH_X8r?6B^4i=p9Lmg$sZ(b9<<x_0?%?Fv^x)kmXYQrDihL>xVX3=EG!Hs
zPMpB(*|W>-moIc$(Sp8&d(O_z2n!3t*|TRM6bj4zzsPU!O-xLb79Jq#Q`uU0@>Dpv
z-o1M(Jx-o(`10jT)pkzJ<nyK~8a<Lf;4v{Vsqot6<kw!);43XH4Qtn~#p%<h*`IxR
zwZqx7XJh8fnTU^%hp(?Me0_b{_nDZO)T-K{DzBL|z>zOu-aGvF(m$9Va0DZ~w!(kw
zf3f>`ERIDd;PR~$+)d5I>+H7xfY;e?aW^#+mv5!u#DzrcJ|2socl<BL%-@0e0Y`8w
zI)Ocws1~InmXf4jg(&<-6#wCYl1rN*&A44@;8iK91k#M#D2drF8yyS(5t0XIRoh`g
z8X<Yv>!_$GHqep_4Gl$5P>{lLMDr$0m;e(K6XfLNVEOXp3h8M{NlEMt{?esOHPuC;
z#N^47*$1qZE#DvyIBGlJsV>~y+$t?`FCT4H*8eeM#sH9|DVH5Fm%DiJB7mw3VgRKT
zA8Q(XSy@>r1YTvSquQY=ubBW^48t&*?nHH5zLkPM&%`6?k?Ma*dv~$GXG3~o^k7O`
zP?tl84q@@)#R^Zj_<TNme0<>V?++s*BMtUWJ*1icKz!|YNM9+RW1`)*2ejMuf|h{^
zVAu*;1}4xl`~X@;tz;u#@BRf-kORESl8u^W{v$h=lE6*7l{NSu&wzGE<yEB!A%MTX
zKh~~Y3qUrX$i~J7si~=KYEei?2;Dr?GZ7IH?D|9|CMNjkqmLjI3K1V44?uQ9xnsu;
zO?FWw_V3@1>C>m9f!vY-kX0ZAWTVCMA`Wxr%z>4a6*_nB3}0VgEL*k=Yu2n$`u@bk
zMD*?37Xa|=*|S=u-qn_yn;W8{qOf!4&T=E+Nl8iQ)29yrR2bkmIyxdgKAyey_up$`
zVp6R@$JW*ssi~<rc<>;mOqrsBD^nj;T{CF_!B;}^GXx#IjJv7Ihq!xpu|Pk&4lr$D
zz@`|=(+%b6hw@a!>^B8SNPdR9f=oyx(sJjr?P!iUUwwl9y)4yzSxr)IZmvQqqMU_=
zMWaeZlx7JazVQd7Pp&KO;ORoUeJ}8=oS@yQzbxpgA*Lt~()6p4KDhzO(|AB4QrNHE
zt{3<NXF>aeE_JyCLK>}zhzM-ivIS95Q2=B&^e!$g@b>nu(WHFBous5BtXsDZXV0Ex
z=MlNOx?<Y2X^rOZMnep~=FFMHju^{1I5;3OG7^&~PexQ!RFw}j1`i&L*w|R?*|P^T
zXU<f2ms#@Q3jmfaTZWM%M*@(Q$6vpGJ#un#Dh(Xvi%aL^<iOqC9p2vF$jHdRPe1*{
z&cmweXHy=0wrSG_>FMdv)6-M!MXH!8u9?Wx+u$qZ>1*sd7K<y1ijy66b@=FK*8$EB
zT`;JxHO!0+Ykcn9w}rTTD+O1Q(s1pcbcjmC3j6!nb%3|WP}o_vso)HxF7DpF3okFP
za_epkA3hwLHf?Iq6Q{+u{)G6(ABr2B8G+w(9C*FPL#vqzNBBw#A-?-xh;JVOiWLi)
z@a-po|Is(9Yl{#<h}ty7;7ceJV(#3z2n!2?iHQlkyu9$k4?n=n%nYWcrpU?3L1JQJ
zrE`Fe9Xp1J6DMN$@ZpG#j^?cIX=!PQj*iB~ix&|eAJ2|{TU%Sh#l;1aCQYjHVN6<D
z8a8g+s4(}?#l;1Fety-O_q2TZa;#px8cUZh#kzItRB~PFR@ZALGW9a}+IKPzyN@g0
zm>U^1gS)FeJX{@MWYA1yZ50-YaP-`596WU$`31!a`=*Z_fbYJfC!y+6Q7WRhw>MU-
zSkbW7ZIOsja%nRpkIt8F)8>Kq;b`#fC)H|{tGbxtd`J>PAincog^@6x<v{3sx&+Xn
z;xdE~QlB-X;7dN&uA+3$vT119+1ZtzODq<{($W%HSy_mSi(}LM8oQS-U!rHvp2*G3
zMS6NVrzw|2^XgT>4N-|0D|en&2)uYaZA=)^51|3yV&?ckDh<2<KwnQ6Uyu11Cw`rc
z$)g;ht5aG4a^J}~`2H4-!Xi;6XCSpTWy%z#3p8)uycu?Ob~tqCkcN9$JxoCkL?@Rh
z1YX*mK1MT-VCW2<tJc5^0JNGJfj?jtnt29;XE~7FE=j+N;=dMxdHYJO?Gr)>X&M3p
z0}&Jy#4g>S%#kBU093E|0-w)ENJt3yd_E>loY*9mqY;b6m^yVTva+(UZ{I!&yqchT
z6MPBt-eK;#FhpLx&u$yk#~PvQXW+-FpVlh9uqKQQn!(#+C_)2f;1hdWcKhX9DVX`6
z!+4QJ>no{)yei_IJ9jXA_;7an%a<=Pb?Q_M9z3|x1vWK}$$kvcac_m98vI`4q3gB+
zTE^`vd8g`WHE#_aw-w+!lup`ZvL8eA*8)gi)Zc$YLI@!Z!-WeM0Dzq%^**6c$j$>(
zwxokHPEJk;2?@dD$B!|6`g9Z(6{)7P_0;m^%W>}9Ic(arsoodaAnH*sg0HlUEX-JO
zP@$-XyQ@6{7L0>MYxRyAysvF5V+1T1hi}K1jv%CEWMS6I!)mFtNMyQo>xSs)XoQ4>
zC_Dv<jg3X$zJ0N1(IVvL=4!Bq<uL_05S{ifU5`tf2c4k{!5{QJpv}`*zxa+*W$A`I
zUACVkXIIk*7$JlZm3Z^!jneJQmoI0FRn%k-(3mk}5E2rCbLY;%&dyGunqFfOA0Lka
z0|sF8=FM2KVg(j1T&U?T5e?CJ@FmQ9heaEYvFmN|c-rur;fjTmhk?h_T=!;<AA}X(
zk7m;lg?aDbzxBT~0;Xmj9v(<ePR7!uOY3(kqC|v}$d#pmS2H8%ezqPwJLOLUxyI}A
zDRjpMvMG;DK@LO_KLaI&8txe(gph`6{`~m>fE6oNC=|^~N=kx<hX;a!g5c%lRbiFD
z%1oFr0neU2!-541uxQbu`t$c*1s*?s3}<I&^zYvv>FMeCpa1zEO?QcCkVXq`h)Tqm
zyDp3!@iH=KhJXd*(a)}frn*$l-PBAh{Vg2AymtTqD~nbL{&_O=^>j7dv&Qeig9n&5
zZywH_JEySS$;k;pK|va=idb?!uyl@>HV?X=t%r8IUK;C9MWp{eg6QNDHt5ps^f7eZ
zR%mo&ju1kKqJ~s(BQ`b`+qP{}DE%+5diV9$Un^Y~tEP&IicnNk)UXO~RpI5!muS<5
zs%R4p2VX09o@VEG@p#(UvgE6J6?n-dr@zG9bzyAbjX`~^5wKvKMn~qFlF-mlEMB}A
z85yN%pPH<S_<lKgouLcs&4`yWlGIBmi7qW;%kS$Be*YO7>=7Y^kg^(5@I?rz8;wN|
z`%cCw6xUet&4_v#cmaT&WgGa-aAm*0k|-!w3ZJM?eM&`?FQ6>P?=`+&2VMZcvl*&T
zghPBg4ARVhG}t3T2qA=!rb#2gSIX1Z3c-uJt35s+TK`hE${NwXn?eze1E;PdA^DjG
zd(^ZT85v>Sx^)__idZ)A((d#z_ycCCy-ii%J5B}9dNBKaxrLxfz4ZI<zvIM-6Dm2^
zlP6E$>+4(LM0r98A%v)(MuM+h$4UdQL4B+-&ts@2x=~{@#}C3V$FA)6ni~B|OG|^6
zmX^X-MU{cv+}sq73k(e8xVNgM$*PFb%zq$#a$WX~HV--)u4-6Qe5bi=1w`qKyO5+`
z)o_pMmz<m&Bqk=}#*G_@jg3WCR+dKlvth#q+`M@cZf<TWIbWwvozSmeKg^jkr%9}(
zLkJ;+)JL2LUkS<2a3xUyKsL{7;bi9qHFxTVuRmogASOM^z~x&hocF=S#RV}jF<=-5
z48y?7%L|^Kp5+2C8yg#>rlzvTg@lB_*Vnhf2Vg+esffYB!76W4eC>DkHSfdGoUh|m
zS6T)p;P;upelNcEJ0O*4ut)XF=FOYo?(PmJCnpRZJQ&Hz$yL8eO-`OXiHL{@1O^5|
zUteEk=XG~?hn<}rmM&eYvU3tb2qC2UIFEXQj$US8j~~{D^L4!H%FNghlSetS-|skb
z84`(<(>|o8rozd|sk9F}b^wq~*p&+n4TV4;z}d5B*=-&k9&mMag|DwKXMI(t%2E+$
z&6<S)0|p>IKEBHHL`Fs;F)^{yV<hQUOBYgZW(2<dq&oFoQ+U0<gqEH$0D#GTR$8%<
zV9AmtID7Uix^(G+R;^m0OP4Mh>BqnS{)=VHmSOqw<!Ii#xysK!fBt;jym=Gh;o&Mj
zHz9-&LMq2;@OAlCib7fWX`lD!vU!!6G|~|*o6DX?KY5X@P&h<WtgWpTzTdxpKdh~-
zVP$2duzlFDVE|;Qi;YFuRK(7mJG0xbUAu+>0|vm$%d5gv#P#dfW8}z@7%*Uf!kQ)T
zlO!EyU-Ns8W7p4WXtbIcfoJc@elNL0H{f!HhKA77)5DV|Phf9vj}JchKqLKFw{9J5
zY;4%yRaI-=yg9tRz2WEQhj;JZsih4<2qA<h$7%5O=b6$`2zOU|m>C;#*}Tfg0>=UD
z_hC`DG}s#%fk2=TXr-p6!p6p?+;JT{b_4+2xN(ECzHvpKiult{KS57V4}dHcap%sR
zu(h>Snu;jD`7A0bf}fwC((^I}Igq~i|6(3IUGRF1SI-4-gx`HMpd)*DAk7kh$;;Gm
zkLr*3_;}>!=c8}mzR=d@J{|h$)2BFi@F3>SovYS%#*G^Xkw}C;|NK*}?GQppZG?x1
zSDBI0kQ5aaVe{tAC@Lz_bXQ0{z}ek}Fz+3b9?8~e($(R^!_|SSrqyEnu-@!K%PCJ^
zBjZ($#`+?k!!>DA)v0i0i&Qj5dU|?TwQ3da+_|Grs30pVOKB?Nx8Hut25Pafu{d_@
zSh;gbpIl>KYq#$Ot!74QyaEpJbiuPMt=uU|i_u_b>X&QRWdGNne)_3K+CO^qD2$Db
zF>v6(st>LMBO@b>7%>8S_wGeWNr_t9B7~6Y5R1h)bm$QJ_U#KVFRw;b80h88m-yq4
zKVWHTNkJIlF8I1~Tfn~VXV(En2F<u?S}k;S_!!c!bY$tm%|{yPM_O7Me0_c4<>jR?
z53H%Pv9ZCKGiPw(#ED8%5j%J8jD-sqvitq~{2&&K70x9|{hNKwvuYgw#@Ze1+1Ju1
zjc*jRHY5@WVq#)oYHF&H`CekN7=Qis7aScOVPvG<0AEW>3lk?!L_$IWQd3ja+7=;%
zR7ETn!_(6f)2C0zm@#9Jl9JM>?rA!A?u?r^Z(`lLby%}z4f^)&+o*y|QZt+dU+1nr
zU|%~sXl5e2s(swcl6`$OQ8RO>tgWqKZEejK-Keg{J_05;Zrr#kQxScAebK5_D*&=|
z&7C`UmY$%bP+>u0?M@AIp5ps>mID>a&NKO%EvsH1<mTq$_U+r~+O;b>cI=3I_wHf)
z_U%};Y89?tRexFj%*;$ACMM#GFTSYO@hK@O*t&Hqe*5h=Jbn6<-JXz;fK{tj;rQ|6
zmHu(Jw6uh-t}ZTKyjbVHHza9kX_zx-4opo=*(Ep}9UZZ2*Dg(WjZ`5mEsb41#lyox
z)7>E|<mKgsW5<pmC@2W4R;^O|11M#Zl9J%)=veKF&_baQfq{Xrv9V!4OWfSt5D^if
z^msm>k7?7UAv!u5j~_qA$dMx(TmV+nYbMHZ5_}aFiIDK1bV1@leXT1wy5Sho&qkr_
z{OjzuoVG8Y)1~amwY<#y`{Xx~?b<c0GU;_uHWg7GWC5kAh$Bai#F#N-*zGG<u4D^z
zNS?;C<=C~`_Gqw$Hp<b_hj!cU?6>UtW%b;mMT?-NrG)_l2CylDsuCL;i#KoHVBo-k
z*tl^cjvhUV_U+rl#>NI;fBiLleSN_&j7r-q>*2$PC@3gk=Veyr@ZrPQv1121bm#y>
zLqm)hF@jB-J#pd$x_9r6W5<r+%P+sg+qcR;mpXOogsxq?;`;T5@qe!h5fKq^aBx6S
zP!IsX)zuXa4i1QqkH`1le@{2`_1LamyWrs9fT*Y_08ra{j)Z%DetrlJ4#u=;(=c=9
zOwQYv2NZq!^r=>bWchpC+}z;n>&q_x6A}`F8#iuX^yty>_xG>xy?y%h!KO`{5E~nd
z>C>mH>N3=>F4s)n!*JmIjR#Essew%Yse#PwRey5PBxmNW4`Z+Guk*J#YuDA)l>xvA
z1Olb|0|Ek+?ss){Wvs2Ox#(iO#OL!F09Ahd^wUoa!!S%q{9&eWhYM4<!-XlizF)(=
zSFMJ4Z7o~2RQP|IIddlS;>8P<oO|`^)eHcpckkXzWMrhmzJP!LMq68(xp(hgwa!&o
zSjfD2^QK1auU)&A(bd&u?%%&(>2cxV;mopS%NUVJ#4rrQNTpK7#l?lOwY6myELgxu
zBogN8)vJt-jt-yy{A&OJAOJ~3K~$ryt<BuIb4TfUq*5s}XwV>L(4avz>Ssfhm6gSq
zn3ymC7%wj`g?*<_pJsoi0s;aw)I*|-Kp<fM-kF$~Fb)n53;@Q})m777Q>lIX_AwmY
zlGQ6OUc6xR^z;}D3k#;Ou#ofiV`5?$YinzTzbn=G3|O{onbOaan3x#$JTWmbm7c@R
z&5Z%TL`O&0=^D7Aifbk^oQ!-u$;@V7_p|Fz=kqZPgV4}W%$zwBpM3HO=Fgvx=g*%*
zDwSf_u3h;2^UpD1!UO~d2SX$h)w#XO^zBx9J^$u#GkiQ}&KyKVMIk08rd%m`xg|@M
zu*b@UhK3?4DhjJtujZtm_0g(TtEzR}#*G`1k&ywWptO)mqZ#%3e_Dp6qkzo2hLLu-
zYSk)sQEdPS4i1K$ogFrA+*od|UQNl<CKfDM09RL6g?$DF29Qdn$jHd3^c?5UpU2v@
zYq4O#0xVdt0DgXc*tBUAUcY`_W&4?#nP}a*b)}=yIXO8vapDAge0-pzqr+}*)~p#)
zQ&TZ^>{w`PYeQF87q+&xShQ#nx^?ST;rZIMX@i7>gev>i80_7<7dbgOaBy%am!>^x
z)F>=lwhREUd-rZlbdOX({`bzy%L^$fDVR8MqNck<R46z&7)3=zm@r`iJ2ij{LZJ};
z{{Hy<^Uv|!ci-Xk>C@GIZ(3R!)~;O(0PykgQP}6?<OBx?SwXpN+qPADp2?FZ13-gF
zc~;dm6B$l|uk1Gk>}%5&26aB)FTebP^z?LW+_(`JFJ44$ZZ2lbn1OZc)<IWS7hz#x
zFflQ~tXZ>=l$2EG_9|m;TDk}-7iouSX=!ZA%;3R;*_>PXS7>M`do05+h>D70_j!7H
zA|@uL$)?t1Wo5y_!U8K+tbnbpZKcN+6%}Fm^5sC;prlN&(imtNm9AsO6l7O&Wc}go
z?Ty>FZ)51tq3pKY+*~YPycj)u_Qbh!=W2D{XV0GD!Gi~|x3|aCsZ-1Czj*N?baizr
z42=H$_g{E;cwozxEf_Ln2sUikfbHA2WB&a40D#e>M<XmOtkOP|l$5~8$Owjp6)(YY
z>((uN{PD*yF)4izP+VM$jEoGJnwp|--@X6<dwY8%BqU(t#*GTW>igQYYlp(Z!b<zq
zSjdB_iqe`!jvNU<wrodZS_iSA8$W(LVq#*jW5*7dnVD(2J4A)VVllRF-wr_b8Of!*
zygb~xbqn$F@mR8C2}X??RqgjiM@IvI(zR3pun!2r!onaF3M)L%xN+m4r>BST@bD@h
z>{Uc46e`SN_3-dexDQk&G&HovpK+?XW+KB$@KrV_DI2WR#`*K-k&}}HKR-XTY}pb#
z9uLEY4a3>9XAvJCkLlB=LnsvD@ZrPI*Vl)ELEVGB%9OnxVV?RIEVZ(-0>dyBe!U-9
zy}!RPRS&8uXJ=<jojMgOSFS`#N=lW-A3Agh`Tv%FAU3v<FX*)>eO;irr4nkYM~@!3
zc=2MnMYSJ1cz_WjMqvE-@p%0BagEM-@7_IRXJ^C3#id-ZlAoWC+qZAS!oosn(4L*0
zjWJ`!AUiu7VPRnyG-wc7v}gf+eSNfT+ZKx!EyAi*t1xTUETwDB$w{SB_CZNSh71{k
z@4ov^VcU}@PjL6{U5pqp0>;M1?Dl5Os;($oS)kY02n4c<yWP8YSGvFKXJck2t$kNt
z%$_~FN&nqyDC9vv*+L8+9v+B@h=7}$o6`9}r%s*1%a<?FvSmw!2Wnifva&*CWMqZe
zLzOvk;sgLFT}u^!!crm0$;lO-$H>SC!-o%NOYGN%o0}Vgf`X8fBl{a378V9iPfxhH
zxhV~>l9H0(>FHVHwO&<q%|xc+N1`f}T_z|ot;52~VzC&Zp`qm#!<9cV`0~py0RU~=
zw#A-3dth#Ejt@WlQ0cjD+_(XeNL1$!^_I<Li`9xng?RGhNu@V^Sy@>ssciG|<x7>U
z5s{IRQRh@Gi9}NCCpKjj6&2y-%a?UNPkw$rva-sj&@l{y=g*(l=v-p481Mdl0)2hi
z&9Ii?2UWbIVbRhny-|Ph_#uW`T2^v&{iN*oAUr%Ak&%(`@$rGbzkjt-SuS6`3_vzw
z^uC0I1U!EH7&B+iR2tB%S+fR7NlCbW|9*vSxw*Mv#*7*G@y8!AWXKSuL7bMBR+R-k
z%BC91B_<}Kq@)D>`t_?ca8pLzY1#EfY-}w1+Ro0d%HywIy-GLygj7>fQWBh<ondNf
ziY;5VVAQBl5DJBuJ9jQSqBVZ}_;T-)-!IwN*i<?~U*E`!nJN2w@xFWa?p69((yd!J
zoH}(14<A0PaX$hB10fIy5E2ps4-XHdrKMrx#*GLH3PMy=6dW8JuypBCOqehMR#sMs
zh={<HDO2F!;85cXC{<oF;VAf0)yS7bBEjUzlgmA+xO?|5fYQjD$K$cNv}N7De;;Sg
zoIz%0CjR*250yMoGd7Y1UoVqm5g!(f6We^Mcn4`nTIrYG%xW1mwzR|2>uGJoukmP6
zeO6Rdgw?B8<Itf)xOnlR!U);_wRi7fO<d_8z`ucrXt5BW)(cuC*ve0>C}2UM6;}<4
zt7vP1t#);bRb1_AFQTZct`|gHu@%8vYpYm7)ndJZx@rXl1Qm)dR0yKddLsmcN`%1t
z{>aWiB;guz!T0k#JWVE(nfFu@=ACoSd!AQYTZ^=`G?<y0!OgAVQUb@09RtHK`17Ct
z+~Bo>f&%Q=u>;elO>6QFYEV!RqN1X(b?a7cs7-x*J|A+q9CEq5**#JW!{Fzie+G}o
zYt^0O$B!Sw#6)K+ju?c-hOUW3BCeVqA*5++;spR{X=&W&%f`kA3l=QkhFh!aab|Cb
z)~`Zr4A@@u`XdeMt3N!wtgNijW3m6gT6z;(DwQHQI2b2RoZyB`+S}VBDk=(d=gvi7
zU?4IwG7uabjNss4?tKD*pvfWd>S(jg#K?vncJAD{!3D;XCr^-;mIh~MXY}mZv(fk0
z*4CnD&z_h(c`~|o?W&cFj<yb?B!=x_MP1KeM_UW4etUi^ZF^6up&31TG>#oR)@b4d
z0Qc|T$F*zM;O_2@S6)%=-7GIJ$FXC_(7ShUy#4mu0D#k{PjkaolarJ2^yyQK8Z`<z
zIXQUp<cZpI+_-TA-MV$dE3dqQbLY;f?QycSw8Vo44{-nf{bskZva%BA&Yi<+uf5h_
zI7nh*Vv}X$@7}%Jtezl32vH|6Fc31CtjRff>TYzi2}h3}J=!fkeQ3#0Mz-xOO}=bw
zY!Dk8t9Gv1(4j+-o}P}_*jTO*2B5qFn30jus-c!mX^&%eWIE~j>TcbQOTZqLlxsC%
zxqJ663JVM2<>iGgUAi>7@8H3MF?jG`R8>{AczBK`Y`aX&%+d8_n?~DaWn~2`E2}o2
zvqz5}TB!<TXJ-dfQ`0sdr>TqE<}f!m*UA^Lg@uL2yJ$m)4%K*ZtVw4<Z=m`i0D$@9
zafj;tV&rvqr}{Vy0>k{=?&s8I?^<DDA(ky$)?mG_e*O9(G&Ho?!zzCL^;eXZmSV_|
zAuuyDQ+X{TBLlzw`YS&B>@!$eTB5eL76%R-;Hp0T_rL!I0Celt4g2=(Lqb9VUVi!I
z2InX$D#GEzhcRHl0Hma(;MZS&#gHLGRQ7Rpc1C4oB}z&(7e6_C_%P0%J&R?_mZ5Lo
zz9=j#L|$GV#*G`NQiMaHP~gy^LtF(vP2_Sp1`i(G`2Qe62vOtY$&<*)$be8NRQr9)
zt}9wU0jQ6iYG7w)*W|g{dd-%Ulw^=Y;n=pfX8J}`f8+f9{a@GuYlhC~ldqqDR$eeZ
zUmCiqstR(sT<wKWTjx2|S5~2{6xP$x6K{*&#lCfa)!MO%c76BVci6deC!RiiiaU4i
z;NHD^sI9HlxW9*o2W;$wsJZ>W<jaVPQZ$RaULtDV@N?20w2`RG<#KG?xDjDtVJdUJ
z%+1Xa92|_LOP99j=EUjKrva$1ww02S0sxpcZ5jY&Z_<DP1JJv7Zve^)g@AIXb9Hq!
zH{7EB+$|oDhl+{{@OV6!nVCVMP;l?7Z_uDYFflRFSScz$KOeJa&qjH9IedJ4(6?`2
z#Ky*=bLY+tzURLG{(Cq&I--9g^Y|V;dW1W7?x-v<{vwb{r5f+hvy;#@4Xq)B)Y-Rh
z9{|A5&rj{^>@pVP$B%FHINF#CZ>-q1xAum*R4T>Fl`A0@iy@QA;OFNDUtixwlP<AX
zj1eP7P;ZqU>15bp{URGBZLA3R+i$<Alt#XM`7%0p?%ZH4o5P0><JhrdZ8}$Tl$O`U
z!WQ2khRN607s0{7xO?|5?%cW4XyOI@Z%wfJ6%LJLEv)8ZDjsu>>zAE3WEU=6fTN=$
z)~s2hl6d+1`y(eO2dh`FZt)+nl#~>ho15c}H{NLQ+SsvU!RPbw`0-<;q@>{J(W5HW
z2HC<H6%`ejGGz+RojZrr)KsLUrEx#0si`<{-~a>y0rK+l@Y-vysV%tCw{Kqz7%%`w
zjvP@N=SwfW1Y28Mj2}N9{rmUF-o1NaW@d(M+qU7#l`BX~OM^rr!S?OjQBY8TprD{e
z+kN-$T|9jFu)&S1j;Q{8gvKgyu@%EKRYW9&)M0O2jT$wo(bu2v<!7-s<J1+&dR}8y
zo}2U29=%?gMsn0I@YB@D0=DhV>HT}2R4Ub3wL_LR+DvqmeA(1XzS^=DmRKx?lamv+
zY}o=pIjJupApyO5^-{URTU}j^ix)3y{6f$sZI;m|?QiDHnavvdHfho%j2=B&bs^#o
z*7L<w)>}Z@NY*fW{@+hi+4+_jJ$f`YY}lao{Ub(<Kzw{W4jedu|NQ4aSiXEYx_9r+
zz3%Sr4nCic>({Tt)6*0E`t?KS&Yc_lj2$}`rlzKN^ym>>U0u<wTf^^)u3fvr+uIvg
zu3S-D#j$74o;Y#h1V)Y=iGTg;UobT_#gZjU@X<#fVdu`Bh>ng%SXdZ(_wJ2<{_~%W
z4#Q>`20#7u6W(~^jTa)(u(!A8hGpKoc~k8^_1A=?d2oa@uArcRyWm$h!iepO0W^P}
z+A`!$pV%8#%~>mp9VMX&+xFHZUt6|p;i?@n3<HTo!rgRZs~v9Iw26!J<jIrp^73j`
zwL@*Tndm6_dPQKtJ+8mta!Vy7B%rvsm>UxE%{Sj*(4ax6tgPfNRv3msL_`Eej2NMn
zAx=%HzqS`8UxrWJa3VgR-(cv~+O=x|06fdOJLa{&|I)s}=@|1cmwRk1YnZX0X)7x$
zL`O$ASa7*D)~s2B#fukfoKrAq(j@%w!w*=oVnu^LkZ->ECZ<lEiXVRX0goR)R{MU|
zH{X1Ns;Vk1Uc6Z2J|BMgA@cI_xVdD{b98jXs#U8H7Z-;QKm3p@eJ>J;@a?zXV%M%+
z@b&d=vY1eHbu~_&Jc;+;f4|+=LNpZY&?k1in&<7@xf6hL2o){nOGx7yTMLg}^NTff
z=uox$u@~vuSY}3-*x`DbdXLx}JOY70W7}B|A1bFcv^4oDC@8>&4I2;>6T>A^Y_-G8
z%uKkrxIiY8Avib~LZJ{m9*-MZ-<oQN+H5n?QSxQ?YTbq1wVZpcKF+vt<1lK}C_H)c
z1poZ!KOvXPaq845j2$}`!NI}UvSkZ`gM(piZjM>AW@#bvrrng(RVK53`Ng=1F-C=j
zg_tm5LW8^BW5<p~c6PQ(Ps5BEGvMUp1OPCx8wQvti;~nn%uy*)VbrQCQFAwgduq~e
zWFtEpj#H;j;r#jYxPALJ=FOX@_qAboJRZLK>MQi_-5Z~M_L;{0u3o*0@bGY~UAtCo
zIeXTyVZ$I2iLh(euJ#C*lboE4hYue%Sg^SxTd-gO0OcKFHql~<#bQK9N2}~d2x*-U
zKKOu32pSvK%nnb>&(B9`X{k<P(+2ittxP6U=`m-WKYt!T(*-dAa0R1Uny}d0+pCnB
zudh9-9cr`91OTH0vL{cOQL{EPZZkJAqh@VpWKW*9`dD}F++n`^?mOo4<;&c*+S*#?
z=bwLO_V3@%+`fIg$z%NS#~)1JzI~Y$D^|2R4u)Zvr<Ko`xBs?<ahth`ahth`c_@9-
zrsEOqtE{YK)~;R4n46n30JxtXJ$f+v_wQ#IhGEX1KhJIF^Z86(UY^P^o*fNlDx=0T
zl~Lmv#eYxgqZwMKD7eJ6>DdoK`VPnF-M)RB89jP5Gkf-I=EjX1j6$Jc7=~d=N=lgT
zzyF?j^UXJz&6_tj>sY`1@(W{cZ_niC=eJ9&H8nNN`0?YJjT<+%%kd3aNJt3xSr-b0
zj7TJ6ghC;=EjBh*-yxFc?AWn`5s5_H5Bu*W5C~MZOC%C~huS84_wHqMbV;T)?B~YM
z&yQgkhLK1lj7TJ6f`WpWu&^)&022}t(&#aqoSYZ{+}~q;V%rlI7S`mxE-o%AZD(a>
zW^%uuP5n;h<>fH|7%M9)ro6noO|k2OHrh;-boNPKxG|1PQhqw0rK{7brLE-a=Zsri
zn`SQmR!h+lZ8>x13^Q=xK$WD6&*wAq=FMYdG8wlY`{fUSS+HP1gX1W&f8r9As#B|V
z*@SjebvBG^Q+37xeTUN_$mMe8z<~qIM<0E}tXsE^`SQyznfdeQGb>iCV6w7W_MI0V
z9?ndgHjSyNsnL3zUw{2IGj7~CMlP3Y{n*Cf#EBD(NF?Gu^8$f@@$>Uzl9H129U4(1
zC@4tfJ6zLGW@e_oLv0gdOup3p+qk&6FvZ2i+-Iz*8ydTJ?`8ln{{H?tin<|*M559b
zp-{-2IB}xU_he>fG6I2sOGc8Cl9<@oSnlRPb8h6UUAtD}b%!C+Mw^L}&OYe}PhaH{
zl_gu_b#+>`o;`cU^y$;5$vZMlSsi_xYtuJJE;s!Kq7(P;-)Cmbn4$KMLV9|-%D$&g
zo#I|MH#cYQ-@o7Bc(vt^xkROM=Ol)yYJJbGL8wtM@^7YdZK{>s)ptZ4jzXbes;a7(
z+S=MyzklAmdCb<WTeTY3wQJWH4-XIK)~#DwJuV@nZHzJbDlRT&{QUg5n;0P>Axv>`
zF~cwncah#yQe0VC$=KT3G8PsV%)NW}bP+bE{!N(1el%f|Hny$ojhyD(2&k;A<Zce<
z<m70xS?#JVZ6<YeGUp2b-gd4lt(^MHZB)vubaiUZ)vH&rcI{fsnKK6u9z4Kz-+hPA
zKmVL7uFw)SHML01zRf)!GooRcYNA^Tg#wY0k#KZ$L`+N!x82Ih3fs1ALrO|YgT)?m
zbL)yu1P2GJUFex-VGEO<|0|tZQw7D1qwUiG9jW>CG&gsRXW0upt3G;;sN*p;HASaR
zom#yxsHv$bA|fJ?o12RtfBaD^F+F(j09&?f!S?Oj)t0&^gplT#KYu>v&z}z)8ykql
zVlWJYl9CdvU%wtUHa5u0%7RQLYgX|Eb8~Y<M@K_0mm?q`K&$JpHYFh;p;=|>HDL=}
zl$4Zk{}04sakJ)cEnd7Bxw*Lr4GnFuRFWZUOPfg@oy}J7Zru$-U$;Znts+!aD{%1a
zb$mGKEnS@+0O0KG3}<I&0Lle-+u}sh4Q`DuyH^Ext*3RH<0Gw?k&(eoCarJAj2Q?I
z4_BL10l>U@^B|E(U}a^66)RR~Jih5b5o+(>001bi{{Ykf^8v53g~t62R!tQYSL%NE
z`EO3uV=$yK>_v&T^ytw8`}gnH+VKb>FP=@CHX%AX8X+Me8u$6(haUhmzxcv?@4bi8
z(o)QsGY2bIu0&{Ps8(V%R539z*s)^=7A;zYrAwFUI~<}1I_voYfIq)ex6t1H<7udP
z`b?Ln*P5zo1$G^-TTsq#{BS)+^I|J4Eycox3*qkWu9A2S95@hX&YZ#i{rfd0UV!of
zciXmYSi5#@qm}ba2abn{tx);oSp{mY#cHh$x}>-k$E{b!v+M=a|MSsvM1&ARjK#Tg
z=Kuf`CQMNKx>PFVZW_&<JGa@#4GauKL_`EOZ{7?qFE3<fX0|<81M}d)1I(U18#8Cl
z#H?Af5D^if?~sU|=rsBA@f?f+eU%H8Ry=)%Z;z(v^7LA>?|2%wzL(vr0!$s_r00lU
zOffMraCCG;WMm{aRKeWb9BbFE#r5mgF?Q@&t)7qn*5A0titM9c${%X=`0b66mqC$z
zgnP~(@mH>lJ|Tn<(p*oTJW;!S<;s<i$z%u#32E_Av_*>+AulfvPEJm6cX!93Lx;2x
zszE3$EX05T15jF8itE>}WAEO*`VNWckxr8@0GR*&+uY-WXRhOZv2m@NR9aq%xWud6
z^N-*4fT^j@|2MwSa&vPrZrnJ`oH<ivaYk=%Z{+0UV8x0RFgG{X`gu+Iy1=B@o609O
zRZv{oq4jgLCq>F0;8_I#z{FMvQ-{&|4Tumzh*A0ElTQEut5&T-a&p}WpscJc`1|`K
zIyxFbK|xr*etoNs->+XkL_|d3_U+s7@bJ(|%!Z&}zkWzcN<w^mJhzT0d2#7HYjAtB
zKZZLhC-_%YE3oyzd0mIlCXwO`+;GVOeY<0voAFGPG<I^i94l9@#IRw*aQ5t3Zo8eG
z9S$Bmh*PIdp<lm#?HU7r<Q(pC&F#xjq#MT^8pSX1sL4IeJ?D>_r^jdrA%qyCi4!Lx
zDJcm;p%9ZNPX>?21CPgpmzNg+;KYd&h>D78^Lcvo=+Wqu0b@i-7h&nF;6{B5{72(&
ztCSb57q8}FPy8hWP93F>P+BA|@hVOv-Qb=t`e2M6qj|9;BqSgxC<ujxh1@nipN|C#
z7GUk#wXm?zP4NqpS6&C-`7cmh{T=|I$cO<?(8r*Ak!tUxL6NeXdu}?&r>+N&5JCuP
z0S^z44%I6~h_2~nyqshI9+*AFoqPUu{AHX;&28iz`gbW)f^Fgp-1DhpoVXr5(te7H
ziZFfpbWE5qK_&5Wb92M>>(>zx5uvlhi^U)DSD5x6$vv+=_ixlb%+YBK&Bc@yqUua2
zP+J24FtHnkP9A^Pb5w*7LI@!*CcRBo`uJTBm9@Xt?LLJY`M>KcoJJKC6=P-8an#h*
z0sveGy@t<b{z=bKb!-ZS0-HB)hNGjS%A{K>D=X~Yy&EYhDHuF>u-@Y9^rt1@S@%;u
zsi{JB!Wz^*zNNQ#)L}{rQFUx7P_0}NfoItZoyM=AA{&GdLI@#xqSs0htLILHy`3!p
z<@~RuUmiiu?FUV~OScM&it$O<58R^AcCQMsVc`@iveAxGQ&TZ)*f4zY#TTfksNl8-
z1_mN8FAsr%fqIPYe>!!6*~EW=*Hr)jV4liQ_0tm6<X_NlT>n#hCk@YjT*Q@?=i)WS
zwaEw}gb+eH2)$+yUChm}`O|5zv3v;tAT9d?e-Di_m?4OlG9?K7*8#4qJR7e?*Uoy5
ztYa!JF2<ZWbKvgojvF`X=GF}!JQztyN!Y!6H*9Tf^%$WlUbk1#Y5WQ<0Yh~qs?UV#
zy$FZmmv~eqtl@gR(5VZ|eAa<yMZ;tXA%qY@^hxjCH$81Fv3}uXE&;2QSK*&g$FL{<
zl3wGAOT3EUFOP6NUR})15b^oDc&(?kUgPSh_UzdMM@L8O*|Ue+W?^B0(9lp^zkc0d
zC-<8491OE*U)Bvlgt7=n_33qWy-qs9$jeZD{@=<H`2U;Z#k1^%&hKr5Nl*O^(IkWr
zLI@#BJceNyeFp&m_lwK$`IaA1P*luq8{_&0KK<}dTw<mRrR9}~6kkxOYH0VW0GmIZ
zMu}HDxN+kKf`Won)(ZguUteEr+qMmMc6NG-tc9v8QFSI1wRh6$wwaoNKkR*&zB#ph
zhx^r3L2)fkxq$Msx?!3ocEglCb2QYD5JC*vx8Ht?*|TTEKrYGjE;BO|78Vw8aB$Ff
zC|aRVC~*AvarpZB>N^x-0QBDT#p-Emi9P@P0Hd6Q+_rP+zhc^_yRawz61TQid#S2c
zU{CxdO#foHO5)`@=r!zJGm{c8Evu-gz!zV9fnmdjsU%+g`t`%HW5*C5A8$N~7oZ&4
z=e-L2VSaVnYO0{fh(Xo&e}m$ec&;}}YiesylXD8sVm^c-BSt0hG9BatGoSU8co9Mf
zF&fFq$(TBID%{=Ok)NNh?{KuHu&@w8K|vTcY#5FlIil}yh@Kft&ljtvrWU&nCu867
zG?ndE-MV1bWOuwbc9>R+UDVXn;zZI7>^hvx&Fx}M9pi-0X8wtaYiQY#BS)}s;X)J@
z6>;16d_I;gU5e$)m&4rLT#wPUUG49`Kyl?e)ZV|L`a-8JFzr7QCa;Zv>1%HRow~IA
z;MJ9=DY}l@f@IX*%>W}WQ+e6MRtWy6d9;ofA%qwa>iGf|FJ6qTTeo7yj2Q?G4K=PC
zu+30WQGv~yHzO=83~p|2ICJI<_<X%Aw@dWQ;F2%awVZp{bvPMWw~AD@cQH4^JHs6?
z(n$ypCwp`;H*4{+E9F&4zj+7e({CX)`!-6;D^*?}(6>7leK3aB@zS!w!a^)uxDdyW
zA6MBvdh}>SM@M7ez=3*-tbNqnz6?d`H(*NdHGI+33?{wbgh`J<;JsuEp2aJG`ODy$
zTY_g{3#Ou2nOMo6fT?&4rcwsxVJ>R!W&kx+4Gzb%?4?|P%zzhrCd7~=CnsaptXYsq
zB-pWI2j<S5tM8DA22!aMUw{2IcJ0~)i9`Yb5DJCx^Yg=}pMDA(8yh`G*mf^^^0j*P
zYOGna2CG)B!s^wl^%6r?Ru%#S12KL2bSzo2q{;o&{a%VhB7E}6Czv>KqQ>`~J$n`t
zCQN{@uP<U_V~r{SYi*l}DuYeFSQoG6A?k;VxO2ax!E0un_!#ck2g3&TfsN%$=xKMV
zKAHdkAOJ~3K~!sr?$#Etv3v<#%*{|$t-zy_ay%-jz#~~X9+i~irsO_Sf4PmSYDI(N
z*}W>j$M1SzoLk3A0`yIxP+;T6jaa{aJ>+sZx82s(77-B<m@#999;0h#wKb@@^&cp*
z4udHv)cWChmc77#b1F>#&xh9UBBU9lQYp4<*@6ulHgMa*!or$$u|;&Rpr8Qb$B$RJ
z&;x+P#6$qfBrGj0&FB-b7diQgjEuy>g$v>B?Tu5XPU-yoY(fzn91Ng&-v?5u6yDz6
z$jHb*P*4#5@|VA$sHh0@=g)^sCPPR_2-dG(ukrnCvbkWv0&Ls1O{?u`FKulzsblcT
z7oZ#(m~i>O`2JM7N<j{7v3pejzwyH{b&L}YG1RgP7cL+uC<wW^b;}3v`FsQh1|l>x
z6joMNdW=rDn6lqdlYarV_pUY^lGp+!wnCWLd%#raN#)}SX@UB^T|%L9ez8O%q2$Ye
zd3$>!F)<M?E-pw&NZ^vJtgI}&`|i7tNF)%6L`X<T&~v11^P(nSrKP3l)29#2&CQXQ
zm#6b<g8JVHtmb?lEMLAH8#Zh}P*4z}qM}re=jrJQ07yzo(pafkp-{ln(-WzwsYp*x
zhl`7g7FyH3+S+DP$0+(bO-)VU<2e{Uo`X^JP=+(9xk$?{Y%nCTB?k2E4lmc&F=oUY
zR7|5CJb3T`UwrWeVq#)cw!65vVB5BBaC39hQ)K$Xv+M=F^IrhxzksPIMs49`Fi&M*
z{wN0Xv;=r610yd3Q&9|_g)MmImdc@s7OyCWCUzCTq~A#JEDUF@GeV4sr>7?b0s(h%
z<?ZdQa?wQ$OLB5D*TYpm@dALMLx<w4ufBqhj}H<P6H!o50DF6TeT7O|DJCWc6%`fm
z_xIOn;>GrWM@L6v>C&YbJa{mCe0-Yq-hzSxuIK#o&p%gr&BMb3E-o&}$jCrsWTeJK
zgwN;WqmMp9YHBKW?%Zkc$(J_TOzId#@>QSRs{+iP;*Qx<-0`TS92c+Vq2$R^JSr)N
zwCoQ^OaDMwMI|1Ul%u<KH&|M9fmOFI=x*H&-L1R9`sJ>8+j#)GTX)lUQ#vGtLV-Pd
z_F&nvWhgBz<+fW{Sz*<xRamfKfl-ZbZZA9wTbK@>tnV-gd7*@agy5r(KB9|sBk}$B
z-va>r{QT4oE37}q<jR#R^zUkfwr}4K0GKjmicZg4R#t|qSFa)?BcsK?H)qbA0iYc6
zs_wnhr%y*lMh4>I;;?=Dc8x<~eSLiq6cmJ*m>7hIhqo&EluD&oxpF1MVliYg8T|bG
z;OpxPe}8|C?-7f|7%^f*i`uQNHWMYIz6$Pc-3{-J8?Ns#$p2(yWMJXKg-A_JRoU+E
z?~jOx2=wUDLr;+rLI`L+f{`gGC;$KqAFlcDyhtQMVqzlh-o2}<u!tIL5^(zTX|6Zf
z&(9AZe)u82`syn<J3BY{{9U+k0lB%ku&}Ve*s)`E8n3;*eXED6#>dA4fW|e*MvffG
zJ<iF=(byAYYio<qqetWH*|Ug=iNS&e3tAitI|qvu7Z-=PxHx?K?YD@EifWK3Wo2a{
zARqv-v9T>mzO>b5qC^v%NSl?GmSW+;g>ZLwS4q4a92{`w%o)VS#!})%2qC0J*dd35
z2M=y?-*e~AwRbo~gRHD93>Yu~r%#{8S6_VvhG9@#tel_E4h!wuw{L^@v2(#492|^l
zi5YhNF=uDzCilI0^Jb&3v%lL}Sy?TPW7DQhkVqtmjg1AvFpx+j2nq@U0B)Y-rcIl;
zn;0igo`jc|7hGIi8toZVN1JUXlzfpk5{t!fbaX^yWF!;{Wd%udb91a+yB68m**d?Q
zMF=6JV|n@Imo>gNX3Q8JMnayKm6ZiAFE0Q<T3Q-66x7DXMx`fb(4avL-h1cH9RSK6
zAY;Pz>{(h`s(rmzuU_2ava&L@`>@#IdG*&lZ4Rkais0a2#KgpKiIly)J))wbkeQhY
z7Z(@EWHJN?2SX?ng2&@=bK2tK;#zbrK)Y=wlzfp^%FWHixN+kU5D<U|4<2yay}iAW
zot=#pD^?iQoh(8KA%wI{U|=9*G8v+xq8gp&qiz@)n{afr#gtnzoR4jLOOr1f8ym#N
z#;RRgYv|CSNKa2kY;3GbA&;P-pjORsYYv)k*)o)T8Iet!Hi5_Esr;x@P*BidKepSs
zt>kh!R<2x$VZ(;u?Af#2b~`&e#Ky+r)TvV%#{?5X2qC0nIC=6UGBPqC6bjW2W4nC$
zG5~0-<i{o)&6$?){54HWf0C1v+tAYX!?wMp$rpeohYtGt`y)L)9Sp;OVHmY@z=(cO
z@?|8FlasM)*Dmfu#I6PMd;*r7oD88*h_J9QZa<Mo1ffva<^(JuApt{%48gi}>$t^|
z`FuVWEn0+}oSYVqAtr<nLYngA$rFvQUAuM-0A8pyBMrsAeft0?3u~yu{@aWnKfcl9
zuu~RZL~U)mR4T>%`SW3IZ4Dle2Y-Kmh{fVY-y;@_wRS_Ev<@X-M#96xgPZWkij9p0
z0F@8gx^?Ry5{Xn62xJ$-+q`*mtIl0iRD^(l08E%LK_vz^H#elGrz0XF0u~k)tvWU#
zgb<<*yAbw`8=4oTXO}c-tRf<5AE!^B1^|p2HLB6qhYT5__H}m19b25EG4*dex8|ok
zs_zvR7OLG|zn874VliynTQl@hDwV?9+Z)l*(U8ex0F?8&0s;cy?d`2L!D6c&Ub%9m
z#peUG(`G`+mr;BE!&*>KfW*Ya1{09&?d@CD^QBNIuyyNJI66A2BzRU<R@l9JH&Rkk
z;N;}g`UVg}2q7A<!`0Xx6m{5(NV?$Dt%8CA?t))kK@@h~DFASEbX0o`_8Lah1-+pX
zi9`U<tZS;?y?ZzMI@|WvBwt&$Y|&Y@Lv6O1Q1WHeo}aAx`|rO4fZCF-4h{}n+1}<z
zO-+TXt1A{SUW|&03U2$XS+kIrmxsW>z_x@=2qA<timjq|`t)f?rP2nkvlsXRfk18H
z0n&ch>kW0-p>V9BLx-x}kG)85PS2MiVdqV0>OEphtqTMKjcsSKzt=5Iz6uHouwlan
zomD&3W}68mUq)@kiWLwFh0W?tZ|)?^($Z4QnKK9O?(WFU%;dHY95@h3NlDndcdyZv
zg(ZX#Vtn3v?>z_v0?1@CtX#QLB>~II%Hl5Ymo8nZuMmkEAAIlumk_W$ChD-ox$^V#
zRc`Vcx=E8J0RUt&ncDTa&YwRIpy`4b0J!Tcb*1<lV{dPd6DLmStlFVA+e`p3#3+S@
zg)sn_q@*NnTT)UI1AvK*jcu@hP*4!l)Iay$y?Ys3TU!PI_hVsU!Gwl}GS$`9T5kg(
zgy>RGP!J;$iMStuK)?WCghC;=&CkzI-(iw^PMkQw{XG&01dK=|Vq9EYxNSi}LHZ6+
zEB5Z)+vMM9L&N?Xu%8);M8b$fA|@y(h`UA!2?=TR7!D2&3;-rRK3*3gH;QdfSXfw-
z`?9}-&wpQJW@d7~s}hN%(PP}ZcaH(Un46n3j~_p7Q|!8+jW!b{<NBl%hG7^cHa1r6
z7erIZmry8Fd%W!IY{tXGLnY|~!1((5GPiHvZjUAqLWs@@g~A5kbI<<>1Ok1BNuHCL
znaTM1`EkiI07fJdsr_4Ltc)@FVsGl!|8a3~VTy~38Iee&@p`1bh=>RV05faWEFDGN
zkVGO;X^T)OWKNto(dc_JGc&p0M?XJ5CMhY2iH(irzGIs6yJ-k*ZwYO*nJ5|8C!KH!
zmb$xr5{X3PT^sh!ZhhtD<;>EhOBp_&ukz*DuU|idxC=!HA%wgLj4}BtE-q&L{QS6^
z79k-aOmT5B!!QhYk)D~E+2}E3G8toGVZqqi+A=bkOc!Bu*aWeuA5GY#jcuzyAYlCb
z{F-bt!!S&Bbv4(Ml%Afh&1SW$wzQel;W5nr7K}1NmGUa2WZy>7!%~!#{eiObN<5O4
z<55WkYHDg>YHEV+))we4=myJfU0`X^1$M6r;5z6vSas{7@9<l!pr8Okp%5aG2nh)Z
zYWHz)aDan@gUajd`@+J)xDxb7jvT?_#fw#{4DtDVeE#|8ShZ>u%+1Z)wJn4YLI_d%
z_S<hUd-iM?!zCFz*N$Dr=6P9JS#WZ4f<PcZNl8hQ$BT@N#KMIO;p^**`1p9O#%icm
zuU?HcYt~@iym^R@j@EZLM92904xpu^Wq;t(bqUU<<>FfIJ=E0HHoAY&Ls^4urluws
zKClno9`1m*od=-1b+`5kSF40VA%sGq#>5LyuJaWT5CE}Q%uRe`zbKb1S%SjCLM&Xk
z5XX-nS9za@hX;1=-i?6+2ew}W2qA<JVzf4G+JxxnXoQ4>Xx!(AAASJP{Nf7>7A(MT
zzx{@d8#iL>)~#5yXpvT8HB@KMp2hn0>*4F`i*4Js={p>v2S$^8UA&ry?@whQ>sC>l
zk5yAsi}ag!kbd(H{=NS{82Y*${`}4m_;?!bIw6}jZ2|yDBogp=yaunccgxr>yMTZI
z1Ox;CP$q5F)z#RzaU<5OSp&IT&b`mp))o;F5tuP!Mte7b5JCtcM(o_Va{zz|6DFvA
zT`HAwJvnpd&TaN_LqkJRR8)j7zW4%JSy>1T4MmS0J=z|y0g=n)*tl^c!otGf=H`a|
z`}c#-H=4_EqD2P(uYN7(9-<Fk#EpFQYf21#-44SY`@s6;uIO&v4c3+~p}TcAbhqw?
zM<wNWR8o$TvOkpneex97a_-@V<ad=Gv#eW1$huX8xWucN|Nh%>d$Yf;n%8VgmMr0h
z3^v8z-(Tg9(}fEcFl5LO<mTq8>^E=TJcNdZ!ph1@tFaP72qC27dh+Cn+U+Y>u7pe`
zLr6$Si`RSFzkfeI_}~Nl```aY|Ni|EA0H2IZ*Ogct9M03MR0d_hn1BTqNAfRW5x_h
zyk1}iJLfC!?j!6xl#EN65|!;{o%k5;*au!NuVd6OA#5yPYVom4%PVp5Y920S6(IGO
z+o-BmsJuShu@4sbkA`D^<G$-sTwILBix(p%CPrnui;D}kZQBMnH#a>+MhGE<5SFpb
z`8s*>Bz$~);Ns$fh=>Sool&;8DlRS#K|w(p=Yus@W@aWVEG)RSz>J+jp}_Iu$KmVi
ztM5>V0WiqqYwu4f*mXErWt&CU&hQgC!(ZeAi>{rucCJc!6%L-gj{V2eQ1SGc%4@Ty
zxZ~q@n_j@!5bfBp1Iv~zLuqL#x6R7R3aeJF!h!`0=#C2^gb-pNj3xO3faK(4L`Fv9
z^y$-($&~Zz1p)!aj~|Z@Km1Vb!oP%&ItG<|RaGkx`gI}_F8`O?W@>7JsbiclYqDFb
zdbygb;^{Mddo%?H&s<mO347al09MbPh%V-4?RIW$%E-vT!i5WwnwqMz-QV9I;o;%1
zv$NAvWP}hx2vNtFk}pC?+ZaspB`x~{OTRp#GPi4#lMstO@Pgf|0-eQizqkxr51hxv
zt9jfudplcf{&X68+FI%?j+QDdEybEOYY-V335B9Ad311az_xAMI?T9fLI@$GqoL%B
zkQaxEz5@V&f}&#lZPk92#LG|QjIe+B>NN2JfS$IN2>XXGKAJjGCB8Xp4rry)VtWva
z#TYVV2)1tB$|YXr=H^(nY8A4xvnlZ+gb+dqA;bXaJ^7NB{ei`s58+WsIRND_!)1RH
zVbKR;U}~zr@B*if!m4>bFzdwU;#|J%DDD@R=`E(`<>%*P+_-TF2naw?QC(s<cI;SW
zXJ=#e>eaMZG9iQzLI@!SLa)hJRkZ?3zdXVvUKU+D<Etg_WAf-X^%)k&d*uIN`!YXn
zu9>v#4}8AmM^wtI^ct63F30NCt1)EA5S%@GmfLP;XNTC>Se!X?ro&VSB7_h^2qC1S
z&};G)`gI~V)X>z_1Y!S}is6oZ^chkEgB^My{L^V%!Ht5VVyuihuCh*;E+r%+V91am
zDvKra`Ft!|v<TVR+09;2o)AI^A%qa3TY5{r_WqQjQq^$DU&k3-;>B|8-vi73CgPr7
z%9J!Hh2P$aii!{r5P%62CLljQpWE){=7yA%6huTs&|=Ai5JCv)5ae<>a&vR_8pDkn
zH}rab(lO~J`O3TdNF{mk6FD2qP(w||xeZh)!m;mo8m{HsYxnai6bfwJx)no)41riI
z=C-q|q^G2$z{SO--QysH5JCuPZ>6QB*t&Hq`uFdT_3PK`Esmn1BDlJ`V(QeXxNzZu
z-r^t~k6x0mormfYuTf4yEc73(k1$#+aOx<Gaeae(-rl`msi~=Ob#=w!#fw!IOP(=f
z2J-UqFmK+xc0E5Kgb+fAt|TWXb4l0o<;$^m?_RydVrOTE?Cflqo14SS%L@Sk0V+%R
z5Yk#YPrk0@+{2|z2>|6huSFkt>9wk1OMUv`pSTK$S+|N*)&tX)($Z1{1qH#~-5r^k
zncVh)0|z20DGB@c?}x3et=7*=2q7<u<m6;HI5>dE<6-B{o%#-kG($l_0ldAv!Q=60
zesc$uo12RX6DGjU&JKBbd04Pu0r-4=qwmSe%7Uw_D>iM~)U0zzrBZC#w2Axd^LRXX
zdwb*L$&+gLcW`h(Y-}uIV`Cu}ixCtQ)Z%t^L?=(4gtfIbl9P2i1*fCXdDats@FMqk
z>KG@TujAELHkL2pgNd%(^Qa##YPI-AOiT<03>bhNJ9co}%+1Xa8XAi1>}+^=cxdfh
zgb?zgkxHdlzI-`6Jv||jC~pLol^M<wB1FBNJ9omx#RZ9pi2$H78iW|X2M->=%gYM@
z5E~oY<Q#T3iE?ssLPkbLv(6!vO5yG8jo{#5j2}N9Nl8hFjg7^XD_7v-<AdePmuq~l
zzrQ~gEn0*<d-h=U>ebC|S4UG&Pyl~_fB5+LKqiyvI~=2>)8y;o)jY1cp+(oum^Il=
zm#5d7zf5q2RktnxfIIg~R0@Z*R&H)CJUu-zbLLDG7Z-EeeSLkAlaqs`OP4lz2Z#_t
zh-S&j$$0Cnx3FQu1_*^h2!%p@heVpd_I9zu>}ig3#}pJ4ga;2EAUZl4g9i_8bYJ#!
z92^|nqH}E7vIQ9#83+mrLR3@~JUl$$@9&SJM~?ykHf-3?XirXfcsN{KT(D-%8kJE=
zFADYsNL*Z;zC$s3I!(U5KUH^k!cXMPt)FFVl!>D|_dG7~YO9YWm&>ti*)j|nGDPJ=
z->+Xk#K*@YK0Y4(`t@r|xP%Zw0C;+OqNJn*VPRp&&(Ejz5RJh6`SX#On24aDAmruc
zVfysx`VNU`Sz%!zjvqe`TU*;khm*3s){`es#>XFjj1wnLH2WL{1qIl!VFLi*^Upt5
zdCkMagG=foBO^5)gU{z<?%cTmfbHA2H~ZYij=cdA9v+UUs3?Smh3Pvaqo=dvOIr2^
zvThXt0L(h^;V&}oyH``k4CU7T%DejrMGsrv{d(lc5jZ+JV&le*+$2supO2+Wmm)hm
z8@|52T8)_yLSAGcAtA`f$iR{%OY|KIX{M=Dry?mS2~kl|u(7excQ~XS?A*B%3WWl`
zzP^o)@F^=R!_})-xzF&#i4&WBjx%S@004wSA?)q#8@$dY^>J}=kV>T*kHf|o6BDEN
zp|4q4S@8Gw2am^twY4?o&!6Aq9ITx?cQ)ESb*@~w0%vDuq@|_7-`^i2M~-azO{7se
zOTI2$mvE1VJNAJ^*Uq{+b-OU@#K$|s>+YJKOTX3Z_ZAiwV(QeXm^yVT3JVLl?H(Q;
zxPJXQLPJAgVPT=oa0wygg|~kFdbJl`#Bj}>JD27<8<9<$Ho?`^l`Cf9>go!ySd8V%
zm&4W7wZZ;!xg2};>;VAy`S~?^Y<qiqBqSuX>N6Z49}fT;d%No=6gfFL8joXZYm3pN
zN2|oG4+RAU@bdEFh5*WBGDJs5!_(6f%a<=#n_%tSxfAo|&1>--SATzhtY5#LZhmNy
z&XTXQX>|+bdAYo<tJAitx8Cf}J-(b-(B%FKg#sHlZp4rwLvZBC5pKJ!tu6NM-HW88
zq$bBY6G8|fgcuU3R0>yDS8Uw45rKh$C@wAr!!VdWeL4aH0=RjW&nqe_;^w(KIXSgk
zeEIqL003ua=O*{PdGltYua6ov3V^cbNnhsApAVr>h@_+>FbspFq$G$$A^^&{Yj3^v
z7Q|vPq*5uQQYn{sg@lCA4JZSklL`)%@+w@*ty_?I)Ub{*$@!h(4lwJ)M^&`~S+|Pt
zsH7a-t-Gn+H#s>ObLPxxuv&XyU?9T7!<($^LkJ;+5MpT9DuNjq8AwV>Qt7E&vSbNY
z7-RVG;SJtfR8+)0ZqFrj*vh7smX>N?@71dp_qeH^AvVtXvFp;wlP7WI$`xc}WN?X;
zhld9e5)yFo<Vnn!F#{5b1OWj7D(`b~anb9d)ufJ2dcIP!Z*%3?hrVv7l|mao{`e#2
z&6@{LPfr8}269Qwp+kq@=jVq>lO|!^x^?YZLb!{$8HT>zn|sc#UshjnaWQ7ko()e=
zPnE>W$;k;RDJj^!dp9Lsgb+dqF-rBT2sSoERNY)5cIt(`3yZa+H;7HX>Q5WdrMKRC
z3o$V<YGa-_aU$~a@(>ml#`QD`1OkMGg&`p!LD!)Y4Rn%x-TA$Qdpz8+Pn(aoefxG~
zWo2RQ+O_!k=bs@E2=M;<@8ioazeIk1KEC<p8;l-38f(_9Y4<U?!v@y1=dr9p<+U9<
zc3{AO0r>XYZ@Fz278Zzzh(LOJI^5ihv(!Ezgb+fAR4Ub2MG$~W0SHG&#|E#ny+`fY
z>!ocydh`IGzn(7}8=FRpjo8@OV9Amt$j{FQ!!Rf*DZ!E@OK8rP0nthFRr2I1_t^U7
zu5CKj#fukFP*8wXt5)HaS6+dMi3vuH8inlaZ0y^&4~rKs2B1uQ6bc2bt*zU1zNXY4
zX85S28~~7+nF)7ycLW6msZ_)9_xDFmP7W3=T10Dh5kd$d#HbxQbO?ZQNSnHz7<T@Y
zi;Iiei~ncOo&kVSUK6oZs`W)z)eedF>EySaO-cZ0oD<a?3WWkOF){e;v(I2+QkOTD
zlqh@FrcIlM&Ye4>Q>RY&^2;wFlgS#a8BtnVietx);nAZ<kjv$G>#euo<>duaQ`1((
zRKGpHJ$Qu0ix(p@GE(J3>EPgiZQHiN+uOTU=OBa-LI^Q5=g*%90E{0$zR}m!RXPNK
z-o2GmHy%8A&<@cxq-m&N{iLO-!e{JFb+!jgAF{Ht;N|57nM}FN5nJsrIyxF5AtCtm
z(@z^DyKK>oapT5OFPNU`rsu2d5ALyb8|Hh}*4Dz`-yd(h@rKHFb}kiLfyTtd1U^1K
zm@#99%H5RQ+*~YNxDb_<m2h`=hlPa&KK}S)Oqw(a_wV0tRZLdhx&Q#Ag_+nFz8G7#
zZsig$b8~a7Sg``x+1ZqM5kd$dq(jNb$N-?ekVQd30aprr=+L2R-*0DU2cZ3j@UfKu
z3ksU9OwA^Qny}Rw+1T|VFffp+9U3vC>iIG=GsBoMV^p@)*4E<u`Sa-By?di~E2^uj
zv3m7t{Qd8Lho`3}0OjOQCnqP28#fN0eDVnn9z59Mm@F;2Kv7kR+iCGoR8?}@$BrF~
z=;&yTYf2D82qA<RGq#GLI`ikx=N=ClG)V0}YyzWDC{S8j+HM8N*o5QCl`CprXNN}$
z1OknTB8yEF^_6^y#bQV#5~_A+#B|d0rLE*ko!@@@4Zr^SD_(#7^+qRb78Vxb)TvY0
zxpOBNhT*oq^UgaMIdUX7Zn>qpTXzHBtPA=Kn*c!B4ILXBi!*1=P~t@hA%u_@&ZbS9
zRC-u6RYA0~v*Si6v1@U)he?wr0Z<OlQ@1`BJ3R9FsVeHQ38%g)G>#iL4o8n3rD}&p
zOeZ~G-L1QE30PxmVYSB9t5;E8UXIC=C#!5{E4;AdS}iRt(XU@WR99CwIEI;-S*y>_
zwyXPq5$MthxOD7mDjiP<AqHsv{P`-wj@Y~4yLRouxpU_L09IC35R1iniH|h2bLURP
z$H#Ne*$eb5SFWfG=Z}htqTy6}AQFj?n3#xNyLREDk3IsREIohv^l7YFvj)-8(Qt8b
z(fEE_TU$(;GzmwJ9KlaN{nY5bZ834;M7X%PAR{9Kp`oEFpYg1$EX2jdK_C#Qt=L$f
zTrS6vBS!!LfBoxU+a=bf*x1-KTGF4bcDQ885*<cGTEgg(uit+A4FZ7xUAro)CSJUF
z5j-BR!H~o2*RLZsHWuOG;mR1gcgN++mtkgR1|E;c?N?S-28l${>M!lG3gu8k9?t~M
z?@Xq|ix5H#)alcw)ee)ANF>~Lfk2?^ut+1ava*nvnAl*uOeRy=US3|_U?0-{X3d&~
z#Kc5MBoc1)kw758`Sa(we;-Z7Hdu4#&c%@<M<5o9v3Bj+W}Ua7pa7dUZ|0uw+O-RV
z2M=zv1pA&nd*J2e#mz%ouwVg-ii)se#R>q;OW+d{5>Qc50XH`{I5{~rE7p!AD=Uku
zDh>ea)~!QWSXh%oHHj*n3_Gk}WTSrZjg~ri@F0c_8-_J&)&NkJC_Q!R6kdAiC5#v`
zqQSlsCQMM-_R>o)p;M<$D%*DM+=;@%LTuTxrByMNme<YmVvBDOLI^QD?7BCN{jk+@
ziD8I}ifZ!TjA0nM_|p@Ae}9C8gm5=4{QUfok&%I+Lx<wpwQB%07u#TYdwXNxz=6om
z&qr!%YLol&csvM&LPSSLbK4~n34DBfz~k{$Zm`!kbm&lSG3e8$Ps7vG6Z7ZKhl`5~
zGBY!qHRSNXfdc@5fBfSgP43%~u>W73oSe8KD*%v~m<T5)C-9H>*1P}!2){{0K~#7=
zDlFFmI!V54>Lp+G=YO@-sZ*!$`0-<|s?K-ceTQDXdV$B|sr<ndi^b^Dr3<{gyc#{;
z&p-c+@bGX%Mn+=Flqs!>sXgbj5kd$dgcusJSPWNJS4gE&tY5z#B_$<b7zSdonCm?{
zefl&2z|GCA$>W8Ghl9`OW9H16sHmvWxL-m-LbH-_P3-OM5fv51#amKR0<l=!tmIuR
z7UR&NL-6qMz<ck#*W~^kNpt?6)10#A)5);IR|FQ^<N6COx77IY<B^k-1BPL+X3ZMN
z<#HT7dKAII!3Yix#;8%FAd|_^xpQZH@x>P!?|uNlrAwDEfBt;z*s%lezWZ*gW0KbE
z$)n_p5JCtc9a(a6G6DhuG%lPB04GnLgiI!bP$+CxVl!#dB!q{DWAWm}m@{V%Vq;^q
z9d?`K=jUV2oH-aca3BsIJZO}QLKDNGliwb@SL?>mU(31I>f`wP`(xCoQMhp70{Zpq
z2M-Sq@OV5#Mn)ndBLg>X+<-_VYI1?R<m6=h>tFxEH{X1Nx88aS0C3~RjV9lx&P_?(
z`e4>CcWv?e2_b|KLX5@b%a;KF)2C0@xX)K#eFXsc;)^euecVNh7C|bNV%@rRP$(1#
z4-eN{MZx;SVlkF2TLudY3!FJ~Mz4!2la4_r!wy{sy#`ZL<*9B+epi_%)lz->^uf%T
zGvVp!snWCM;^Kl?vt~7!K&7XrWAEO**uQ^2mv{lds#U96980CV3aP)`=AOUpJfOwL
zAcPP?2r)KgWo2r&i^XCjCMLqg#RYTc&TY{#*REZQ`1p7{c<=y@j*f_ojMPS`tx{TA
z3Qtc@%$YL>zP`S=e*L;$7gi=6hfaFFth#l<@PU1he)A4$YHD%uY91z!ep45xR&njx
zH3S9*V#<^$IDGgpYHMr3<MHtD;X}w|vKAjN{pKB1RVx4h1NwHSVTXheLI~;5-h1yo
zY}~jJ(b3TuGGqu>sG^{t0EZ48LU3>}TwGjQJqO6w*B8FNzPNDV0*Z@^wHbPgSXo)Y
z$Hxc9jvb>))<mmxHfZ(j;SNZ@c?SS+DXT!|$=Ab&5Am13`~|=M`YV3<<(CGp&zd!>
z#m79Kev5nT<@$PC!XtzbLI^Q<_V)J3$jHFv&6}}e#R>!j1aPm3L?Z0iv7^O3Uh0e<
zJ-W@uXse}5m+CtN(gE?9#>&EI(W8=bOj)!80ASXMkA&@iM;G(fFK(=FH8r)E^hp#q
zgi;*#5nk(Qt>>r+A%qZOY$_@$P+VMW5ObUeA?-^ibG`s&CBUJtE62)KRV#4t>~&q8
zx?P+|y1^x0cCQL3@gjr}LP)DvSXfZvMaT<6XUP`;{P~?B+~fVn(@^pBnJ!PSHC5FL
z>^hvxJ@*?wT#wNZLI@#*5JHTBPLnSm&%qebw>to!;^{Mddo)Ftr`MW&$J4m=z3g5U
zVConrJx4?cA%qY@2r+azO}+qN{`+rpj}M-?j{C*xOO+a`((+2gC0^y8fBdcoS4N)@
zLI@#*5JEK3dDh_eW`7KK>;phKd~fT4^STb9O(Mk?xZ#om`gX@Sw}E<&h!8>uA%qZO
z4D`}vv%r5e_xR$~JnV_Tq>nIKEH3dXP9)vno-g`fj2@#Qgb+dqA%qwcy(C|b{d-{c
z6nF0V*YTHeCN)<dp)}j2ObND$FL2MNj&b68@CYG<5JCtcq$zrvtn~4_9(db%0QY>|
z?o+st|GU1zX;eW`F;+$$M@>yF0Kj$7Yxr#DpY$9RA%qY@2qDCn=(SSB>bVnPZ)XcY
zIsa?vmq(Cu`++_~YM`K~7@vgwfJ%840A+Q<4GX7Gkqtr!A%qY@NQ>w-gXm&zhRvT&
zgN@}&003#(ANYG{oWTr1yp$<H;J*%VW#!p;ExLBrb7X`NLI@#*5M#q*7>3bz5Lvg1
zuzcH5F3ACakEV`9;M7riizzPgDz=F)a6=8dn42Nu^LH`ybvwPqL<k{-5JCtsUIvkT
z0l@v@GJL+}M-&tlbKAzazJX6a{1ewRrVFLzm53ByP^oHY_o@J!Kb?lxdRpr&4nhba
zgb+eV$6_$a7XVbstFSWaI4)&MxNT;g_?S6q1pGxV?K<4As#<}4$I}p(c$Hhn3s4r<
z*syR44K*Z$5JCtcgtUo4C0_tgQ&Wpwhm*1Ic$&&~t8QH|YqC4u8#_#^#V%@UYH=dz
z26i1zRvGpPD9g!zHuFzZT!Roo2qA<J(q;yie6g<O+{3QJ$;i4@q_Vw>xf$LW?tqa_
zLU=gYql>v&i;rC?uR{9GJ2;<y3#r++QCeQ9^7??j-LdF{F|>{sA%qY@2q8pk3^w^<
zUA&rys2?uk&i#@GubFk?W4L1<3>(-7HkL1;r>!NrTU)@!@+EXJH$zpm0*^|{@u;K%
zk7VU|R8o$clKV*g<u<CS6%CGO_o@INzw3c<ZUc4EG(rd=gb+f=3&h})FF-joFyZol
z@%^cEm4Y1FV)v>5e&dH@>KG>)Vn_%fgb+dqX%|M3eAQR<P=+(9xk$?{Y%nCTB?k2E
z4lmc&F=oUYRK<`GLI@#*5Yq09F8QkOQAs&2Ud=<vlc#u8QVwa^ACQ**fwGE9JSr(i
zck6DjwCDn>Ze7sbx*NJ%cZ2oIUGcW_0CczRrtk0xA%qY@2q7;JqfWjEA%qY@2qDB+
z&;%z!2qA<JLI}|TO1=mogb+dqAw&l#`67f6LI@#*5FMc8ix5HxA%qY@bbyjCLI@#*
z5JCvi0ZP6IA%qY@2q8oVDET6U5JCtcgb*E|<cknO2qA<JLUe$VFG2_*gb+dq(E&=n
z2qA<JLI@#52PpX>gb+dqA%qYepyZ1XLI@#*5JGf-k}pCCA%qY@2+;vbz6c?N5JCtc
zL<cDOB7_h^2qA<J9iZfk5JCtcgb+e>fRZml2qA<JLI}|TO1=mogb+dqAw&oMA5Eq!
ZImHx`)&Kwi07*qoM6N<$f&l;k|NjAyi17db

literal 0
KcmV+b0RR6000031

diff --git a/image/20180117_004820.png b/image/20180117_004820.png
new file mode 100644
index 0000000000000000000000000000000000000000..8be2ba6cd8adde3cc243d6fe28f763f291476e18
GIT binary patch
literal 48120
zcmV+Ty9Y#xP)<h;3K|Lk000e1NJLTq00Vsh007+x1^@s64}KfU00009a7bBm000ie
z000ie0hKEb8vp<R5p+dZbW?9;ba!ELWdKudX>eh4bY)!^&fNe2AOJ~3K~#90?A>{M
zRMq|e@z>ltGYQ!@Rzt#0SQU^(KtL1(v@S)ff>s3guhxpxtyS<x#bRBtD1ritSS(Pq
zEJ8&PB!CS&XhHyqN!UUX2$_)W-kIMYlese!wn;LRg!p;#$b-2vxl0h=oOAByo?~)2
z91esKLI@#*5JEIaN?l)o5JCtcgb+fAz>!X$5JCtcgb+eBVAAOmLI@#*5JHFsOgeo+
z2qA<JLI}}-NvBT;A%qY@2q79U>GTO9gb+dqAw&ZvojxIi5JCtcglNE|(<g)wLI@#*
z5Dl1g`h*Zd2qA<Jq5+dmpAbR_A%qY@G+@%{6G8|fgb+fA2247ALI@#*5JCvifJvuM
z2qA<JLI@!mFzNIOA%qY@2q8oRCY?SZgb+dqA%tkaq|+ya5JCtcgb)pwbozu4LI@#*
z5TXH-PM;7$2qA<JLNs9Jy1oD*gb+dq5m;sA8aq<6*qN3^UO^GZatp{iT|`;Aj@6<P
z8x>0PxJY6nL+R4CIsLk~#%hsfq7V&*$>DG~YV(A<)3f<uZw5K}h2-QHa=Ne>+u2e8
z!a{-w4-GOxr~g%L=-Rdgswy`mg%CmrA*!ORTw`5II^S<U$d<i_DK07Vd0(r=Ouz1}
z8E|DAMhxgI9Y7&2bG6dxOWt*ejXMsqar*&I7Zz7(->C3L^y}7|8~P<N;HtI(x<Vm@
z5JHHCV_nLAKKR%7WS=-y<6||63Fooj4Pr$9&VINuAw*pWXs2&SY8D?X-pIa#NBwfV
z_6bdR@}42|?vm)2;|U>zzqzUzj-4zZ=Tsp%`8M(jiU5d>45dj-7)_$XX%Z7I)eJ%i
zzxz2mmp2!zWk+h(IiDpqk6~z^jwCdXp-FT&%^OG1JT8)){6dc97Lb!~<M5GOHtjsb
zfy|t9_V3!R1y7B+j;`%m)W(k@gz%$)bo#PSoZ`&|-?DYj;d4H7-MQ<L)RL(1M#Myh
z5*rl?K;G#h3T(yXoi1X}fg>dEI&|JUgFQR7<d0*A(mtVyzb{<~A*xKO8H5n^!8cpe
z`0JdnDJ$2E_hKVMxo2c=2KQ=5eA8&3k991!fQ{P^^7+>(<m49`@2jf9v-c0<mLc8!
zdhJ4p!18;iFL~D?UV49pSKYYPV&;}1-MOJ}$10C%?@rHVeM&mZ*6sERu|~mGo*g$#
zN)3b%bw;Wggb?+`N6V7=c-dxS+iEd0c2sZfyQvS2g00m)Zdtj;!c{4J{&k8m2Lr&^
zQN4NW&OuVCAjD<DubsZifupJlBl>sdvEL0MHZrtE$IdG#V!?_Z&guL~=m;Tdo3GUj
zO=7~0FTj|<Dkr~Csu_e3e)IDC%lT$&nz7xfbu<3<)NMxg_(NVn5ih^L+^cMKXzz~v
zzsGNuHkc5X0l#(nDhE!R_&BCLc`J#{WBhS=!?D}~o_ps@uUc~n9U(+*k!l7ZM14|u
zz<pT1BwiSQV~y_aU5KvRd2Q|*R(`+FcyH{e-aK*l5Wk;G2;pDqlqplD)bt=9ElXy}
z+MUMs(B2(+W8!a#iw>*lq0bQ>63mGHojH+L$ib|W031G=M^Q-`{kpgI`}u?r!sVl7
z$xNU3Uo=ezoYf4Y26o|%iNEFgJ{@Tm8-b#js&vd|u@Us^-kMv6bVs+_Igoi0-EK$I
zbT(`|KuKviy*edS`M5%ehA(;7A*Rp!udzLLRBxVp;6^NFH6Z6x6cdAbwMSJHwx?zS
zu=l`Gn#V=bAyFz5gs9JI-0AyfYZ`AY_}17SJE}J?ObA@y09ec_L$2=N6*@m2I!0_{
zD4kk23)p#u5Wik8zrWmTaH~yx9Pht)H@6J#PKX~y)I)-;^y}W55d%82BQ=ZsiWxum
z9ym(I(R_wn-CjC=LI^|liBtUH^~J^@)X?4?d11nhwQ}wrNi8{^d&a1`+PXJ`e%)Ks
zH~@qFLJ0q;QK#?c>|CCCb1Ayr4me8+o_nBn0tcL-bMlmp{TU|!XXy0moItbKh+4Y_
zAw<I`)eJ(2`eyR1m1G>r1Du0UZ%q7cKnL6_>({+CKkUsQ_p}Y&ZYSetJ~t2QR%_=M
zLR3wS9)f#w!CK=PluoUi@xu7p>+rced;c(cc4`SYYt7&M^jmb@UhCH(glL$)*_!6{
zyv*29y?OP?TLSXDj7y_nE0Z6+iHAoIG~WAS&32Zp+ZC{L3L!2ZJ5sZZiKJ9jVcL_o
z1~ik-$7(V2x2JByYB2-O=aV;XKTxaJAcXK;wL5+5QuZ4&IJy4EukFAAXV|^^#I1yd
z1Oad$Gso)zV<Cj7uAj4W`RkmojqPFml4^Crf(LHB#%nFCHy3=%?)2<hJHHU3e)?eX
zM&tE}{+<0kX`Zi|#DsJE&?}AY50`F|fp;P5scLol%E~o9_}BNw_SjLq{W>jhRYiq2
zV%#m)7~8X#Zt_}7MhGFQL#i2s5cN&+u0zJ!pjL~S$9^}cPOs;|+Xol}?>}efvMwdP
zPOnD@aeme6^sP%tC;P-H0AeFUx$mYve!ZybxN}$!;+sYT&b4G#C;wQ-S0seEoJlo<
z5TZWXxZ|Ml`j#QxYrGC}O@)O7ap$m}#`bs8=@X(}s#d4(`|a+)xo2eWI%x=1X0@0Z
zGxBO<+cOk}5TYuinn4IrUwJ+^cSGNfb$BIiH}p+1UT@iZ*lW#EAw>O9<xXE&xyF{g
zhmGyQz1sQpf@<Qr-tO?*k(TAPc(M>e_)4l7gb?-7?(}R<7ZwA~!Jw{fTh#FtIkkz8
zqj_8;0L3L`MwNsRqW-9Ir*B89yEB#8JjQ5*)CW=FjkvNyJm7rxWrN)96GBvjR5J)6
z>Z2d_W*D#gb!&~P)@Ty;^C~GR;lP0dJpcUjtXQ$a=lursXluMq-u<)RuS*C~GgVHD
zooVjTo1uLIS5|Q5%o+CX-OIxdKg^abTYTQHZ?{&)>pkg50&rzQh=xq68H5n^RZf1P
z@w!J+%W56t#~*)W>C&Ya{CxH5)vRB?o>{YIVYmA}X;k<2R~WBdl@daT`lHI7KF`2O
zsOA*GHk*z2-g^&S*U$TTNl6JymMr1hZ@*>k+_|W#?~9GLjgK>4=M@xH>-vNczg|+!
zAcUx|JlkMV;f<<wjDrUcvTfV83x0mvZMQLI%owazYn3{EO=7}~*LkOla5x;*x;`O9
zU{tx&cP#ge@w!QL^(HnbEG%T@%9R)VJUBR*@#DucV#J6lA3Mfl7OVUM2^}Fs)zn2b
z!{*JKFTFzrsb&!3*UNJPr<iKa+NmfCCX?x+-{WdKUF!QhIVZbvU{^FY4_e4k`%&z6
zyR^fEs3&T4r>}YAh-#hGWHO;BN<e}jHYyZwpx8A=u2_KmsDzFX!grn(0#`JNs@5^8
zTFqcKn|(fZhr}kvYtK9uLNt7?NnF6y-l;#D#)RW=I5;-^dkzi%hAv7M-qqiwR4<iw
zm=N_qHSY8k7_VJ3HPt7s(7EfU@A+-Y8k8<w(BFL*y;MR+2ytot$T(lC8AgsA2~ee6
zl4=Gae!X;$a!Xb5tqGTvl|^c5DrsqH96EG}?Cfmv^78oQmtROrOCv2Ujr8<%N=vK1
z42;9!z~OM91r>4Rx8DL#U@BmuWg`7e{Ylo7vD@ucDi;+(_*a!XeV%Jo`8vv+ot<q2
z&Vd65IC$_NHk*z8`}Z4xlbV`Jc6N4EFUO0+;owBx8N!N-cyO;XbW8;WSSC)y)W1J^
zvV@Kh;^Oj7yYKW>cO>1{YKH1`*qjS7JFqM8{k2^<T9Ike`4ghyiwtu=$LH(31-p0e
zX4R@ytX{pEufP799XodL^UpuCa^*_nz3;yJuEw3d<0nsJvYBb~x6y<gjWs^osqSQu
zWe^WK9wb-GMc4I!<<+g+iU||*nCJC=GRc@ce!apg0Xe@A^_lNAMHQOIMH-#GW4Q%B
zEm*u~&mMmI=_kx)Gm4^6P*6Z_ZZ2!qtU;+5snRr!?%lf+A0J=UOENed4o;pbq`++E
znZBd>%TH^$;?zk1)SWv~2Mt0SHx7OJbkx{bpX%C$5Wg;E<?fP9tHt+8q-slCRA@yB
z)zxI((336>2a`38$4n-y6`3ZvCPc#&9vWo4&iAp?ck|6RbMwtN8{5m5FK5e^Ej<4C
z<9@xi6ZwVUuoJc`o@-xug!mUuupnUpWr}lRtoi2oEO#ttsy3B}91j_7Fn{Hh2@_M8
z!hiVBIiC$=AXAvaWF|9@d5mW~H*f<37~q$43voH9a;ML8cBY(sn@{_U8a0YhqedCq
z$B!Rp%a$$t;SYbP(z7hS$UkiZhn=l)@%&}XQ%o*7Ou~W%C}qyjG0&fmWBGElsZ()0
z<p0nSLR{WFJ9?fSz>CSw&Ze-i5R=J-s;Zngal)u(aLqpKa5xAL53ljS)``3`Xh9Z^
z{B|G!1tt>{EfyB&I`8T_{VOs}@v-zv2yyvvmYh2$oARtm2!yIuMdhBhfl0xnsKkau
zao;b)x$eky%<4FcO>vt5$TQ{fxaD!?>GOC;dxySiU%%y*1LxhtDNONte;)IQC!Wbn
z2H*i6-~&G3Q$CeWpZHa&QF-U#Be{OPn93XuN0me8m*c05&<Tx=;+OmGW6RvR<PIEY
ze2*zF56k0^W9r`@ZR^&+mVCbR4wy{tugYuV3>@hG%;Oq`5Ou?|q|?_%)t)_jyh^3k
zuU~IeGpt^{n$@dUvvTE1e){RB8eN;Kn!#kV(dKWT5q=`i_-v=DGRR`#L5G7}O$%rV
zl@OwCcrMeh=Rja)@BQw(@A%+@4~UJ8<?FA%=CjW}yW~D5lZkzYj-x1M6mt-*S~e##
zGLl3`B2#uxVd}1_G%IOle1D3X!eHxQp0Ynho}L%byxPiEn$z6tz2-FMIL8BWJ|XI>
zD&J=7-u?;}k^;b{oridMwEsIQnx^s9S6{Jx`*so%5?Hio5$Wma+<Wi67v0ZfGV#OS
z3>3wT!yH7fuI-47jKrp@?4B}(*ezQ~nmLo;<Iexl)sz&}!GkG(<Pn%W8AnWv|4TmK
zdJ9}ZHfa(({WOdo?cBcmZs+f=&l3`y-}A;B{yV=AqDnkR(w&pKTzUcIx~OId+m*)E
ze?LX&6Qfy>kU&|*NcnuTndJ@#Q#Fl;91f{w5TXIOwr4vQu5z})l6M^n$T>Q7>O||-
zt$E;q2PiKur>vq<>S9bL6I=Ei#-ysKSh@D<&cw#X5)>4K&1U1;f@|ryxhJ2u{+z{$
ziz!pe(9oD^naN`NVqVi;<M)o=OI`^PKvlle*ROkPtQKb@=0IkS*GzYQyC_AWckkXj
z_Sj>jq@*x$;zS1ea2Kq=R>GcxM=_}?)}Uan>(`Cg*jQp?V~L1}py1kT+5GXx93DFs
zyVdI4Nz<^*oQc}CEBYs&pzFGSCq>B2bicml8pv|50mkOd&Q74q#EI~)fBEOULWpXK
z^_U&=NY3eip37CuP?ZLbXEj4?XfXHv@(XjfY++!oyYeE>Wa4p)h5jZJTQyB4uo9wy
z=-Rf0akuYuVKKYYt3CnVZ+`O|rcIl6!OxpEZAxNdB8?k2rbUYuv})DrlE?hzSU%Y&
zPGd5e2nr5jV6P;iqN0e4iz6;Bj+mGjq8mjsA!7n_w$7nXejj7s93_Vd)(H$U4Pu|R
z?~-k>%9FBGp0q^>aeh_q^jR%t`gLz@Y;W9tu*xTG)~p$;R;{|=2)LpsBqSuzvSmve
zH*QRPe7sMgvvu!bblri;Wa6r%1X?tWJ12A+MMsk{VFFv{%pt#zJ9Lzs9IO*2U>Y<C
zZQrFsr&<;-hP&=^zTUCJ*#T_r{<EZIOYcsh5Te#~Y3nWn+O#t;Bk7u^v2^KD7A#m`
zR5SQmLglJvP&}#`5*-ev?B31PUAt&jQeu36imEc$YUL@rojhHal20KnbE>M)ubaEw
zus$Wd4zI>-&1P5Wx`{qrTNBbKm`05n5gr~+OiYZ?4vUJ4qK&-`({@hd#l0`mxU{ix
zj4kRGdRcq%oc%dYYo{;R4jaG#93H<O;DL)?TMJrnjALH!9pe~1=~?5STZqd^wVs?E
zaAh0g_2*xwP*$$_?SiUH*X_*zYD>kIi9x+OU^bgC7&`VgZP+<&8hc-Sk<!NQ&{4N+
z!P=`A_UE2MJAL8M@!8U)?q~KkZ-zySYW9N)Ap+`hu4cHlpn#7zZ)WV_!&ocs>}kME
zi-oSL$|n^aKUv~Ih|AY?y*n7Mm#y3F^U@80Vmn*P;%{~s+c)$}LQxb{RmEbl5E2qX
zL_~zq4vUSAB|JQw;rYY)c=N~HopCp+!#UxVhQ^zgH|eT&<qQ1_zvR_qCX-FJu}s4}
z=8-}QH*iDEesCc!Gu7(!jTq3`n9wCBztE^JuS?6;?c$eX`2d841ab4AZa#%h{_x>!
z{`g}u?!FsG#VmVh8kRTTbe4R6QH9X)oRr1&yx!>1&S&-<4rlqM$>hAtCxob%F86AN
z=thm0kdeWhty}4npKt7&qbN+US{Y<Av9F@!vnCCx+2mqkJEJ)F&!-ounAnbq?erqG
z+UF2LoNG|8_OwrE0zg^0#)1_;)amssTC)w?S?3ym@lB%{);9^jn9W#KRf2<q2@4A&
zDk_TD*jO4jZcKD^G;zUkJbd_JX8kaWZUx<pV;)tGGR887k&I-&zQ0N(p8(?-j|mgW
zBm*#)xlCaSCQOWHJad^VGk1z#ooaRZtQIqm{ce!4{rT4^bvn{yJ6p=fUv4(G9~nK6
zun^~3Hok;Ta9kXRAAXo0X3e6Yn>%!rqerof83Q9nqVK<S=&)&%yMuSWJ9>ZoqqBr_
z<3{LNQC4vHu>13@EEpgmBt%_n2-OU2>~^N@+{uf3_tMy7(d8|wN-wLG=j?V)SF`gs
zii3Q}Nk$TR-p>FW^uj?ej#JJ!GOGJy3n9+qagR3GvUR(S^^<E`UO^FGtl4gCKRkLM
zs_NaeR1^h8QLtDnMqWinN7J}*V`5`tiHwY-V|hp3-u5=n|M)yHWiiISYt3uvVeY}7
z?SICm*?cbfbp3L5>>l8ODwTu^(GXR8VU!X5JJYpY3&7dwdink3=z8r>6rk&Nrp#K&
z>B3?F5}U_x`_QY-`95Dlr@UiFw!Qr}KR*9FWijs1F|S>VxknG|fBrL??ZTmRjvYI^
zmtk1C)Y-8cR1wy9-34#I?f(3&x1e9YYW+C~A^fKyRWl6F&*$UKo4Gq91GOTzG~msO
zlFu)yQS!Npc5J89c|Y6DSsuY%GJij@e8ZWV{qRBvFa5f=re`PT%)({m8qdG`WvvfR
z>AIbl-(POr<!hhNgkk-X&ilQtwfIz3#cH)0c@-NQ>y=kGp1hHdH-F4+*|!-bpQWZ!
zrdy`dRqe_OZH1Jm3sFrqS`G7wy9XO1Iy+Lccx~<)zg$#Re6V<<F>SG`Dm?T18_pSJ
za`82EPTqJUn?L@T?AvZLN<K}crC6p<NA21bZH14a<GP#YD*3$Q4p_3p{r;jw&e=U(
zpZD)C%QXm54>YuDhPdEh9zJ}SSwH+hw*vPwiboZNF%}CWf&G4HNF`(ADCKk^*m$oM
zK^&#L+Q$?^oZl0751~=8b0+fC!^e4j{x`LH{&zlK&yG~*<a5sU*Y%g&$CX!Rv)Rb2
z=;&ypN+CKrnkLpJJemF^Gg4;I`AlbH-%KTwTdlWpJGXO4KO`MLA*!fGoxUqO#PjU^
z!;I~f-|u6dQGOJ7U#!{gH3I+e=z;X^l6cAed<h+ElP07;`6MYbW^ksnJ9L!HOsu!w
z3b)^me#nQ=@htgtINWRWxnyQuyd+czQ70N=HABbpa^Bvyjpu*-kr<D)x7M1?^e~(G
zv)zu(56}AvAp);c>t;MV&btlvX)Qh9_r;p+Eb*AU<(d1g=gJQ8KJV|DSHZ!-Mu~dk
z#*K-Kiz6~Jl5VBln2|DriK!C_)545>SD07O&D@P?_Gy%8C6ZS{_(+{HWy+MA9H3*X
zrj(SHv-iMJ0Jf)Qay<78{kpfl;2pP`(ses;FI>l5kCE@2uI<W`_YA4haa;?4dX`98
ztyZj7D`vA9lgUI$Obl7Whf^9CNA%vkC>0GQB|RNw_H1;M345PDm|S-RWkFFP8jQr|
zF?^l;6Ap)iW4UKIkzdH5UhQl38s7ic23CH*4{(mAzw+44#5avT@AtYg&6R6rv)RZs
zi^XE(T4F%~H)dr~YBqBqJRFC~gl;mCtg0+DnP{hJw5xR7^I3?q+;l9?a`-IDm`fhx
zi6a5$9f<9mWd#LHp@pCRM1&A7?OHbWYJ+Y2@fS{>veCbL8x+O=?GatK^Zvg!Fz4UN
z#(TF6>CQvHz4YwEm3d~>`SMDwXjip4-G&>pZp3D_aUlGF^EymA>(%uvHZ7)|){Zu`
z@j9*$;#@WE^a1qhlt9MOd=4MY1Dw;G|FAcMYp!fVXrrK-9^Ok{K@rcsvy5+l*l)bo
zvr|i^J#lNb0?yaaIo+lWSvTH@)n+67fHQPVx{kVjJ*LHr(b~0xHWE5QG$hSpBZ!L%
zGuG=nkeP$3DD+5bSu5xNV$F81#?_;DUdyO~T`swwE7MFS6K1m+v)Sx5prt4ZR=b^E
zCr;2iH<yg?a83p}v%0`!Vv(w{({87a-A)wloUE*Jr!N63uW*dMgwcx-0G4u!v)H|!
z^Ake&Pp?i19L&x&p84IMae`gx*$nR0-dKLdA8cn!`OD1Z#vl|p+h2eEzgue5!8~7H
zx!Pf7v)TDbj%KCLi9TGNdo@2t{7hbuv%Q&T%HwnOb5iZ8^s)CLf`|*|l@Pyne(Cfn
ziisgtx2LpRGe(<oPuuwSx4S5?71Om{iy8-y?QAKZuK0mhX00@W4V)uPfBnB(YJ6AG
zm(bCyR!;QkL+;gA6Y=xU1m!tH$CQ_c`uXSBQ&X|`=>riGIzluQ4ZWHnrlf@7Sy{xD
zma;cGnli=tGo>pEvlRuCuG7bEN3F;+&s?kA=>zy5XW2lZ(aHNg8C*jcw-HsXKMNtm
z#VLx3p}jj$R8q!|hn$O$AIm+%vUR&q6@{c$O>2}@x^Cy+-|pmv_rBslW{&axP1km1
z+7q|>EeFq+SFSJDU{%c77=~pJBfLDEw8%8d6le9-Ps&fsSLS2Z%=B{fLN!VCl@OJg
z9DXi@Uitk#UZ4Ms*DO+DAwk?ZtS2}0O`=VFT$PUZ%dvdcZ2pPG-|R4Eh=PiThVQ%n
zywA4Ol*8e`;c%eqI+~_YQc}X%vuCl{Y}jlzii(QRN=k_T@=Mw*Sb*7PbMG4&N%@N}
zVtVpP)Sw{g{0Y$jIA^I_!MYT8g+Zs*&G_3>w;8j1`b%Cx5ih^L+?XH%oTKS8p8Z{o
z8dna71H0XhuIrSSms3(wLQzo>g@uLKY&MFEi^(&YnA^TRt6F%MVs^0Gd0W#MUQrRz
zTiMSJ&U$^%{lqe#RsdYV9%J&Bkwmh}t5{SB5h%;n?c&V^-+DcN9N#pW`)=yPpkD2X
z3UB1|u}&8jvvu!b=6|)tYp`8a6&@Zvkl)|j*RR*^sd8Qw7Z+1hRD{iDqp+}$l9Cc~
zlpN-Cn8Vs;YrXdEZ12o_+ItLA1{qacLWlr#`oKAh)VmAUvpYTeoX?uaMKYjATe`Qu
zf+jIxG>?n)ni@SPzmS|$h3rW`Lh`Pk$v$!FoMW_4Xu>nUui8Vy)!|F%C^<QFm@|iF
zYrR9q-nlc{d+(tPlF$*NA<%U@A1vPJHF=cPV&?XtSMuQP1B}@;tIKw_ltpW{@x_|$
zUISdW4C&6Z_Yd>iXu50C15MK?EiI+ExY!ubve|5umX`8kcsMhYlGq>a-J!ih(|FzC
zAfY1DWI#)Z`e%1~HgA6Vt=C;Smn%EO)3;kIIwUqR+FxNIK@^viaV+-?Ir)Vg%Fbo;
z?nCTOKXT6GRf)}Gc;@#v_%vyrKiKVd>~=evrcqW_#@VxHjlrs-q9RI5OW6~#hqpVw
zO=d`@*S_~^_cGl+ou+D2$txiUP^Zsj<Mso5xO5XgXXpCmc=1i6d3f}|3$6nbD87VF
z#GXBLe*0}gGQC4byZ2t~)2E|0mCzBQA^5daGn8l=U&hC?piLWWW_Njhq{G3B<>fqS
zG7+SzQq3SlJ*4Y)R(`*a*-JP1Wx1KKkRTozJ&@anUKOyi_6zaMtMc-4N=r*Qd-kkR
zrEvD_SxU4L7AG!dVXK7{tHs8?k&Z~FYEyZT2MJQ8`bzw|1+>!#&fr;>lFoN2>1^41
znBtPMOYh{tYBAHhOCmS)OJZ2xq*@Of7hgh0D=8sy@nTvnT!>oi4jo5iB-+%e@Zf_|
z@+m|E;7c__m$uDm5*<#Hm@r}^Ljh;$W=_71yn-TrJaqK3sAkAf6y|j3z}jZby!P#E
zxAUH+F{t9MpHwplQUBP^ma_8ueI)NX#E!JADlI#sstQ+jxPn1F+jG;kU29y;P*a|H
zRaRE!l~=A3_2cH_%<4FcjZHRs?b}1|!9VnW&{yqiJU1xBuT8)^eV)q7HFl(Ck-Xd4
z(8)VpM1Db$F$xtM8A?oKD6vtY#5awmU$<8D?vm)&*{5pCm(VdEKTgM4vuLu>J9P9O
zJ<$L057fRAIzluAzou%2JrNPS-MKTFAt7G--m7U$x7%r|s#47$L_KCZTgs+ghuE2x
z<<<Vm$uFcyOt@DYtVdEy`gLnvrDp(ZgKGf3a$dOxs?MH0OG!xy|BLw_Gm~a=q|p&$
zUo&RLY2$d+{wlF*tmKvW)v47^Uqj(*=*0Z*e<aPENuwj~(7|j*8#fO7tFNNQO6Ul2
zx%)L$Gn8l=ixU%B*s2x970cOxv*d=1_0RwSAOJ~3K~!_9rtu(1$)^w^;40@;<r4L?
zXU}5OY%FQDgoUjZ8nb)?#5!V`s!in~(?doZO!7+n8c3(F27Cz}&1R$3k|nfSxX@VG
z9l#MAi#ByCriUbSglH%{s~L`+ETF(vOx|hlYKGXTP{KljF6(NB<7P9nI(B4ZlO|sK
z_Rw|yq3iUm==e!BgAgK+JoBowwA5=>;-aD=ii?XmYCXz~PBZvl%>TUhy+*%=f9U_<
zO7%*~EAgu!ojyPCC3LJukJ4$z3}XK09Xk3o*EmZ)uawXcLevkwmr%tpGbxE9joc+*
zW?-DA@v7ZUtdx8TAp)#&Ub(6iJSV0qEiGkJ+$LsqoW=3r<Ho*b%sf*52$Pvij1nVx
zB^orpEYALG=eeM$Yf<;g3yPM7gpfUC2!(Ch5S5l@tnH^{XQR%Yi+=JXjy`=LI9Trb
z2_fo~D}ziX6RN6uEtKq9*j-T+nimyuV`e5n4hKI)MxvWc*nu62!aPMGQrGF>F|H`N
zCWP>}%6a8#hgq#wqa9{4nYg0x3Pxs*#BQ>a8kvg2<iL)d6g7o~riC=MH>HcCi`Q|5
zXh@{f=O?~~PT>_-kU4TBCcB-;)Kp9k2iWbXDJhs1F2vrnDUL1@IzouL=Q*I|>iC(>
zW+T@WMZpYo&dp`$v14S1g&BAKicKa~sw!(84tnZ3O)IiYGEE2(2$l1y@*upbs;CZ?
zD|4@8(D6ZJhh=lD(J=rDO@%B|m$AvQiJp2-8k-u+0K8~$q|@hTzJ!iLRmr{bN{$a2
zL|Aq<jgC1($5dE|x@;MaO`Fhr_Qcd!LPrQu_k5{l2q`OLNOm@D3JXb#iZa&r%T^TT
zswyXSojwi+!5+sGLI{7WoL8QM@U8*)h_VQ-%f62IqIlAx(l~2A3qXdF!AI&x6zYZa
zxA(_lvKYq{;&LaQz5wwhbjl(k$iD76isIv)C7)-Vp`&DEpnmibdSM~<{{1moBy@xj
zb<6h>szOF)W@0y)NR5odQBm@lqN*%3nP_Ua(?v=?g%APcnOBOU7#ZctEVW{?sl>uW
zhGh*yQ#H~f(v6bOE$S8)nikShZ%Ic-N3Y`wak-L-Txx;q0b{$}PFY!*G0UfGD)i#w
zVjQPV(e|^?i2w3SOuBCDYfnf(f8z~Ix8E+ad<r4zjmi_fRG#Itq@;w5;9zDZC9yp^
z+H2qIbe(r}oh~xbix8p~*zI;44#zop<(hD>q@;vHjSexR(+u`T?)BPtm_Cem?eEe-
z=^%L}E^E^1t3|$qPNPGI=rm&nk$b&EM;|r}`@8R=bdb;yLevkQv*x+h_A4$f_L}9h
zw6v6UO`0&LLkCU<1sVIAfv3vLnGA%=+I~Wa06Sk^Ri2f&tgMVR&DSuy{cH*>1;)NX
zjv$`Xo?{Y|2vtKbySz#xjTNlm5QjMK@e81t$FH`u<pyrxDz2*ID;9wuoxWP;Yv?pz
zvxfGwXJaXFhmIpC2<^G&VA3Si(90}zY&Q7vOW3dhjvse_WoJWtJTz<O{u(?OZo3V_
z!s_~}g%CdQrJCWC!@*~5+wx_6Ji142CD`q}q3hgUQHFI{<(d$ek>ZjvHtaaa&a^D@
zP8X41;9NsAC%=#;G2z5Uh7wb;mS~TpmJIIMjz+=Oy1s0`^IT@jwZ^h%mBQJxXF1Jj
z=C+^9suruzP44QeHug5Wt-Z}CWmLV-t4(ZTDN9+w3J!9xO8dqW&&}M-Xhw4bHw5Sk
zMQy9~PT%hIY<}3A!LgGC<eVxbC*S6^aB-8EFq%Y%(<COG{#Ui3Yugs6YQtN*&X>^P
z^l949olA>VtGr7-+q6M@`)!m_^*nSm4VEl{FTQ})tD&UC_kDwdVZ;a+JsR$~!?`Vl
zsMmZep=!j8PMz2r8R@m}FkR<eyPXb-BGn8+_=&FDS(lQ|+8@%`y5}%u<(kj?S}kV!
zb#Kjey*n_pcL%H%a{#Zj_Ic)&t4g7AUZsVlF{9HA_J{BH+V?i?Hr{f)MS_x0@A7IN
z`*@nCS<70#9B&9i_&a~+YOeOn@kHIJl}=ysu0w3xagdGM4{*A$xJvs*g*T#Kx7OUy
zFNpzHwGGe})*W9$CoC<EPBUf@zTZ1^wA*gO@zz@?3H2;=Gz~uc3|@T|4pwb+>AadX
zgV$bzd+!Bv!}>=@h=#`Z5~}9RZr`4QiixTKf*cN>(=;Y=`IUT@VCOq*Y@m?il#@Xj
z$0?@-JHaS4!$K>pG{Zt)LK#5>!8E)9O;JDSx}DXVe`5ZBwvv6~RE>`p8yU)DzZ=Ae
z{+%1tK)frjbX_;vVU-8qi_42y)nXMNxBD2I*=Fn;>IgMTK7-VtI?t<Ia(RIln9qDP
zygT=C#4&;q3}!I#9>2_($tIf&GRP*IWRh9I3UbLk=lJ(>FR$?$@x<5Gk0ksopq;)Q
zsabrmcq97`9`(!d+9x#O$$N&-yGx>9j#pp!5<2C@#k5$pigq7=Y%J^!;0O(MmwX1*
zedw@uE&S<Euxr=3pCu(Z@7i_j2(4N<%Q{=Nf{YAjnP)}@?B5S7R-AwTcI}*<zdP;-
z?9U)X4Y;Zqa`Fqw$uHz|VKKI|r2vG51Q8w@MDw^vVk1L;_0<fgfw}G5v#Lc4uaeI;
zb~|rt8lyb!`qjtIUkP@WaGI|;&1wp;VfT68U=&6W!A(SRFEP>q6n>NP<1f7T&+j;p
znRCu(iOpje+NUE4&0}a19ZvJc5j2mBBqzU+W4Q(7<l8uWB$rJ)51n`a_@>c3_Pc8t
z+PmX9pIy!>=T+s2sfvq>$us2{C7+%;*gNo^_8vo(p(quZRoiy4i{J1YvdK2yGh^ma
z9_23Xq96S*<NKhwt2A^Lvnat`rPYjPEM_qS8R*yR7qufGoxbc7r+9P0w`|>W_?*vN
zckX&5wWLW*xbX!Tjij9XLiQXuLh`Od=e;x7vr|j{ICd!Q6Poz@((9Bjp<~L+GfF-^
z**kPVd+$Azp>-EJOql|&yyE>{vu5zjGtOu9+O_ljSQ#14X8_-Q*ZJDh^UuT7sdCp(
z)EiRGaACfcP=zt0Qz!O^hkNaNo2K!W!$CqlEcsl*DPG_R2Pv)bvEs4v8dq>HF@Cr*
z@oV<cvSdD9w%O~w*vL@s8QGh`z1k7qH2MO2p6gg{0UNg;<cl@iIhI@C_1W)l?#siY
z2R66?E7!Bho+aw8Dutq=B1%h3*%Psc8J%WuIMln1d$)EsuRC6+h0>x{^J)=`c!-Cv
z;l3eo2Y2uquhEVww7bqDn`~a<CFV2Vc+ZTPIm}@k<7#wlQTzPf=}X>qh?m}9L2*f$
z@t)OU=9VGdxuI{zDvxUKPS0k2N;=Ed?e?lgZxn3h*>S@d(Z91lFW-L#4us@n=j#Cj
zVACe|XG@oQ->q7*#QE%61z$oZV$U8r&6q*xVein<?!Ftx>#w7<sKwB++2EmvV9_G?
zdr?u&&fcU+HG3Yfqy%Qoa&{(9pLV~0^Ud(jf68PpqE1OQgKvB*p(<xpixzy`uAQ;4
zJ3y#M$!AbKDEZt+F;9}kcNCuUSrWnAK{Oo+CLRl|2%;5MvMD2jGO{V-M@m>h0lPSR
z&i?%f<!xHhkI>rqQA7h$TvEnsbJy_A)->b2u#h0ejO@+WQN3&QJYHG3#<F$0`Dj_P
zQMCXt;HtJvef;JIH`$A4UR5qpx7lpY!78nUFXO*tL7N3$C7+RwNdBz-nJ0LnR!TnK
z;T@jlX=A$?&G;w(WC%n2dY)};<92TMx|8@9{=!tI`t>{_u>9KTt31M_stP0ecjmF*
z4I(zOX8(xg6%?^x#SiCn{>F~#&0}{Cs$Zi`@4VwISA63Q=XOE@{O)(o?HxOyS1)%*
z@11wx>8GL6e+FMdM=L2I{>v|EvtWUD$!BCF+MoXnPdpL$l24lrh7E(QTix&7a04t}
z?CkjY%jwf_-+j)~PnV=5NJ){7pQv?G%}_nQl~9?Cl21<^>~`MMG=^5(^{b0&hDGG_
z0KZV;QO4N}3(wG$+lZnaK^NKETLxu($!Xr?1lhO;NzIt}fCL^S&ac-l8m{7!GXC)T
zVz0rc-dz%z_T;UEh4}t=@=|PPOPMljCCR%E8Sf=Fk73>`_tj~~?-3qhHnWXw2j1-|
z6YloU!#vD~eCX40J@d*nE3vCe!L=6YG4&X8I?Q2x)Ae5a_RxFquKiv5EB%cH;{9zA
zi@1k-jO`?n_?oY2MJvCb3*b1%`3=8e8{3Tc<}il`c`zX76aMG7PT$M#FZUW@Y7-yF
zv?p&RvAKWCRgUEr@Z39Jdexc_?cI_8_xR2AtK;YC?z^48FIwd6<Skj^edjMB0VYm_
zKmPHYU4021_1G~w%$Y;e_1>YQ_vqnV+pmA%LWg_q@xH_N$3Mc~{~ox~%a>k)zy8&|
zJz@kbUoNGdqSi<?L(TbCLKVS`PMtU$>OEk1x2EyB!$FH$F8Q3oQC{Jgu^o)UB%1OZ
z%?PW(^LQoLd4m(Y$q7#5o~3ybO?izgFjId@T1EX-x&3w5jlFpC?jZqd6U|<_iFsdb
zF}C}4Z_OJ||F%xrV96x&G*9zC{s+LV+{!VI8QU#s$tXtgAs>=VG6NaNT;}os5BPL^
z&xxsAc~yA;zO=NIZBg5pnKYBkkW8=r$7$nu)&43?)uxxsD_3*emrUEmF0SQTqoi{n
z1NoY-2_vwB;5KYLzymB{3E(XCT+e!W#_uwrPMI=gN=*;)(XwQgtlepB5AEHNHzxj;
zxM=_X<qHo9W<>waoX9KWVAe?h4j;{<sHBX3-CO(pe17rHJJ7i^3?J@%9TDMO-nn$C
z^S$B2&)L;=mrhX>R8_@nHe<C~u~;ma&1MuuK?@1t*nk0?>e7YC^mJowKjrvw)Oqu;
zXJ(@J?F%6xm%Qs&mC#|z6qq^Fz5U*M@bb$L$PxIVL!HkCE?ef@K6ns{i_iOKCxpL!
zv@DtF^ZtvbIUDDysxWF`7v7loTdwcZk!G<GC`#2D>CIvz=-0h9w+!iyZntwF^CY_6
zj;85s*mi)D(sFurN~rR2>oZplsjBLgYgVh($hEk$XBm-|MR<8RX_1kXRpiP(MPaU@
zV9|AY+U=+nSry36-#r{=CMS*Us|g{Qj@(8R)*5!o%$OKNIOB+AJ7>wLxa+r>B2p>g
zw?v^x$4^{9<@VPz_g&BU+xiDIFM4%OAiild8@3$)Ap68=O3O9+bZr%|b6!XS2|UC@
z#&$aCY-A%7nMg9pyu&-jov8#8*vU@PNb|Zwb}_E3^2{rX#p2ZtGnq^@Eo#chUq%w_
z2xec@K4WdaUCJ&#Rz4<LkLD`-RYp#E=9Q~s`4JzHPC8v2UC#L)Pr2kWn8C&jn@J?G
zfeiug@Bvt{GKx{GXFb_uW5>?de9ax)K@@(h?h*k}<4)f<Thn-J!MDct*ipTCVZx1A
z%xX=q?Sd?3l_6JmKvfjBr#eSfemr!H*vL>iwQd%$^H$5!rSRsPu(_h_b%}Fy#H-Uc
zcdm0L%L{Z|d<~tVrcL=}<VYOB!9?xbXRPg~?AnF$@yF=V(b%uLc<AuaN06S5qszrZ
zhqY^A!UXsBAOGm=@YROy-JQR0*x>wq^JZtMXV<Q^bAIuw^z!@5y&6|-;^TP##k;v>
zaCbudP}&p{Y^7iK){Gd?nH{NF<X5a;y7$0QGLGgm<m&bfvg7ADpyioss;XjgIOurl
z6xSU&LVj>C85O16r6v>Ks4A;~E_S;yfp{P~ep5K=)#1CF7?#qOxGKzq=Zi2@?j?pS
z%Giao<o72^D8|lkBK&$T(J-X^_zTlMT5W9Kbz?8a-`2lY&fTtMV*qxhWdY8dN^BlW
z+xWUIOa3SS#D<NBc!+t-;~)o_$VB7w@A!@b9PsKW`r<-)<@!<-1qFppd7T(~Y$zuh
zoggdJ`DasVDrKd*lGUuHtKO9>OjmdvTi12ox4+N-ng5S}oBmBZt=&aCeoyff-|-#b
ze1>m5>uEymJqlpO%FW!&7kt4P&S1mF5svUXephSP(9oPYbA}H;{E)V7+Y%BIQsw>2
z%gdQQeLAgLwIZ_88n~WnbW7&v>|Fjj=WAnoSidBmxO+%V4p}7++<FbS4C!uczq#OB
zcBf}wWRE&<#~tpDUJbbd$80te6cj{gXed!pQN+f^5*HUobaXVKk&$GM8N-&jb2&L+
zfP3G90xXX|jxt~X+SaW`d6nn0gZj*wD33gXGIlKb!iDI%j@^EqDabX=xh#Xr4L3MT
zI&0IEDb5)|U0!;rYKy;%bDTMIh8Z(vkehq%`aHfUFE3}>v}t5zW%>Ea>fT4olD*2O
zhW75rM=y`{d-*y*^SDSp{L4LFWu5C%_VeDN@BDtQ`oJ^Sf`fwz3kxGUI-0n+IO5{s
zh>D6LK~eb2k3TYf#|{$Cx+g%{sj3XJSa{Ik;JBut>pGWuV!;^T^1%uUyh=JJ(UgDE
zx<=)k7h}f6JX$do_w$TzaDw^d1>}6<@}=u`-uvfw#&+*6i9A`0?Js}_Zy&&*UhR$T
z*-JN7Y4P_!n9Xb+<FSApzj9uMhldj#9ZloLjg7oYbR_c1o>!Q*a~f9^yE}L(Y6^p`
zgL%~PD7jj$SDCxD%sp^8Nu9)*vNJ{-&C@>idCjExPyQLOXZS9r8O>PEa$^~YB`jeR
zn=Y|e{deZf8NT`E8)nX&$@uZ(*<WdW>_8|lFXy@Eo})vD4#dS(Z_vbIu`p`XC|-K$
zCGzw0FZg{m`j_j?1#6A}!8^5X#tY+btjXc3<=Oj((X&%az!`#Xe)=uC?)zFv0cA45
z+i!c#%t?H_bCMTNnVE3SHB~t5r9;P&n8==2USa37X%t`K4jnZm1?%9!I39fzE!R7A
z%B=3tQ728J?9BN?htEE9ucH?g<(#yoE}p4du)w(_1USn)XU(epYY2db9y*tsZ?>j+
zO;9y<RBv8=@|J*3T+k@k%H&6H;^EQm=On&Zvz=w@&a-}H1K>G=Znauz)Tj{=5fR3K
zR%~o65fKsev)P!vWeX1;I)v3@Kx)3(OlOOQ*%euKzT9#>movxV;GY$*FV^`xNGbR5
zv$1^#(fqxZ7A5`*%^63mvHcjCY&*|vpW@eR_2!?9xedZXf|&N?t#$HD-IPa0858wo
zpE$*`b-Qc*8eIC&hlhFC=jZjRt8!k2goF?g5kX8$j8|UuKhvMtTV^x%@K~&N=f4*k
z8XuWIqMNxJpXi?$6ZKtx>Uypyced4XlpNmR4Kz(VC!?O`X=CB_JGjH|vvgL)Rb1t@
zY{Q@U(}lnJGNEZ2Sy@>uUc8tUD^?KY&j|@HVCvMVv})Cg5hF&_=r~thbrsiMdo8cN
z`sxM0r`idzE@eMEQk^6ER*RXxJ#|~1%-*D`3a>ulo}ubMW)3UA-&gC`aSm69ukz$9
zW5zg_a#*_5x&6*Nkd@`#G4$#1zJ<=2{{7i9dp3v1j>Yck)M*;#k3PcOtsD9$?$9}P
z{q>YrbP$!C9C+hAp`&Tw`4{S$XZ$-$XH|rS!Jq%^-kv_aLEP<Y=%I5tk!pqu8%G8v
zwi{oSd44vI44;naOEp7eXeeVcGnu<(3j<EN%PtE{CLXs~7@#O@t?2kwu4b62>pY?;
zj8zmC>iUJN8Gt9rG!|R$N+agg@@V=8Bycs(GM^IcJWa#9gI?PjN;QM7+nN6#_l((N
zM)vmWES*)+DA>xlTlyK>3s(G4CwKe$(1+$U_nMhAfdsE52EaK3We<Az<(!rCDl9CF
zsHiC7;^JuBxG^y?F+?|tW<tgU=4_oqpZq??zBx(`6RZ=s&U_ua_1#bc6SCcp%*+g)
z$&u0{Ueybm*u+}a0?r9kUgI^t{2Vngm8k^dT$XDqTUo)1OYBj<#l*xge*Adi<Kt=E
zxG_zeHVx?ccJAECh7B8d>@ok`oxcD6`$<hrWrOSSr%I~T=_@PO_~2jP8{1<?^){v?
zuM1J(jTm=}`%c;HrJKCglBso*COLn9`e|q9&-De+v!}B&c*h;i_nv+lwx8Qz@|7>4
z(<nNcj0qFiI%f{~ecYj=<m6zTFah&**P-v;O$m_g@tj`p%$bxP@eUo9EOFjd1Ls{f
z*Uws49(~lk==<^G&byG8xrQD(mlLUGIKO0U?4=k7y>QTrkwnsqRO9n2*u(wA;-D9s
z=*TDJF&p0-+P;-gIe2By9;WTw$rZ)!WiL`xmBCgkk2)OWdUXDrB~<PiS0|||XUfXX
zd&loP3R%q=z*%y+m^J|`>Aa9&6qeDJ;EMBZ!p4`JzQkUa2dQSLnRO}YWS=+%I2T?Y
zJF0h`T?@eNL$5Lxea|Z>Vs-LQwR(P6hwm%C@_PRP9w4509^nzdIn(EV_z(T)cfP|^
zn`d4%YShTcE6)=3Hug45+c}Mw_Pj*nlEz>M?66hY%Fw8xydL#B19Jz`wy-S#XOuHc
zH&3U$yxhpBr7Shh`6!Rpc;R(_Xht(8;cf?dUSps+91imB`CbEj{!m(4%76d+U+(an
zdm}*Jdh0E2y6Gk&BK-5*w%KgvuDkBy?-zLFs#^bwRSul{Zt8Q1Jp%8}VLd8^&X09>
zF>k!#Tz9YXm&+gj=>2}ro;5zDFQH>^(}tbXrm^Rxmndo6*p)dbTelK5bSP1;zfSJJ
zffTlNhK_RP4Cd+Hp~DwnxKH}bGc{Xy-5<<m=XJPvUSEJY91iUH{tp~z*r9W|kZOht
z8$cM_>11qQMI(+=4mdl6M=581#htMMgfWuHDtB0XFQGca>@8aud-$+X@~HtInay-F
zoB70Jt<&pIo#Kje=XK^N3U9!9OQ>Gpi1GSfVo0KHaxNY#k9w@v_Yz0Z@L$f<6{%*Z
znYBN-pD(^=WX%>{_Xkx~7&G!}W83rk0&O1iNFjy)@E=SbzveLyaIR%Ho7tE!F_3{w
zVM;*CKhKv}k&%&JCF<ef;S9|m%ADjmw6e7_THv}}XHN7S#&#V`Vqv0j%uho;CAB=&
z7<l)*i*^@x`Tb|8F3)SJjXQm=QvDzFALwA}K&TSRWXEKR^di5s#dhu5MSgxhojP^8
z^f%W)c6K%?DJk4}=be5%?yzCQIB?(q`}UpNPN-I=@B8fsjo0^#>|Ljea=KV8X0OoM
zxZ~hOzPn-aHFWZa4kdZc9Bi#x8Gixnx=!?*IdmO6mcm4L=!AUwDdnjZp;K50tKBn&
zc}=8JmpnU0-+c$wEZy;yv3BAQKVa(60VOmP$K=WAMg9pKXxO21Igo0GsyRwI&9DHl
zk^)*(ymo1VnG+SA!m9GEgsKq}GBTL6bt`>5?!e?I3KOhWt}~n2t?N)y!UT_Js%HiV
zbELG?tD0d21#HDRb80XOui-t@UTvF93!-q&hP{tsmT;<0ug4#xnxXoNOUl@~=diIo
zxL4iZ?E$#1cSqy(j<hUJ7ZzXSyZz?@9>8&)U#^bb00wxyKbgq^y`D>zs7FOb5vfL!
z6<$#ytN>=f0VmBTS=V$Ou5q1GQz_Fd(<m=5C)JV4L7eT{IO6<%x3VU>($$zuCYRiR
zPw3)sIM6hW4f+Q1OnH=0!e7<D(naaQ7y1`Q*?x7~V!L<m#$vH>-F4SdQc}XPW5+0{
zSPIRbzW@GvA|oSd*|OyYzsKQlke{DVPEHPb#f<#Au9K6K!<jQ@&bv>G7A=U0iDCKj
z<>!1><xXE&xyF{g^)GPX+|cn{Jo(qem(WooBMGl~F2N&nFrPe0({<~Nv1C(eDVAx@
z(BaE3-OtP=CArHg>snkK46K;&Lerer89=VU(Kl?sl$Qr3C8&S>D@vCx=wH-4aG+s_
z&gDR=8LH+J@_2;C0X>IrB~*5%?cB*rd-l+{qy+4Cu-n<HC=88?;`OK~2Il6{wy+R@
zGm64=v)QYf;VX|jk`EGRbY|;H6e>@6Ovk>o7E3&x<x_U4W~ihts~I-zIB1ldCpM2U
zGNG<Tg*W2L4$g^=bluLz?FZ`kit3gtuPhdekylYsQA9^a6BZW6{b~23Iy{y(Ggo}s
zah59B0SEj$<lk)5wt3w_8^H);*3A0iW^OiKuVGEV&f|JUyS%)dI}7flYl(ZQu1qD9
zF_tk5Hw|aEzPs9)wQ}W3x^(HnjvYIA_uY3{xpF1r$B$?J{P}+TNnq8gRdnv$8S@1u
zLew;kFTVJK*|TT!!3Q7k^2;w{v)Nd*Xc0@6EMd~5Ni1D@{&L#uufLw%yU(3esmh(c
z9jWflRDB8@I5%`Q{0i^(dAd~Sq}_i%4%Hnx7swn!{{3&XZQI=I;(_<wwff*jk7um{
zIQr@tI0bj!Nr}hWfJ$a2mN8>64IhrayZV6x4Lfu$2U5-8&2v(g7d=WJ0eX?j{lxMx
zfnT4?_Y$gn<|HT6%4UO#Mcs9~ojK9bjP2T$#EMQIz^5T0q?VT(cl$icQ17CC{QKs4
z9jhszgup)2=`Nqr>0mMuswhl$I4JVNfR>9?GgOajT|9uHeL7y`JG~_*Co_Hebe?_o
zS!U0kjjrn~T)2>F)21<L(j*QZta+aF?bgb8z3r!8YJ9xQoo8NIEEYmSLI?>7Au}Qq
z{fy3#O+$#w@yJaRU;$J>ulTaV3qdb%!0zru4`y)f{vbXWfP0Cs3?C=%sxH?cl%>?d
zC+VN?+`;FFEO)O>w_aUOA4?yevOh(xmh00}J}$+@#iXaFbL!M7jvqhH#EBDm@WBW9
z!yo>@q)C%VO-;S%{#6+u%gD%}apMaQmM&ScgpiOBo`3#%UViyy{`=qmGJN=O;^X5P
zK72TzfBrddz4hP>?G*q3AOJ~3K~&axCnM|HwJYC#`|UaJS9z$Qx`AW2+xhQ*|I3aY
zJ2-y)IAg|)p;@zLeEH><96NT5u3fuw@4ffdcyZmn-C7y5+wDm|;<eV*uaW1%?yhZJ
z*NMo?<dm+nX~+;d?%qw4ijqiI=GbxOjS1(-K+p>>V2_M+j}mnB{l9&!xaunR>&i=F
z_?hc}>Qak^^iMt^<X`_Han>v>6?fv)_3Kgl^r8HbN3c(xj1m)rq9{K9-FAgeSy`D8
zIu?tC_U+p<dh}@e_U(JohLS4)Jpa32NJd5m*IZ<|5YNzYI2`op(}(rz*YnzIuhF+}
zU!HyTS$_QSM{d9Ub`-^X45@3^u6+36hZi_<{Z-$q8D5|N4dAY3sErP(gI?!-zZa=A
z#bP|a2hfTjj#et=%t50Yjr?{!p1J1Ps0s=SA}A=xc?bIRX|lpAN^%v&`K4)`G@Du1
zw5juXYLkgllZj~-3!j#kv(;QeZpC!yahT~xsNb%+Cc4syR#?fP3>$X7!^VgJF4%6A
zPdOaqRSXFIRaN=aZs%{h&Ycy1?!IKqg;cI)ICbij(TVpbU#l5TojQf4X~f3HqN*yo
zu9KISM{scPdG8Q<Rx@<<82k$~Taml0`-&#MJqx*Y>sHd!(|PKtr%)7yPMtcjdi83i
zO`ArSE?wx+qX#iDF}(QVi#58o4vDTi(hl+piZ0sl_2*sV`sjQ=pUGrGRaO2J@h5(E
z{0ygny+90*1V%(E6<<1_!4}IFG`o97)c9IjI;JW-uPMusg>Kgab}rAgR?V0hb#xSc
zv-<K`+t2u_<yYt?9Sx0{mYFPaEMlrQm4_S;`IK3E_Us`oEscp2C-T4p?q@&a;^N59
z&nG)O`@HS1?c28-&nH{0R!*EaLD#Nbx#gByuv*XkH@d8>jH03<uJUZVdf2~zKl}IZ
zXYyocIkL%QLen%9MPcyZ!DMD;GIHcd#*7(rPTLD0I5_ycvlLgk(|0V_U1F9{g@uXN
zuU}7baWT(7|2&&FZ|1JM?qdA-@%-sef8wsY?qcD>h1`Do?SzGeRrQj*c!o|+exZa;
zC9cqk_|u<o{QR@8nS*7^794HbxDV8-RY0%3%3SO90p#WyWr%^`wYam{%+XP!$m-jd
zwx4}Q%dft|r0bw*SZ2<|v1k$6)TuZg@-1+n;fGFrcR5ru>`u=%su}8PV9V9vTUBWW
zxrd446^=5F4Cd2{WNds*0Uwfhfg@F)XElSWs+i4Y%w{vHs-kHc_ot=tNm3HJ>;E~k
z+1c6CG-v6js)EVHze7U!LqP#+9PV=E5kz37W`mIabTd)>1LwMID=7$Ar_ZZ=s;G$1
zA|lvVF=1DxqA*5Ln4{~wsq1uClqwBqdGf4g*t2I3v9Ymy{q@)U<~P4#+_-Um`+0n+
zW>~Uh2^kp~l$MrKR#wIfFTB84UwuVEK>@pV?c&B8Z)Eg&mQ|{YYKGG`_j--Z<1XDn
z&dbYV`SRsVojMgoQ7A7jr?|M7pr9a<l9Jf5V+Z5MkLS@xA3bN^J$v?$n3(8uN4$Al
zBsd%tB_3f*!anBOFW&LHm~67qO_%<6{6fbsqKG_GUX{=5dAt**6O>T>WuP=Pjw(mp
z$5p@)>EMLp1jOMUU3dI{_Rc)KscL=Oce0Z-Nt-5}u!S;~NoG-?3UUBJltDy5R6r4d
zQ$(vM!*M_b<p@7T<vS_}inHQD1rY?nBg!BuGRaUV&=x3dDQ)RICfVN~X?BuMbZ&ul
zbM+#7uk0ah@?^bhJ?njOjIft{Db9|V6%MNpE4v$e(6^i2gsH=7+{Z3YS7en8J|KI`
z*n?g6a{#SPi%sKt-=wNic~tu-t8A-SW?RNB>RT$*tfNPdqE@SU^wCE>_HWp*0li*N
zt1|k&OP4O?x8Hta!GZ<K08mCo21}PN<&#f7;lmF<Bp@Kb<Cu($3@%-|guj2;ag<7>
z;{N;ZSGLpB)46cr0uv`r1fWHW7OY*nw#;LJa`mptL0@uOw(>Y6uyS8IiHV8)@y8#^
zD3ZZo;OyD6^zPjoqtQs$u3dTf;fG5Fe9_U-N~X5T;&1i_S*G2k^K|?*8oT*Y_1}2$
z@s1AsWhnRjIXR9sUsc5Ye5wl<YF2yBYDJyk5*;;QmSyA%7pkf`XwIH>HH0=Y(Qyy@
zjvPU%g<|pYb=Q@dom3^u_yFFrOt9TkaBNyF8n^e1Dm4}DqmN=+wF=v^WvFkdSa9I#
z7oEmVZMYdOT)4pf_uo%QNC@lKuO}fP;i_^otR#i~#l^ziYxKQGOQsXZe`!NMPVg}f
z{d<PsI<tS4=VmzT>x=EuB?j!;#i0%zNNLi<c>rj&j-bzGb8M^CJmcj>8+$&*IaBxt
z4VSp5Ec)Wj+r^Jh)u1C<8C>?M0zQt8=D$WGD_XWBL+e=IxLuOyElK>dsE8NscKoXt
z{0TQh^+~+w8kh*MTz)3nZnt|3%oP?ElAoVXpFVv6=-IO;AAInE^8DP~TsCajz^PNG
zc=z3R*|cdBH{4LUx^{sUZ)Dj{+6_lIKjvqq@@Z9G+SQHoZ7RF{NGN)PjH5GF7HTMv
zTr<3lG3aaM=Jv3vteoKtbv9<^eqO2EXL)cyIzWG^KhIg8V}X4^xq7v3-8y>q>`BX(
zo`aNs{q+|eI&`32yLKM?KmYu5-hKC7cJ10lNJxmX-)uIsaN$CxPMykw4?f7IO`AN9
zb6V)j)35gJ+k0#uK75$O#6)ht{r1Ye;Bu%&(C1nUQI%|V_uhN2@;Em)7cVa_rE~i4
zfB)O#xm&kx<?!Ldy!YOFEL*mWJMX-+(%11b8IWZ={m&d>>XDye!v~i?=o+DhnuE&f
zR&cek&Ggkl5URRxq3r!`k1MG+NCyre_3w}Mx#zGiC|_{k>KC2HPHIMu^0>10De!bN
z?Af!Y&fE-Pq0Zo`;Ve{B@n<S!4;I+5b2CP4B?=(h>tG#P#TF`GVq_UEU4p}h!QbDJ
zfXYzpXK-3Ri)ZHdXtiX^E{zLpWQh_&an05zVXZeeg9aFukU*bv=lCovjPIH^$EH$Y
z1>VtWStHB5Y_&2?mW7+4p3!M9{|yur6y&jPXzSLk<mTowYSgGQpD#%g?c2AfbLY;i
zUcI`~_ae(O-Uc1A-Ht5R-Fx$jMg~O&E8BS}MkT8pGhEQ<lDJ$6m~19yWX|9Tp1^9f
zqSb0k=~Q}pI!BHi;r82a_ZYOkc<~}zw{GQ`XP)tRenv(H^XJcJ{P^)6eJ^*Oc;X3e
zx#bqV`|dlB&z#X{#AGs&ot<6gaV7cdufNdi^>pe~xk28t*7-pV?VXje767Gw8DD<+
zCE?-W<^GaFLqloZx^;!K2xTG5GC_VmLUbyi2AYGcR-<yhk>cVSSKwF2>-cJl&152T
z#teAk35?dV1qZGT(P`{dN8?Jm8T5L6rQHn9qT`jt>1N1j8N{BJL9DJpVvTrkSsyE)
zd<zw%R%7PU(?X@H(Y%!vNGR@*J1kUcWV4wIvh2w0>zvUmUc*Pp*W$L`FIsZFXB#?e
zXGvPQ1$~DpB22BWL;I8pe0-3-y|D)em#|OSu(@eds!GM9S}m(=HkR3J+){~IKjCJm
z9SV!8-p`4Oio#;C(4>hgBW!+tKKf!;i<g%dJ$v@7R`L0q+<feIEBe!c1a9v_pDryc
z{2r+2{Toyegj9)MN_pqd*>(68T;7_mQmM*4hq=g%!B)Ms$g(UW$r6G2fy%bkY9%i>
zk9mXUktJna<_w+$<^_^$blAJ&iKinSt94&>MLe!PSo4DBeER#RW!6Bg3Te7DilmB5
z{n+hxY&IKKtCg)yx3a#&dXHlySz>VfU}h%Gq^(a|<Nz6)&4xy!L6&6?ojQO1JaKVx
zj2t=A;~HDHZY4iIpAjQQV7J@ZvSkayh7BV+I-1znSOyOs%<<#L2@4BT-tUqmk&uv}
zBv0J5X_H6)%UOEp*s)_}TF0G(@=|fK#UFn7ftzo>nWjyfD$n`x#~<n1wX4TICxwND
z%4gc0Dl1k<pjqh@C8lIlx>MxDZntyd#0lE8X`=|HwRi@}x$W#!mNl|=Ig(N`u-mO1
zHwCgKtUEV$46U~46a)o1)_h!s^3Gw`=_v54ndlUm&Dadp7aduW$Pe@so!q=U2F;s?
zlvOp+$qNj`nCuW8;^P}v(3g~?Jj@FV<IfL1sIlPa($bKMDla%qw{E4w`t=^i$dW|-
z;K3x#oQY4{wgkxK3l3ZxqSM$(O?S=oRmMK$q$+NPZQHhaxEZQaFxt=8P;8-U%i+8G
zvh(tXTst^FPqOU#ktCOn%d#T?EDN=oLUrQ}`rK#wY!q=urE<OA+Q$97mG}+>I3P*%
zmn5FET3KMX3pYa@5fbF9^ubcob7*;)+zJ^P86+em5Ed4OPN(DJk3VM2m@#;JJG3o7
zKcD5xmosbDERW-=Gn4GRFY_PmXnD9J^Zq%MqN1X5zlUpTb+3(cly!VvoYQW%W3^hz
zDav8ofpKhZznMHu9{Ex}1-1gm@5n@%qwzr*L9{GrsRVs-#5L-mFW4H4UazllA1p);
z0eks<Z0G0uu=in>w_nb2%W;qP4i`Hx_2^W(6?VgHHlxvKJann#-)YO1Eoik`!otEl
z_ODvCikok~nQq;>arEd>qN1W0Hf$I%F)@H+0DbuI;iRXhEBz&vN=05?9$U9=rA?bQ
z{PD*hrS9Ly$45CwN&fxsf3tJvPQLy2TQV~<OJyL=%*^DMUw)yVvs_sT5)%`-<(6AY
z?XPms*TmnXe6W+#vMLqyrKhKpoSaNpSQr;CUS!v<T^?DYHgDccixw^D-o3lB&+2X^
ztO8DJ*7lHgoa)-0*^>qc(J96$Iz>4-92hr__M11O$;(5^&&O8a5S?-~hm4>g3R<>w
z1$}XGuG)Bw0k@#f?(bhKf+L57ILcOBMsU0jAEy2C<yek;3eLq29XL95DuvxDCpd6z
zh)!cCufP?w8@wvl@vo|zp;@zLv})Cg|Ni&CRk}A>mI)5<6>f%#kY&g09#lGDaiW%G
zY>g*(%N2#mW@AQXCQkrXqfxjS>IjREQF-j>i<O_16ky4cCH&_<|6$+0eH0ZHap}?}
z3~mF--+%vosqdTWa`93QDwP_QS|YfKKPHo@+`e4N@4=e%d1{hH*8RA;x+j%Nh23ta
zu&@w=!N91Cqi7M=g10SildsNq^u#*@<*X){cxWQ0I=D(|xCdB`1&^6NRda%Zf~qxe
z;NIWzNSaroU6y4E?S(7|UcmZ5&)UrXx&BQ0dlI)@ybW(}Z%lqB%w{ttlL;>`FEkoW
znSa}Z2M^M@bLUdl^1Qq}1`Zqu!20#;6?cHyY*zlZW5<pqEX<X>Mv^4r;^NThbYx{^
z;aA24(D32I*|>3Isr?BF3B2*f8+7T?1zDE)`s=R=3ky@~BIoDl^X8jxGIZ!rW$>mX
z8#ivGXV0Fc_E#h5bJ>#;Q!?q^zJezgvvA=;KKtx5PMkQwu3ftv-tXcY&C1H+@ZrM@
z8Z@Y?w^AmTGIJHt3GlZF(J4oCE{+;ST#FW1-hLZ(e*Wb&heH!5(!srs&xsS&zOOpL
zE#Oi$uOGp&7Zwt{U;%+8ioxgl`}6mtNnE_mAvk`f$_Wl!8=}+LaS!y|1Hj5s6*oh5
zKHp9^gZ^|p!8;Gs$juN`P*5qGclj17JAMTPWwyCfv4yG#Lp9f@IV@B%fyK$LTo$Ta
z<_#J|RuzLj|9mSKi~GY#6nR)G8=80umB#@^@Xc?()`ERXN6}?|N1pbnrmXMK!Q&W7
zmKhu$&&;GG+WPn)2LuQ=LmlGd?WH_EpPXL7GaZ;rCi?a3$Ej1NID7UiD_5@M!w)~?
zr=Nb}?AfzeEEev%>#kb4x7dU<RB8!H>qW?Qj<tm4X;V%5OwQxW`oA%q&;1<AOkYk8
zk|go5^f4(#DbNIHO}XoBTBNmLSm7|Xs<!ey-vf^9m{XZrqx-9EcC%Y~+)C4mfPjFS
z4Z6GawaV&;S*=!9>Q=Je-_`%p*>#ML9?jTOV=;S~@d@<7WHMngneg`Z#$Yg@)9H{T
zsZ1xK!C>IQ2Oli8|IIhw<daW6Vd27sgolUIrZ|&*ixw@=YPFm>bA}~LmX!HAva_>^
zi;LsQC!Z|U79JkX|NY<pk(`|DVYhDDv?)uME+r}|inrc+i%y+7v3>h?7A#o6OE0~I
zPN!qgph4Vv>#gNpGa(^?`Sa(OYOB^vpOdqRmGgZ2`uZ|(;6S!--%e3c5sMcu=F2a?
zBs)8sqeqYO&_fTE+i|QaXOq%hq7&Rih)xBfBYpfaMJXwl(;U)Tw4iX<Fl_tx!}ku+
zVdF-4`Q;kjU#;S1>ydi*t{1`4tz3z}Tfk@6>4+XZnp0!P;$=1y=u<Vpfonr_8an|N
zZ_X5JTV?E1;OS;aNlB>}H-q_)qjWhPE8GljxGYpfj5~0E&F$Nhr_qovNfbB>^qNd%
z&Hx5wWDsmC<f6e5^gHYIH5TICY99vK)U{-va?FZe-ah5c^7idHZt)xz>~QfSQ;!~{
zTVbJaGt?6|bZpLsU;YMQ*MZYaA5*d8X71d%+;-b-WM^kHVZsDVCKFw|cIC{OGxYA=
zyVhz9s#Gd||2qbiT8&Dj<%Z5}@$>VmQ(Y=~p1L?^ZJoo}Z*Z2A(dac043ro%XcN<h
zm^QBW>-3Y;@%Q&<h-wJ0@frXdDLqiz(74~zaLsVMy}fHCkyu&hu-R-B6co_L>MA2P
zAZY+oqNWgR4aQ(G;8WcH^6~Le`d&_bDzE>wa^=c0_uq2ME%ff)8(EgoYF&fEojP@5
z)TmK>_St7V@W2CQ9=mz-X4Go6$J${hy?XVcW5<sC_~VaEnl#CyZSv&F%J;f6N!8M&
zODQNQP|6aO$DTcV@b>nmckkY%+NvD%b!*p*&)Ex9PH+I8d+s^*?b}CTVIh6{_C=B;
z{`~V#va_>!@WBVmoPnqgB}J!CkM=@z+$bqJdX1(m%^{{u8``*iNuHeU5FOR%(eUDn
zjuH|F4>q1;E-5LnYnQUAx$nMu5gcoqHpr5M%4Q>JzyPAAOu-r)jKxqr!GUW-bQ(Jj
z%etd%LuKq!AlwX<Ikv9vskDXaA}!+Lc-vwjU#)i3=<D1WEM@x{CLTJ(iH>@l)v%JN
z`Ydl<;y%+CjE0~fb3NFn>?{ZlW_^jWN&dOHO#1t8Zo7D~*goYa+zj=^KYF%Br`1qc
zWaZ@9<jdw(kR+*;4u^$>UDncRG#XK<R328)ib&7O<Iu^3;=j9!!Qq|I>-80W57$<I
zsj*UW&>bLGm&?MCg~a&Ac%%XkP6_7TZTGUH*A8W0my|9Hunxc+XeLY-Ml-n?=T+xP
zA%$J+q92W8iOq42a|(wO%z}kmRkv2yKd1>#_drom5&d)fv-bE}?3s3ga)QumwHVDt
ze0+TH@$tcEG%9)|Nm7lz!^%tAv}DN=MvNH2>eZ{6GG&TK+p%NEm_L6$OP4OCZQHhG
z9{=d0kMi-yAD8NX0UmulCthA&rS_HNgAYF7;fEhCGox{pgTC-?t*azB;JESd@NkcP
zm+K5Vzci|1op2W&Ns{PyLwg}QWr&V0H<yrw3-OJK@hCr#5**C7d+(*!4wvYpbm@Y1
zzyJcxW{iP>*l)ib^@a_O#`Wu=jM<}lXUi5xv1NdM{ZO}PQD>KO7o6Pw{YhD~hD^Ji
zoFIqbn2mKKIB@ldPGcv)?CRiE#y$m}Zid3bLg8kp$MaQep^```DuO0WpmpnV*Z8$a
zOJi7JA?cDCif8zClg-pRsx4R@cH>%?)<N>FC;OC+^=_Fjb#^<WqoWyn>J(-#FMI+6
zg`1(C-3$i3j__`+*|F~=06X@bV*Jn>Ywi45Sy_De;fGwfaDj^#FS2swN}4xsUMkT`
zNq#>Zi_K;SRCMnUN^ljE{9Ua$KVPyevxYUy^_@$yI$3Gg+O!P+YdCivy_2NCBo4Mc
zsI*OwovsWX>vTFsFoO4R)P?+pZyHU|_c@;{k4G>9t*UO5V5w9p)M_=7B+<#<iF{2y
zDvM))!rR*$Z*OnByu8qAwTc$iRbRh#>(*@9vV}#977-H@!yR|rfmW;K@ZrO3+qR9@
zUVE*SmEE1uqet`g*I%=C?OG3)L3P=-Z5tUG8BCr$xy<$|2YouNrcMP197zyjV`Dje
z`ZQmD`6UMq9N?*^p1SODB}K>ITsxhtD;;;yVa*zR=gvi)>=GTDR?A<*hjaAKI|)om
zqU}MK=)_L<6dl#rvEU5)mMw#bh%yV9*Be$VxOW7`jH&ZL-d%9)ojRe(&&Q%_7{P%n
zPjnhPox@zoB5K3UFlo}Ha#O}v72#&6_#CAzRC)*wE~QazVq%DC<FW=#KY0>=e}C?h
z&3sr~P<|sBG$!2dXPD$yPxdJ*k}P9WsTh!y#FVHgf~{5z7K?B*G@zSdV6XN{AMC3i
z_c3}<cXZm?DIZ}nnTU*x1YpskMU^_nX0!9@MwhjAV6RFfd$<O0+M{FaF+8ezl%KqQ
z@@Vgw(344jPNHdHQ@jGacrW}tr7b)uoZj}{`1<-{Fc{EiG>l=467;QL1yA#IgBNN~
zA%(YjTiG7Y@H)MobD&S7(O@(>k{bE=_#jCVUS3}4^?I~gtuk>`ohkrTrFrw_EMLBy
zBS(&qoSaNiQ4#Iix95Qe9#HPFB3^#^WoFNwP2awK%UnBLS<=$d_~@gLShj3gxr6i7
zQi;CZ+bDwb#pb=WDmZ{5-0o{)E{Dx#=cDiTDBJyewyWUT*A7n6vB$)qdh}7ee)1HZ
zgq}V5bJ8RVn>HoD%Zu>$T%wZ{9*(`Yr|2+tEX<wj$d(xw2P;-I>}=m>pTUtMj>i@Y
z)N!EE7zGEeEYWG~2sgu(McEcA9ScK3i1GFHC_fOKlES^)wy~pEFJ)hsloSS7t(XG?
zxm9Z+kPK3=l7f|8WYZ7N+KLUqaq>BZBVmpnHA7UsNK)Nsi>G}mmo+IV*fTQ;%E>9V
zPnm_AfrfQ64C>XMx4-;_)QlVwQ!-fh^PyTFe6I>yemh1?yrW3HkI{?ax7N-&!7CN#
zAbWwWfW<6kiDn4}Dp$g*pn@Q#9-Yd~=Wj-5(4qI!6BQ7}{wDhYM{T)B;vZ2yW6s(0
zA*vw^U;w}H3;E<TpZR>qhYj^I0a(N$(s4LqdeDQhjIHx)s?}=cbF0;Ak!2aRTCM1i
zbD+IGzxz}w6<xb_t=6$^+O%Qbym`Fx$}7C~+H2Kv1<A6^yYIfsv}w~ym7;N{T9Miv
zeLL~N`rk-S%OW`~i_d@9%fq8?uFk1yjdedCRFW?U(Q%26t)KuFFGjOu2`aZNdj&y3
z9GyCq^Ecm&L8rq{uO}cXiYEIVq9aQZ@sE@i9hFuKuf7ToKkPWsf(4F1tDJQ*bxM9d
zxLa$Ud#+yYqcI8&TsflC*r`u9LrhEzpMU;22M!##tbGcEo1r{BEmSbq*Oz3s0T->!
z#_+%X;?AQ-NeT?)pj&V-JvLUEu`=qs7%H3iTy+V6Z@APbg1*mjB~2TQ34^L`*2_5Y
zv`^W|*Jw~#EW*uDOhdaFbXpBF?(NSjt2P7h{<_@^zqJcK#`+&<D=f0I@*CHh`pI|Q
z+#vVSSg;o-M*7wED>F1Rh*n1{ZIUc8>f9(Mo}P#W3;IAk#^UlOznOkho_AZ~ZS<fA
zK0ZF^^?Hvrvaj(Py>JX#eZ)u1WF|LpQ~kckVvcacW0vnVUPDv8u%b#h^~vcjaPD*e
zxzgy<rw@Jl^r`moDwT@opMU=H&y%a^583kDF&3<FWK8rida-87BOYsE>XYo;0>;f*
zMS4~q08dZ4jj=<nyj1bEg;R8Fzy6A5#thWaF42)CiF2byaeCrJuvpORU7}<9?mL<n
z&#orieme<^77-K_grA=uMx#*~$;E1g>#qlA35O9QTv<KqlSz{tGkxH&aK*;fo7L3W
z!F0|nT<L-%@MOa;fAi|<9|1?k;<c|$tyMQeb+Fm&OnCM~WpL}s34<DRbic9SvQXK1
zRHfpl60=1;6B3y8=btn!EX2#pi-kAe%>LrFUExVdymjUb*IjoV{{H?L3<fr8vbjg)
zNMxl)O)Om+v`~9GHd=F-bR0=rKBYAisU5p;dDv_=ii(QJ%gZA-Hy4}D*5GaiaQv;E
zZU$#idecoeRm#l}6BEPi*|T~3?YC>}W_bMZ$9eI^7aMeN%Vx84-@jH9f59<8(YHq!
zuRnE9z2C=z6`R=d+cChg9{SrirZ>1&HUv%`O0}gjPd$&1G#`1icgX5MWK<;A=UlJ!
zyPVc&fQ+0BUi5vDR8=a^#5_Z&C6s`G08AzmI-Snrb2f=de1@a%6G|w1*-J3N_4Zo9
zVe7n=TRD!ST-FFiC?zH86K4n``dyVndg-N?UaHQ4ZJP)2$Kg1V)3PWmvT-~vi92rT
zgj!v{zj&L?&hzhl&&jinHEJzG{CRHbo%MbnjRB|V*iutbMMk21>M2yIsY-iRhYlQi
z=_M`<ACBH)!PnOpzv8TGdcB^!)~&H7CzBf-Ox(PA_yz`IHk&aTjmlaL0Mu$nVuWwL
zacoCNgUtrDl%23rEM5$6zUkV2^G&G7wH59Go^uV02>7lZS~m;ehh0a>$txr$uMnM9
z!wnrTpT)B-`SyPY*u2}(x$-f3F@O57YqE3Y#ATtfu}GGgpwV#BZ4FjXK><(v{Wp_N
zoFG`Q$6~P%+pHPyw{8tM>dU=w;sjyd-dHRaW$>$$+Q@fgkVFwyWNgUXLBl1bSWHcS
ze^&qiAOJ~3K~xey;>al37B5!N0yXusZrM4SuGi}^7z|ZfyH{8Db=`H>(WXrsTDNXZ
z%a$$6v}cxupPwJCTD9Uo|M?FC1`Mc{EmM|d-gx5;MvorNjW;&zfQwqK!q3;p_Pvfl
z-E&Eou-j#B>{NG&%u4df#y?oI<u7IX$q9q#<hCaITEKk(c(r{s_h|27kK|fvWUv{S
zc4`{4j?bc*+)Sw*>F4LCES-@g30skkUMam8m^u)P(SoIT-K;a<bMIU9q$gkT71?By
zNhZJYD-ZAhx_YWBYQ@S(M)DVqzr7DWtYaPibvzhV7NXx(HL4x-fg`}$y!#lkER&d$
z$%V8m`rlZ;Yw6zo@2_my=~&YxNop3%7(wWDwNnD(O2J)p?5kI!z2_dJJucC)84R47
zHjU%6W+68#Uv!FWHd1=^B6Z+EjFyT;hb~>9puklsVaE<=+ZMWYtNR!H_17?SCO9(|
zPMr$Xe;d~bAvjkjlBCAZ*T}DbIV_$h&Rk&ltz9tc8zviRc5VUB{O3FJ3musyAHQz^
zJsLO&ZAe@eDjOp;8ot$NuoZs}C0S<lxpO@C_uq6bC{PBsOePZteSP_#*%81ENlauy
zahiW;sR5_XwZcoWR30Rc$pqkAsWSGpOA<v)B943<quKA!f^J-XR;#8sbxo2aBuPT6
z)p}St>)Os)SA>R!GJN>(YOljnsZ{ju-=9{Ep;QqN78*!Vk&Q#q=K(l)BA(Fe{Ak-e
zsLrqb^WGD@{>e|uOv_yZx-oTh-#Wi;W5U_*I%+%0c=dSR(Y`~TDo<(epWL69557!z
zW;i}ZAIxU6GSFU@byKZ&)ZcX4&GmYHnVE1cSO_PaPx%x(b`nV7BqtfhusRR?tXR39
z`}u(%0MMXe9qZ`Ll~<nWTBJrnUvPjgffgTj9XJiZ$+O8wYIVJhh=29tK309ZTiK2n
zcPqpCb*`6dHx`uHy`x7_j~|crop(^>xkM+qe}4|X{4$y0;TU~tPjmnnFaY-Mb=f@E
zt#j?KD;6(y1bogC4Fd+iS6?}19|eM1M7S9mA1(`(jYyS>r?gs9-GYw}Sy{Yv=n%s%
zT)?8&mvS?-&dVd&Y9%-~mw9n<1p4}x>1Jq)7r&BC9EDhs*-17J5`d<TXV~1aA~TB9
z948-u9vFF>`kTcOZiXv^o*kQWEH;Vw3yx$O&Vj0)*Vo;9<&%wn@cJh|6|XObp4T_$
zm6>;4Gn(WaXwR|b@Ur|eQ?yfvQM+mz2j>Sf@5nqR#!VzZ8=&Zr#p0-|>YgXT`Pp&~
zt{4mkj7Fo<H!E*|rA6_-@AwXYV;o~U+Zn+KeClW&atbMoWTX=C0W4)H6PZ{i*Avt}
z)n3!*&f9B#;qxE%D%-<v?ZVv2L+Z?WWV6|M>x=Dty=}k8HJ_h$XPsQHF`^`D$;ojf
zYFWC}BT-9!a4^Sb&Ls8bo6+m_jsm)F>9tE1(6!lY6c!dzSXii}%yzf&l>0@WoejNu
z!SUm+eRtmtpMDBHwJ1FK`7mvoYYiVj$BwXlyJJ0{Ku`x9ijHUIt6wRdn}*OCcYT#4
zHE+%yORvr?>-8QQ8cz$Aoo7n~dj^}0$)`_qcYHhstrnxv=%IHSjRvdLN=8No>FMc8
z0e63Ye<dJP)+`tE7r6}N1lc(L_LB+VLt53_Ykr(_yp1E!*PvoM?Hff>8A0PCFTaq7
zU;I>A?+eiX#&*2)&tVv9(Vb9OWaZTlepJ@*fnyNrooDZBu$&H~7{vx0Wu!t0<s9df
zw%zRZsAcyOFYzKT*64b6yB)jT&Q|+Y9@jkX5$s8_#F%qqn0R_3X34Cq+w<}9DV6-l
zIe_Bf)N;!aP}yv_^O?^pyrOJ}63S*a(}mhiW_W}njANX#h7aILp5#s5tl%g?W2084
zM`n!c&!Ao%l<iGBj}Y<7mn5fU)yC;PNX^J0^8fzp5%BfAzB$iK8CvVtsuBJAIZ}nI
zRF22)eDjT~O{H?JjjJSfyB(X&hIPvpq#ixc{`=obz$Z%*XYak2Ju6p|*}p$#vzdT^
z00IL8@%Q(~WHMne7|?399;3I;Mf%>}-pUN0^EnlYj*pLHw(pKRT>I9qhj#7Y?YCVs
za@ECZg^xaRoX<Vr8!$iwe1bZsd;3u4J~Twx-n8=wAG(!>scXLaai7P4+VnB~uE~JU
zZnty9YGsg0#XogAkASa#axx$M_8a#mBw+UT#^2wcpr9ZE0s=6b%}QrWr_*6H8Zn#A
z`1||g=jW((SEhX(xCtZ6as948B9+A?)yr#si)1C>1NaZkMZhO07lU5MhYKbV-mSH=
zZ^yoqjGOa5UvJy53|dteo6XLqoktiq=Y5ZWujlp68#Lf^mMf5p|Ai33C`Kvm{piO_
zyo8L*YF6_SFR`25<(;lVWLd^$vyo&?ViJ=Wt{d(V@O8@U#EL&w5OF$!Kz$&7etrZ7
z1`-eufW=}_bg1M&x_hQvjYgyVRMtZMGB2}=RZ7;(c;dN%8<@s4l4?P(Qb=JIv$%m9
zlz>lzhBu4<39c+^Wu^}tqOg4J4v!9sPOD+`pzcf^-M7Xme6w>4So7mweD&i#vU6QC
zT6YcT#@vU7)LG4<YVp=v5FZb(zwX#>(E{$h*Rj2SKiqhuV_n*qF^=cXngx~kGbmQh
z3l~s7{WO|2YdqRBJ9XmNtXbrRg`wB$mEyVH-rmXr{EE_RD+S!C##%M26`py<^_rcu
zZ42|}IcEO?11o>NloZ&q#Zh?OS%=Tb)Tyw1Ih0e=Ng$|ggqxvkhH;9`#YMxLqUAiU
zHNCsZrXMGi?Pmz)-!!ZAxm^}28;gOZ8Vv>RHTUxKnR)y;H>al7sheRA@x0CjWqT@t
zET=`CSUs)CJj3}?*IUK473d49M_K(afY9swm^8dM{cmiC#bl`T`O>rU`2BD!pKkm^
zsl(@_G4{Rw$v-*30siDqKIB7Q;02GFzuxrb25wLaoL2_LRb{iWf)&iy%qK&Yp|ty0
zeR$;5BaA#h5}i)xp+oL<EbH1Hy^CFpW1L5zr$^6hW;34gRi61f&T&5HbKd4{r4AoB
zlD4d6Eq8E71xE`SE43E%IoY)H2><udHVTVeGdw;<FUAe&$>2U6X%kw7jz4fFF^wO8
zJI2~=`#pj^NmBFlq}v!hs7I~cd!2FLeUAUvtZ@W+Uw`dNfC7%7@TsTDEpqNII;>cM
zX8wFs87|SW`uK3_kw-W`vSCF>d5!buyVm)+)2|;49SS{qK&w^|8tSO4m!0h>^d2AY
z2=F#-a{PWu&JqR(!^<x_f<A$u9<kZ%yzuTue%|W}Vy<r;%;G2Rris6)R<D(sk;4n`
ze$W0WS7)W?_09QzbMI|b9juk4u%2{&z)|z=MxwY5t+K6RpAzV;B!z!+hFx@^ZzX1|
zTox)jk83o<xUJchWSKGN&N1=yY0Q#T=N2j}GUJG0y<5j;04CNEhNTvhyQE`d60vN=
zrR@VSv5j{1x|UFI<+JVg<E;E<mr~Bbo$l>J>C?3p?OQe>B+yI~e-l1NFY@vWNleKk
zIW3FR@hSXv=ro6-&zG7d3^02$eM~>@8c+{O+p36jmhU^h^9TUTYOf4V%{XK`M1&N<
zUdc0<9(Z9O5ho&OVsC=cXjJ-M-rnBm^?Fx*<9b>P8%G>-n8Vk6U8=1Wtr)=w`qG!s
z;(x7*?dtJv|8}#Rjcnu;rTcIr7{QyoNn6^MY7<-;)Oyed5EYxmvd_13C_27WTS%ap
zzBh!?IV^-GekPju`zY3c)QlXG)3Qm;$l>Ve1a=>cDO0rCwP?cA58g)i_Mx?X>vcoF
zeh?n+m<4kW0LyAGfik;y=nzsw1kzql(YY{iASWUsus3NOq60YA->q2Tn59dq1v`|*
z;wZfS*kkophfg3ViEuMi%w*y?Odk8Vo|UAqfCP`3zZ;37D+WHQU|pP3?=IMEJgru<
zro?Q1r_4-d9Xm!?US7Sr8LY_6A)dF~ESDA}o+E_E2tr?jl@eBDR&bF8B$9$_pldP#
ztfHj|_ypCWu*k}~pAYfr#y?2S$f@!9e2iX9zUyYj4Y{FFmWpw%-`mA5`qH;XL7#h~
zmIW+enRXdgx6fv?yk<m3MRHU6O?Y{EDT7YVfp({ZpuX!^I@!f8<}iof`Mp-o*MlCs
z#%l~_aIKtA&~VgA(C1{wzLUK7&8||mfa(%@ogdT3^kYbP$67gGz3|O9Fm|lVzFEnj
z&m&RGf(2-oE%TW9%4^n)sK`jtZ)%*P12}@ek3Mqz4u1Ki>g)UZ^>bKYCr@?+egZ)w
zK)4yoW?1pa@DH^02ms4!FNvpx3g&AxWVi)nK2|G_oI1tG^XD7X&9H)tJkB|+xV|>q
z;>A3Ixf=_CRK7Euf|V^~vWP?_Lnk<rw!BPJ{#DP#mIYTQg+*32?L5Nvz0vGHey+;v
z`?|LeWni!N48OHYjR&^slIApLDpQq2E!7G7+#LZM>>HS+nZ;T4S*2Z)CGLy6j|XBO
zz(?bwxD1>bIh`3d>wTcT9M-d*@A!_5Y$S!M^}{V#7{LgJGn}!ERn`m&u59Ww=mW>-
z_|JQz`DJf3dk)8vmtR<=<8@jMy*jsKaCk?C^y%2>N4ra*Qn}Xe!DWL!4;#{k4QOV~
zLVeaHI<h1Yci(-)KJWk<pT;jb3Mna$1TX*lpJVnfF3$0Pe!gS&E;!g>`3w$*K7Aa4
za_AK@lPkF9sEnJTTf1g7@%K?IQ~=3oS&pAeS^OP+{;F{^IM?qv?VD8z`dk(&8xfMk
zUdhukIq<>-B2Jv3iQV2P+zh+O=5fw(kla#j{qSKZzVyIID|CdS!-7OMcH$@?o+6Hr
z$0jn^MYc!q2+$Ed|Did9@vZaMA-MKP&&p%RzLWfQ><p<HIV4`pBsC+4!Xhg=t%d-z
zHz7g31em?)9M+V9z1r8heZ4MdPIHDa%ww(I0v7N-@0VKBH=N;RX7F_C&{_Lgo>D!<
zdd+%|_8#dyh>VJ)Req~#xeOYbUF_mVek6`K#mebi{})WKV)+aul%WizAN@q2cNJ3S
zL7zK?MOOAlon!Z*7!ogLkdd87YI=@hJqR#+6JYVi$LK}qb$*0*ZAGunEgPkkpi-z*
z@aCJIYxQQ&hTnfLy{7NYH<9nT#}VwEJ&Wq8r_ikT6rJ=QJ&1~oB)`>_DLMkd)yB2r
zW+<7I<vm(59oLLzGydiw0+d88l?nRX6SXV=mT9%PdjXo|<q;Vb#ZBqyjn2(rMdl+?
znNI>q6xH~A79?J#DG>w-JEuTU1<DHeoTyMKWg0%@L#8lAv41*o>QI5LfaUUX7HSuI
zBx*4inVEiaIztnOdSo~+%Vp4Dt}20`lGJO^cTG`Nzz5}K@3h-&*a`}emoG=VaG^({
zmLjv6lhdb@I8=y^K+xE@*4+%v_?sd4daTuZmh*f}YN<7SL-A#i+|<oNWoMQ~!`Tvv
zTJDRB<AK;%d^DOy?Pf^F#z&;Gi41-rtJKV0MQBjb4<ANhVKM==niNJLxE5Hz0$$>!
zQv02OoiosLvYORA%)`pI-EK#gW&W`J!DG^69FPupoM&j_P^LvsBR~%D&>^SGpk%@*
zfuOM?g1)+7_H0<XwDf-Gui9Crp&0w#y;utiksf;t>42x`Bn}-)^t5Tn0YY>Hg2v9Z
z=4L1>;B!(|_RgJhdv3NHIcvA`luE_=5{X)Rq^A=Z6-BH3{437QkdBRwWbi9lBvDlS
zV<nzKLeUY7hG4V=qvao%xC7rRtpOAW1hs>6b}z%0!F=ZPp7uSDL@h0HTQKX`EV^ZO
zE3+I-WlFsW1dS09^feGl;)09}m_Hxwd+&K9I>~L(f@8C0k=ad%jzA!2d_2o}UM-{e
zuXA0WGthIgLT<r>Rtw8znT1-dN1_&UQ4!Nmo@8iZqHr?^1cExjJ!ir?c^ywmPm-Wc
zP}+5N9TVavFg|uX2CV_3(Wvyh+{?k#OZh8-pbij0Up?b4I`X=8NKZbAI>9A6cAbv6
z2@{ANKOU_?h>k!YxUz9ssBAnYNgODVsAXtkBGaOy36N#sW)KJjb%L|s6=RPfQWeP-
z%@&XL8!z2RWK<;03z}mv7)rSeoH`^1+67lKBIv6}l&qXFF{mOV(QNS)ol7^~NK|Ab
z1<i%%2n2#F8<&O3#(dzt5{X(`<mNK#*fF|gW(qfhKp?0S+!M9D#ak@WEFwqcs$1w^
z=ugCn2nHn&Qd|b^<zU=(NVp6HS2`l-s|OS-XF&nH^%j~%i%{jbM5oZ-pA!)gBo7jz
zBM=C#Y&<PgGEYhp32wTjv)h>v7svS6SPWXNa5D%5f;z$JGT3d~&12GI9F`7yw2wSL
zk|`&r;HUD#U@&;-kZ>6Yu0}-ASI0O-$F_U7BT>s?PtiF)awI3GOhM%*L`NVHT-mrR
zRCXd&Dz=nJ)N<pcOGHLR(Y&BQxETZjL7m{#p;TKc&#9l|ea-tG?X7cKGwawaI%jn*
zH(``;83?XMM9^19I7P>nnu_|l=g_?GDLOf=TXSsIEV4Qa(Gds)S2ivSm5sN6MH&q`
zZo1`PSV+W)6AVgD7H$TCKu{;Ry9~atf59Bh9Fo<^O1r^kU{cH^#+)02UZXFiL&9Ys
zxY`jxUoGP<I`%KVKr?3!>SUMb*bD|@CQahpm@#PdLUaTI!Ih26Lgh%*a=1jImXYVr
zGv(w-{8TF8W)KJ(5NAo51IN#ioR&pmN@nr@88q=X5fW&oiN6m`{7rOg*NpIPt*@AJ
zGR}Tiv^|=c>X~epwtKXPr-bv^iN|PK*wn*i;N#=tp+jPzU2rv1??K<0#58stIL-Ow
zbW$^NNXy6}HNCiomBkx>vo`@|Z<;l+(7Q`Z+O=p>pSM>dlwdD98uiSXNZUO{CnY?b
z6OTPcVN)SG0)gPl#$}<h@tj)C`z5TLt#fjib?g|Ov$BMnK_F-#3X81#yf>Pi`%bav
za4dQGg_S;5r_~VNtu=kSx8aVyof>5T=$@!$F^gHESwexTKxq#u2x8{(ne<EPhhDGu
zSVQb|8ECayR4SEl83?X=>Lutq6dlj@z0vGG7(@JpOI13yiNA@yJ;E5+t3ACsx2&T(
ztQj7OS{5%xvt$XX0+;9%1O;(?=1fxh3DFS<1Xnhm7AiY)G#ZlKbjx6~F)1d7G3U;q
z*Jy;BK_F-#e%^b6<^SDT<$hOLH1Rhv<KF(<aZ9IKxU<^9ZntB%+u32?!3@m|qSet#
zn<Puz9e+0uoq7mgwQs3%Fiss3E(5`}M4bkGG4Uz9_4&{2J$mNyPp$+#uW!y{_YL6s
z*1@%MzS_VkI`$nq(9D>DI@%>VvLq3I_uZU&=pod;LUaUzYk_OQ%@A$3GgGZ*dkHIN
zcuES7oj5_$!b0I@5C|HGnD`Wye)<#pqt2CTYZ>Ctpxzy55#mo1KNBHAzJvst6`N;r
zS~jugQ`mLjG$+p{mpZ;n+onA6z(BgRZCW2MrA(YUbisCkdFpw5ruodHy+c+9BBLU?
zKIi&U<zV!BJzid3LWcy`By|$>rDx@_eC-Z4?L30bX7^~bm<)t>ZOsiGo72SKr2GIR
zr)4QWf1f<h?t`aE&&n%x{yT2z#Eg6UE5|hiN}`qv7f{cehvqX+(aGx2fvCtxa;_Jm
zBM@BeTq|yd0-KG+z!Hsy0yo_XDkxy)@#FMMNfB-afuI4|_WN;OS+$wMB3D(+0JAsu
z-`R_Q+}M`T>-;KxuEdlKcI-RF7n}EzoR+2Rmn1cF9~#141G?4fy<ZM@m%(cLYM#|T
zOR6eWY4@@EF!}UkMxGyuL2FQS$Ye5MFc{G5^&XaT(f1NuYt(wsck*m9v)}l(lt7Fg
z)Puo&I?yGoDUwwAFMVfcYTeI=N{QH_$M2$h`_S6F{mbH!sActPw9h_^D%B-ARv#Zu
zPoB*Akt5L>gy;waS2Nd=n_-9D&J2x)Xt$tEl4b6WkLRINr|?y)g_}VjXh7ayx0?^v
z{ibZ|v>GN1>&2wuy)o!@)jn@wk(JMX*vl82_mZ9KTDme}STAOb>tCflU3GExyN=q9
z@|g4(JEff-?fsMc6LBJf5L-y8axi+m9-U67WCs>HB)C?o)u3<N@5gy{^^YD4g$MQO
zz>Irut<vaHStO@rvGSW;Y}$E5*(XVAo|!U~;kS0F(YY&&GP`&5sH5iIPEXNE?%$si
z5fRuzgy;waS2LA$GgwRphn>^n4M1vo4jI{bq^9RwF>ZznHXHNQYCbEGsHH<z7Lid=
zT%VI8+zbLi1M|YW-?Q!a<I48+t%F(o#ND;3A*mTTyzuV#9=6dzy*jY)(GhhP_&EpK
zb8I;*Vi8NVOR?gb00_<xX6Esk+>&-nsd6v|g8?ruFEkpBa2W^$)MC*0)sOpl>+_$L
z?Etek3m+Xx&+D7l#_1KJVw3pSvh^M_i4TvundxKt)#`QJQ4+P}<iMguXqPSpt4nn9
zgM&Ffb0%rG2+<J;u6C{^H^XYXooBULQr&_!AFGwgr%yBT{CNyot#C641Px5d8NMOm
z9eHNT&>GF|m50q{=hf9edJMo%7}kr&?i*0+*K)cHw%WJyxaM(U)G<n%Buk7tGmc3y
zlkm~_C@uqMIT+zG5C}?BD?#73-;eXcyWcC@EkpcybIw>o0?jo&b(y4Q<S^%rZ;6Uc
zQuaMFWoVuF%aueeTeqTl{BhJVF42)Ci8JHI5i@BL8XqA#0>RbJwc=(tT3mB)XNg2D
z{gac4IB|jyn@zYG1cFAu?t`b9{l>S-c3lNvCHe5XJ*@m@m$Lo*v^#4}r<^*JU{7GK
zYA$OuYdqRJWp-lLu~~%Wg_T<lMz{<Fg3{DD=sS5fnSZ|WrP2xN-aeE!XOF3q5hi!?
z@(X!o)fRr<djfEDj^24@e65X&E9>?W5>U;Zi)M|d=wx>4#Iaek$O{vqBM@8*Tnlc7
z9Gi_rz*4Q&%|Hdg`T5K|ew<s<(uA8qAZR4SU%14B^FLAgUxRveVA11u)!X%7S+!Xi
zq|#|Mta$$Z8m&iGTvaw3D_FsN&3rOc8A`j4)rUt;J;KQIBk}U`DwQzGsYAkLAP|&I
zje@@PtUMl?|FP0JX&K_rhYKdvdBEo+FTaq;|69wEQwe~h6SnHb2{oEwbQc{~tUxn=
zKB^3t=vaMxIQ7UQoF6GfM<BRXxE9<DTkUop*Jy|-k*H<dnKMj^iNQys5pD*7pb;_a
z^{@H;?^poZga-2d3lr+C{{@Z&FA=YNspwSq_MxnJ{{Cv6%Wk(L%QA;-hlr3O*emVz
zXdj$3n1~Y*1jqrUbjay45IQ6fR7{P6zE@ZO$cA7325KkZst&0cIZS!+Qzh`M$w-$|
zbZmzXAw@(W?e!F$q``wZ5fOnLAVfzXxK_B@-3$qKJ9AYk)|5!p(kU~OS;vkMmX{~o
z3<5zTV}H~+X1?lhAW4#%&;R`}Ekpe4{XUY@vKTk#ePuoJk|*w_|BdY`eY|s^J;Rp4
z0v7O&_8pHzEzR<p5g8T9P3bq`<>jUHyWGpc2$z9CP&umo35khM@mPDZ@X?X=9`J!9
z*nIt|dz8cpKkq%kq3HN3okPjWnUR70>8H{4>EjXb<uz-@{v}H|_RKSAf`jq%^CKW2
zfPjDi{QUfsY;~doBoJI(q-W(Z`;BjvfUjkUf4u~J00zB|=cnDF6hXGx>^%3M4J4*y
zT;|A%aq6AbYUN$Kovs><N5JP}werOA<NUw9d+BJkVm6xz3=AYNFc3dKKTIZ5sbnnz
zfuMd_zIKQ5_>NmTHAuh*jyj{G2X$Ar-}`1)sf@;Dq4c|KHr89$(?jaPGVL-Y;M3W4
zJQ({REBCA<JUbj;Uta<O0tgHY#NXc^UteGJdOcdLR#`_Z5C|%!+MklQKL1(yU=Qlm
zq1M;6RE2gens_WAetXTYl{(H{bgb*wBlYNkcG)r|GpAjrBlf`u*|Tyb+2KNT1cGag
z<!g5+E`k8FH*d}vTd(#hgI?#6c0DyChqu41oW7NX)5>|!YNfAQO{7*!hFj1!I4Oyb
zcJJoyq$Erx6aN1G9(v~-Sr-Fb0zt#E``~G1S&L4qVaC1v8}xprj_!+((F<@)2>iS^
zy29r>`(9^kXBfvg#^}ayR()1!?~&ev6@RQ?a@=J6jsE!g`4JcxNI*aUX0sV@Z*OIW
zPw0?9P<g5qr5uWmSBeo!lA0O!-dd|SRUM{}>4#417_B~XDuLYxPgnSSCEz=A2F8s;
zH)ag#vo6s|@6m%lR;(ay@??zuLUaUzYmKYX&5&WU@wDAeADxc9Zkaio<>j$t|9+l1
zc8p++Mz|RSf=0}a{il@2cMa%9fZ4kN?*@E~UW^;kQ`!EdoS@ICL;2QxmfDumRnwLA
zn)OP%xya0%V{>?Y-|MuqwZmeuC<E;!T?WpjGy;L3@>DD6+wS&(9zCc>jZ>A^1_5So
zCJgJPY;V7e=vedfu`OMSrfXL;>s_K#WHxhb&K&l={yMgHLUaUzYn7|b&9L5TrH3T3
z%q=sg&Ti+y*jQHX*+Y1Cws12D1Xln%_MKE75AM^U0q?}c;65Fd$9oRPdej^Rm&@RH
z>+kec_hp`L9yzKUrF~e!Fh1J-5yO&)VKSK%9dZt|mvk8j1cIugx%^W~v-_Z{R$XHe
z9B_!vhu`f1D08MyN!0SkA4rcqhIHV7M|;AsVMI@x1{Mn@x2&AbL@gpqoj`DH&{*9J
zTXr9#u*j;o8T$4JEBE=%fbXo`&QmHC>vf*C)E?>SL`Fr?Dn9@-LuLQ~AOJ~3K~x`u
z(WsPR5Q$m@g2v0C=y=kz@&K@y40H)=+Q4_@piO8XA%SKRQ!>cQFJynzIl{ZOR&*%M
zp2h+e@Sg5Hk3=mka$7L#*etqbc0;e%mnsJ%9905A?NQ~R?@VGE@fR)ujZ1LAQ*_d^
z@;DS7Pxtnru9|ykX|P}cy7%5w*6ji0wrIhzS+mIOCPYUd5HxN#gL7bO``+j>gFa_A
zyaJnz|Hv{6wOVrAbjw^+#PpLV8Jd{rsJUmccx1zKFFPYf)CGdZ#UF>`l*i#+TPwEj
z#z5a2!uWdIegJkKilKLxme}of*2-&{EzKrDouE8dXV)<yZUW<D$79eM@HTswSq?^&
zzY+*)k17X!yAHT!(5fmp+qZA$_uqdfIXRjB{rfXy$Pm8x;tS57KaW<c<*BEh!e}&B
z^_Dzv7o9&2$I-QIQ^yS7+O<ftXQNJViH=>TBW}V3V#kk1YcOE;7NR2%2(ElL!yh&q
zk4X{-+}7;@3`<C0T68oPz-TfFH-kWMh2cyr1#m;h%3ID03k&(-haWg|<_u@gp5?&@
zAH-_4vS-g8PM$o;s8ORBG-yzb?yXz9X2tz4nRAJ$oVJ}NQWeP-?G}&c^-k+eWK<+g
z3!7r_Hk2v{<J2KB&@K?vE>#Zt&L*WPkE<d$J9q9RF)@+ZvuBf>oXkx(-NeX|BYE+~
z7umRRBM}i13>-L+zJ2>v^_D#792UaY+W=$|E?mNP`ZTJ@NVHo#MJKIyZ=xb2DQwyl
zZ-WpWfk5EkN_I1(+3hR<-qY!DUs2N{H<ww*j?pbMQ@9xff-4yJpwD75RQkB@zyF?)
zkPz;^`)<~*UCW?BgLv(=*O)eK8tvM(BR@aC#z9{be;<%#>}o5&bX~*ynkgRZ_WTR|
zi8v9#pyWZtE(4bix!2qiE(3v}Zm4q5=Po$TG~$;%COMg(e)@?83l;#N)oMveNug!S
zmNaYD43o*kbI(0TpFVw*V@{qtNlZ)(DwT?^UAqzz5>lyaHSsfnETgtt>Gtg>Xy$H4
zmE#hfLVtfwL`0B0$RRowZy`DYfxyL;>SkCg%gmM}65Mo4XSXvUE{^fBu^6;kyv=6e
zW)KLjV4Umu0Q@VNwKFCrhUDaA#*7&QfFwy26cjLI$PiR270*8VETcw^Ql7tW-#!i=
zJV-%70imIxj2t<#Qrd8xzX_`$m!tDnkk|ZzvR{%Vh9wMR%E>ACsr)ed8a;GKxC{h>
z`k`KeK3SHz|Ni@x?fm?F0DARuWZQh;fd@RE|G)qJkH7!^o9^Aa6B84|(@#Im8*jY9
zkRd}Zd#yl=5ubuwR%~5CScXe<WJw}n*f35`nS#pC4_~7Y9f3eln)Au&%Hu1+&2ZXg
zBT}Vei&pFLyxwVPL`Fr?w6G9Ev2|Uz83ckWo9x^I<#B+eazS5EP!QwCk5{&1V`FL4
zrVYWt!DzKwA|fJ`w%>mHjT0wMFnsuMa&mH*F=GZhcI@Ew*I%#j8nP@CXz@mstwo#a
zqXd0zv)d9G6-no;&gk{}Qaa@2<t21TAgCwmCFr~Ey6d>^y6cqfZ@>MPCQX`@+4(6f
zEaa0<K4IRxd35U3i9v$~k)55*m@#9>%*?FtI<hR|XEKnX(Q?7yqXd1~ZQBwR8A(=W
zAvywqpkh)pT+V>X+NWyjX6VwT3r(9=&PM8VGuYMeL;I$@uF-fTYVj{DB;v#g1|=se
ziCTo4K_IwxF_}F3YF~f-HA99BL0e*=2w=m84HOm@^6<kC12AjWEQSpmR;i%RX0svN
ztTbDB8##*;n0E0YMxPmtL2JNhHhSoga2W^$^-r}*Hq-=JmN|Cp7)_ft#oOCk*;iOt
zsAP>haNqzx{qz%^I&}h|dGqFEWo1=#TID=W(OKN}Ha<y9Aa%+^oEbgZk*LKeL`NVH
zR7{#%&{tXeRCU}8hYlU0M~@zgn_=nFrQCk|?U%h)pv8#QpyTNL3FI{oQua%-%&>$6
zrkp&9pGt+%*H^e11cIv!AETG@I5j<okU(>ljz53?JZI0I<zN5$m$L7#zy6|Ar%o7+
zM*i`Se~_A*TCID#SUf4<m1v>&qcfN|;~um=T90xt?m8p}+6998rOH8H6MvIpFGx<y
z@(`f%$jHbbF)@+0ZQEkE+xh03Z+PK_7nJr>r%thV?_M5w-~rTXHM@50La)~=?MX>V
z7z~vgaZk&1blA>$TX<khB+pG8iH}x@jzA!&9I5H9ps%v_sj9dcii(Q(^wUq7J9n<)
zX2{9OVeHtkm3A|zvUAX;rYk{T+w5#2qoU}Xl_lH^0>M>`$=lWE%E->E;F&Hy{q$2d
zZQ8`@)vGyl=n%=t$#m(`1%S-VOtx;_O4qJk0l4$dJ3Ws5;)^esG-=Xhuc1<@NXf`W
zrB<Vsv^4Sc$KT%{y<U&eXjBqLX|-BZDwS{<2m}p4l|OavmQHu8XGJVpw21KVaFUXe
z*t>Tx1qB7lEFZw8O`GW6y}PpQ>+6fIxR7vcY%FiR^%h@!_0?ssqf)6zNzYS6$1k`E
z{{H?11qBfp7>LDUQGz~=Mx%^)3j_jz6Pw+xJeI1_F_C4NsHmt?Zia#a$6%QxN$lUh
zpKaT=DaV9{hF03m0CKT~YCW3F93oDi=AA$Pq(^=}X0w^Vz(4{61M&0o!(=jHFc?H;
zPJ!Sm!F^`WeSoSWcJJOzT3Q-0F)^GzeVW082eW_wei9QCS+{N-_uO+2US6dK@ZWjo
z9rSuVAAImZrLL2bk&Q~NLDG5=+$5-!4(W6{VJjC18jxzu^f{?)(C6#x%Rm0{5BBfh
zPfAJ(@4ovkTefVWO`A3xJ9doTy?fKSbLUdWUAS<8XP<qRB}<kta^%QLUF%X-Zn5Y<
zvyfl{0|U`&waN&Sur>(<f{F+*dn?+OnvqkfwaX>l3}1i!b)CBzyb@Em^~u+m_{b2n
z#THKCW)KLjZrs-y|9$d2cMa%v*<+r6{&{xn*umk$hnYBWBKO^Q9~(Ao;OC!zrhotb
zv~Jzn<N0>Goi%ILpjNAS=bd-R&CSJZuGmJZQmHt6G7*(pjY_4Zb&C*8CX=E;LWcx`
zhNsFwUyERW<#A;N=U@N&7yI_@BR4mf+i$-ey<Shxo;^uUPG<P<;iUuz90A{|RjZgY
zXAV7k_T<c&Gqh~kvcl`AR4R_eBq^d38q!3FjzA!&67K8x+}HP2#G*xuSh;c~M~)of
z%$YM~x*6QF5BvK1DvzCRhBa%}T=qIDm5K|gIf|Ph#NsO~R06>@#H~Hs^7#*Y0oZ-;
z^ktsyAT%_z)VktF9(knP=YRFpR|EtED90>Xv`9%(RS~}(iY@MAspxw{J9Ijo7-Sa+
z8WB|v`g(V91zwdE9F0cfk+lv`{N!bkl9IxzRjU|3emrg3v>`V)msekXl@%*iT=rTX
zqSLdz5FLR)P$k^g@m1D7RZ};^;>C-(>#n;hbuHm$5D2bax`Z{wVlt4Pl}CD39*3gi
z>E1rH*3Q3X%^Dtk^if*3Zq1xIbFkTL<mTpHHt0K(m`41COMnWUPDAf5t;C>{K+wpj
za?sbVMH8C%n@CQ}suRHhh>VP6^XAR0UcDNd&4%4=jZH<ki;j=C7d<+J3egb=1XV(~
z83Y1BV?~nGgm-Ptmfwy6uzhcIt@gq0yYD{kyYId#ANOPN{Q&gp+!CF(-jl-%1cJ*@
zt%#^^k1*x&_Px=yb~8@C_~HvLUAja}OblnvoZ;NLbDTSO?y|?Zi%!2DVMvk)_yht$
z)u@S^Vc@`l%38fHUAi!6(4aB{K6f`m_wL=v&CO-;;>DG^meb9kQmGX;gGfvz5L`P9
z?A2a*yzb{i9<@aqg6!M^)^6LcY!43a*noE<5D3bnT2WC+!KrLQm%1c9E6+o8ZgC4t
z1p<MfvN+ugfZ}GTZ6YHhS-Ny7Lx&EfO`A4!=+J?U8#i9|I8Qf&UU4&sU{4^pcIba&
zJKFvK_U=1Qs_K0F_~+i~ZFja)mX0VkupoBDk{C7ETZ}co7>y>H5Tel}8oNfsuCc{f
z^3?<sQB+hE3!+9Tf(4Z(ZFhEec6z_}{Qj6_++{nvi?}}T*UOje&h0yM=RW5==Q%?w
z0mx)?Jn`ZO-|6u@J@=!+R9@9pB^)_Xf<7U(M_U#2P1t1^dyX9f<Zn0+&V0954{B>X
zHhW>=rnAG)N)Brlm<l08cStsa5Mq1w>r)Rd{QJ9Xd~XQHd1mg%g`Y1t=|H(J39+5p
z>QCk+rypAQ_ndc@^ZDwU-Z-AEvTA)jGhSa@`1v<y94a>*A;eabYz863_H5tXN3>{s
zzv9kWWU{$!dJKkP^4I%bXwl$)q@;EVvEAD0$Y|_{0UWje&V`?^xO3Kbl2;yzCb{zN
z=P`_Yv6lnJk7B|u9T!6oLWqt?HiHmidw0p{hvIVD0r-4%4Yxk_+BV()9sholMW5$0
z6f72<DQ6$PP4_Q^=$;;Rhh1>;fs{4PX%z@YnR@%PBvYAQIk2uU43n$wd7ibKf&jRj
zb}l<}(l*<_5TgH*Yz863_H68k0sQgYZ|DD<^UiV}-$vv6o|*eGGn!={OgZcDUa#aX
zgy>y8dTJP0Ud#=@nOu1I_<VH@*FW^iHVORlX$3E~Xl1(blF3w8mGt?(g%JIpWHSgM
zws%MEzcXhZJ)!XP{r`EJn;xB8xL@=(!!Wt$>G|C8)EkB0O+IvYPB?6QpX^Tv(R(b{
zTyxDeJ=ws3vLdR=ig<g`*8r^E*ucl1uj7F6qi{E+9rU(PG|ANI&+^{VRfXSO`m;$K
zb->OYtR;jH-LvEHDqes83zF$9@nnX@U##Ot`;EnBwQQ698-~f$>Cf`T>RKS5&2Y=5
z$5Z5WZIk^AA+~>ejUCF@>+1_yPb=2cvgFJ49J1FAy*giBERp8V_rAcKca|4^x98X)
zTz~OobX_V43$eZHanJ`aW>_VrsaUciU)nqnjPm*iUodgk;gl4)d%F1+R;{n+cel+b
zJOlxp_T#<ye<vK!tNRf`2%p=@E~5wX@`BG$N>Lw*v92b>{^LgUdEmD>n_+X~mc^oT
z%caM&^QeJ+x?ds0_lvG;95!JL@l=LSS8f7eQ+<Tz-dKV~*V$=!Rgcoa4a4Nwd5ihe
z-OuyYH-W<Mk2z>pZoK3;Ni`SZdqPu6sovVy?D?N?>%U$rq!m~!I>#KeD;J#f?byGq
z6^bT#Z1zHCyuP@__J4Ewp`7;Py?T7?LI}~GIqxjz`iEXF{JiVvLEL=l@jbq;wI>u!
za@9T07t+@OE<5uuxz`CHI`rHdOPKb=ycX%5)m0^&b<92-yw?u+eO=EI2t|{;zic&+
zJ-@KfiwOB=uM18(kh71S*sI4bgy>tn8uS4y{c=55-95X-*cZFa%9%$`;E0JkF|xY6
zTiaW^DahRSKI6ZyEh<#5gM6CPjh9Sj-`z*_+OZ2EM0*~b`7Zx_eqrI~%2FTG|8R1*
z?`fS`wZ5J!?|#0;L)K|O-iyo5JgisuBZTOmmVUXOX^+oq(JQyvxG~jC+-*2xhE-Bp
z?4hjKLuILtKrl)}I8HDeXU)bS?=4-)(l0l(8XGulU@241K0?M73-LYF>p>sDrus1V
z{NG!=@xK+VUK?0m%mI6hV)q>eQ(5X|V0kf>r9L2^78(df2{cCe<jV~#Sh9-swT-Q|
zalrUdTz2LpDcT~0*rp_#K?w1EU>GKI-dWCrGvDo%0#shNgI}F=ASWC)UeY;*_@3&M
zpl`FKU#{n#r{7}v*Bg6fdpiuR<Tqy=DlJSxi0_PKGYBERFJg%_bKY6bf+Z_i^u@Yv
zRrR!3bjFPt%)xu^z%d8yir4Mv!y^?!^tC<>`Zjy}<F9yo(bp_kvXW3V*{yZGZU+aB
zAI1LTM{(GMG19^$g!s-$HiHo2`zDr1^X`(BEdF904WWE0XG1tnAQ+{x)JIvdC!g}^
z_prxKL)dq>5#1UCD1_L)ZIhs{xusvO=YwTy*i;uL&=@5Uj1^kU^SR|-DocD+mim~u
z+X%*u87zUG5MsL|*$hGmA%yro*ycf>5JL1flFcB55JHIUnFM`82+@l+XEUs?ZDdn@
zq>$1H`HG*Fr9LW4d{kHYC7VGAA%qaygamy;2qA<JLI}~1N%OK0LI@#*5JL2067&fn
zgb+dqAw)kWL7xyp2qA<JLiA(S@A?3Q5JCtcgb+QqF}sl`Lr=0cvlhSAkD&}=W{mO9
z@to#A4WI67v3$gcFe^HXm=VLS*#XFr13)Q-OLwt@eFw(7#^cdF+x&b)?~$H9A%qY@
z2qC`bW=Cgp)S9C(O_S>eT*nPnH*oWSo4LH=a+ai)aMbFfSd?7UVjZhyWsr3cnx=7i
z{pDN|xP*`qqTEtWv89-p5#xd2101>LNS+8ifuW4==<GyKN%c-4gb+dqA->0EM`m-z
zhBLUi@@9Th_M0}Bxp32kycm6vIYZ|#&N;5dYiX5c|F8Gwo9s6%8MB1J*1;`azp?&C
zu4=f78%l5B%8D!d>^wx@k)A#wgb+dqA-<>9X4i7zrVH8Iu{Rf$UDWP!*Hm1CuIXG-
za|sDE(c(3w6lnSXx78nXPVqUEo8{abyqV9_pZEGXh`uLd`hGxifdH$IIfkK+KaOMU
z*mjr8tXf4b5J0opK+~`e7=Ufipcc!hY?joLB`BrP?RLye2F+^4Ic^+AT^;F_E75E=
zbh{m87+^G|185p5n?)}w!ZCU@n$y{rr!2&GVtFdXbCC#BD=KhmTA%GFW}1Xe6Dv?=
zv0&}PeQj$|!{CmF22S_;*}-n_we7}CliF;SQ4UA1ZF76@O*YG;!628Ems4)B^x1xr
zO3`Q-=s>B(g1sNT=R$_T-3<-=-0x>ZFTUr5=xg^i+{Y&SCjM6ZH>@2z+7GY}V6uBM
z_onXUxyW;z=|8i}`*7(liuGbvs+FwEtz)dC{pU!reUhN>2PFRHn`j?@OzhQHI}Q3$
zpM6H`wb#hJ^b-0myD;pPS6T#qDw84c!3RX<%pvyr>-c{3BfLi+jdRys$p!)>Kl+IH
z8*h+$@kR7;<0w7vJkWK}b&ODm)Y7Ho0s+b{xPYQlPC@I#hZG^UrPY}X)9UNFy0Q|d
zrjamB{v8StHBA6C;P|2<hHvpu`9(U-i_s`r(=s`w*xl*mD4(y@K9;9a{9ias(ln{I
z*+`lun{qjJcRD%U@25y_oy75eBEkA>766N;fl{cZe=ERL3Jp-2R`~axF4uSV@awZ!
z_*qE_H`Uhix2h@z+ibnE-RC0_ZmO%}y-}muyiNdFrFc3NqQ0rIN&!dteC)hMptvrZ
z<-g%DCi%3PtWu1&**MAX=jCXW&r&HgO+#<mM)SRCz!1Bg{oHN_SbO$WT%XHvZ6LrU
zWo49GESSK*Lm>j$ELzjw_eWkYyKd3QwlSCE>Bh#w@#lb%b~`5)7q?0STAj)8WYaYn
zVzZG`iVfK;BkXp5UQ$A38~5-}QYpU5WH6P=H%M&po>NfxodM{Y##o1=)pg!h{1yu*
z6%}z)T^-j|RZ-Q$zl-?cikUG!NPIxh2(pK34@TQZQ<JUX!{mn)S&G=(wKrbf+bjEu
z7!l^g=0FlA44BaA^832?<=*tY%nZ-uXa1j|(Y1z~x?CMKs)k{fVeIDEt=q@BI<uOk
zsioL78;5!h#iM&zoLbD9^cqGxMzgDP*DfE6*gBSLuDRx#@A@Fbwo!NEji}|zNyp=q
zoOM<{2y26V<Vf5TCt}88m`*2|`SZz!LKID&Tv$f4+i~x+55A+0BD;1i)sH@k_uzxk
zEEa54Rk-)v7mMFd;;E<boOBXZ*Ia{ppM7von1JV?gD5`fBy_)@O~3sunKf(h9eJb#
ze&TyCs}z@R+Qg~F#q8sD1Nk5-W}0|(o!c54c_No%RV>Cy#l`vHt4Rh3WV1XG4l^ef
z<6yU&U7bz_ZV~L<+t9!tYil{asEFT|mvfNE!@(X8yE~oyI}~DieLeenJXCJ+z<S2U
zjr=DRqQYv$s%aR&$H^p@HZ<^dBEhb9J4(}NFbo#P<NPHUq{3?Dpr-TqE|gj<7@Eez
z!63)@d}zJUt8{H3z+2fYhdP~%?jX2`nkGe7EBDsd^Qd94I1=IHq9UBl?wbZsZy3yq
zMtL$4VWQK?c$bT6yPY)P&@`TkM7Yl|7-X9K*z2X-YAyV2UX91ODG(r~6nnc|E#42^
z@u!*^_H?;8+ULs$?n)6=3cuCLeGLsfVi<fB4s&u*5w2#(pHqtZT#n~sF`kG-nCNmb
z&h2LC7Vo+Lgv0!D!v^;Ec=$tkIg>md4)l1K=yLH|EXLKfwe0G2GIWaug5THGaYsV~
zrMiw?(=e3ct4xN=>gt#kjWX6|!=~#54TGhr6n|@IAfXh;c)j1*qhE#9O4KxYDiq=;
zP1jS1?x@Mt@L=#ks;pHMS&F!#<_avDg@wt5jI@vBhQJLhNG{;GqT_mHe=D;qxiN4f
zev6;qSNxtLOHqf*N6ZM1H9khh$Z&4Sxj6NFV^B`zc(n0RB4&h($}gfw|8_fZ73U9|
z{y<H(hDQcJ!g%NSZXM&i_&nyv<}=PUjzy_OJP>?<3>h|NH)7E(oWK5jMmt6`#xbV*
z7eI8GG-Lfhq`&wAy{HKG-IwITg(R0P!?njA9j>FYSxPUuh(@cG<UjvO;{gXya^86@
zmeE}<>?20BnWm{}T0Sqlty)2vM)C2-qg$=4Kk-Ctg9cG~)m1$@M<KpzPlrNemEzc<
zZ@(<<z$A|cLn+=(Bp92?Fe97go`wc~UtV5VZjjZ=StTV5wAuJLndEoPUfb->`g$%8
z1o-ceA^dcU9>8jwjR&i%IeWtfj{W8vULG=poti$ENu}^8#Y@A6wdn2nI+I~~eLW-G
zZZ0k>!`3Y5*ee)hMLLaAs#k)ot#!Q5$K$~u&qkx1T-5QyOlQ_+GJKLsfvz(v8s$e`
zZ=2_4(KHV7<V%w;^!eC1m*bzQ6xRm=+&W-DVVzQog;R@*+1csj$;L+hTv=IoZC8hb
zT^$ZSO{aM^9_J9Bk3+pJTlUZJ`<WMuaoW0de3nXa|DZwG+G&hy&%9WS6`2gT3>;Vp
zP;^b>z@}h*K|Icmxg3w>a$H|m$8F7)E3sHO)$eC#r;{fd8@Z~ovQ?1tOgPMWH8o7H
ztmJ}{k`}L*S*_eWU;vuM!g1@?F?+}m4)A<i(mj>SF{8SgL!13BU>H2u*oYmtu(XuY
zW{nd^c)k2zV`I0@zb~BT_w!UJ#7ogAN4N7H5uz=IGWcikpBz_o96LLA2H;-Xz5KrB
z_q;#yeKa)QPrT3Z*5i9^pAESNvSe}Kz^ZlrSnt%FU_zKMaTTYS;=*eh8cCJpnZ{?R
zuvK6vgHKbR@=p964)Y$y|3?0gLH0o%Y`wJ=nH7AP_>d`OQ?ToHDy^0LCGZ#Qnw`h0
zA7fhGG}dI-kni*VmO^1*beOIxx<?AR{6NIscmwZ|M^b#+X}Ar8==0Bax{fkUbf=R6
zx88~xJea_r{zUqVFIq2XY<>A&-_b|oI{a{gx86$X(@(d0J3@Td(n|4gV<YF3mbUr&
z<`lXctE$*VDgF`&@O~oEYB{&A<7?x=|ARz=seu5e6&JS(_%_pkzg1KaRf@}MYnx_T
zg0NvQ&gpEG-e)v5$P`lTnmO9%YtgIqUD1Fu{eJGRuP58XV$*YDG0yV)8Dto|7>N*U
zO1bTbp%hn?mvgADb9-YWb7HYp%h)xIVqI@DIM{rRjdqUxaIcqp1`XnoSd2Rw8oGH#
zaCbukClwXpXeTf+HI2*5%Q?(q;r7Nxo{vOY6=`s28vZuYXIE!3{HCUc{TvSd-xdL1
zbC;KvQfjeqaZL@4x%|5>X_^eTTA9#BPqEtK|C=4)c2jAywR^3$6$@}`aWVHcG@vBl
z6W#Dd`U}df<%NLHR3_`w>zUx3z;OF;s%_OQ9KDdc2H#a!C#}-d8}-bI%;7J!f5D)8
z&s0v`iH1go3^|qSbor!8f|j4E!9vRnE2R{6&CY)A{g~vL#3auoPWGQnrLB@hiAAKe
zRJV=|U_opFKk@zqyPnSksLj<9&&8Qsl+PYJuk<{Yk6zBvzM~84yq|oZ+v{)VhT0pr
zWWy!Qj?TtZo!_rT$G-b-^dAV7$&mc`W8(AXk*lo*zzBtizx5WW#fwpyOyBK1mm{@!
zF`fet#QT$<5O=wV&Yq3g#sg=o<Id%<RaaB~_rIe80cxjAL8a3z7wYIsv9m8sUB`RG
z5xApK!p}U@g_HSKuD+i5TW^tg?>$s1e<Mn-T19N$JTj|ScWYZh^wbB51R>MpfDY0j
zb4oGHZs)eDD$<(9l-k<DSij9owPkx}-d&B2WNkK1Z71N{Y^2@J5l$y_(`n{LqW}bR
zIV!q2KB?GZL5FTWe)NrlJsvh128)x)t=>is_$Zm=ypj?Q_IOxtweog6-syU#rcq|K
za@&9b_$(Ht)YPz{X>8<X3VIYA9Ov^f&T8ehV32iNY`Y_0WiqVDWH`KobjX}(Qev?%
zt*VM*i-oB*HHERA&5z$`BLIFN7^KeO;IyKm4j&f$77HhMy)4yrW<;YXrHGg&MHUP0
zZd{jQiv_Q)6W<PIk~+fYV|6ymvL3wW#1GGC$7s$fIjivVhTH~Lq*pM>I|%@bW?>h{
zF8FnSVVSq$Z}G3-zj!?SICE2T+pL_~k%6{>l<K848jXaEP^ZhU&#gz<6hj?D@mu^Y
zU(~>Yg(3DKRNJZ<W*^2x*F^3gbU&XMpKws%U)cZv8&OF_K~(novx%FX-#42(wd7QG
zckN#I`TfNE6zN5bcjZ$=OD(1B;@qVWfG$WZV18^qXZz3QipncEq4)$Y+Hetf2k-9I
zeno2%^lbxXBtpXj50G8E79$#E!>@it?Df|PJ@y!8JWkEkS5tFk-_3cF{Nxifj|Xd2
z6^_xP@f>gf>7`3a{_lSsuh{I%y5zLeD7xSRvM;?v-JN%~T&|-VR2Obuj?tsZ0*UwD
z>(cT7sl|(FeB=>SE=TOGx7hUi-xHlXm)P97<N^WKo_Hd$*Iw(=wuI;nuf}4Gw%aN0
zq<1W%6i4}dOerbhJ>bT=x=y$KO*YHx(I~!5hCN)aPM6=;?FOflS&;|;l~yZ9cM>da
z$)jmZ?#7s=j8eQEkMm?G#5+w5N)glKg=m!LA`!mnMliFbN~@Kjb~~?kAxLY_vQ!GU
zu2XHZabi&s=sM3vB5elPTS^-Sd%0X(Q&z^8Rx5uA1iG|dSGjbZ16(cw4hJu{(UaJo
zH)1i$tyYG2QsgEJjCZ-Xw!EB`Rx5w*!tqB;lNVz#^jM5NU9L{w2m89+XiD*HBm$a-
zN7p&7sHj_G;&k#wj=EYp$N=7t$9XCgVs11_Rw+_S@oGHIf5TzE>_KDdV5^l%i-k9O
z@SYPtJPyr~PoHeEG_{n78Q~DmA?>bnr1wasR7~Lj_W`JE_wOv#)@t@~?StVmT1~v(
zmXG2effXisCSh;m)7DndIoLLs-L1Q`AiaQ3QlE6|_`I4Iy;-<1KQW)3oI5exHoVQ{
z9}Parhsh7|Tl_dQ2ZwtP=aiCDxVHY<ZtYjJCPCje(D2Yhcn&;}q7zS~==kH&EfzMO
zdoI3XkHxw3&cx@<Bm2!aeYXGT+_`uTX}aO)Iz=a(fZH?)Kl^OQD{k?@ue|O$v~lAI
zUULoc1q*uZ_%yGV43Js3uFzxGk?i{QL|%A-vS0ri@8O42dfs_NpLvGRV~<gG(M6cS
zAZqDSa$AuqCB)WxFOgvPE>s=d{HeOCvXcFQzXyZ7($pi@p0Cqs0zj43imwX=kA~ar
zkjt?+nIx+e<yLFAD<WDnjeXqiE)^F^m?rnu*VB;8v6sumJ@xfm7YOihFi456GcOin
z@|rc&=Q>Y4YR@h<8;eq@tq!*4#bSkVZil$tRA(~05{-7NXYHcWQjXJg{+USdM5yx?
z_3jvHw}Y<pK_b!Rmi`YC2}av&osK!%yuFJ`OF7YI<MCvY#~K?uyq4>;SyrXf6zh7M
zl{vRG&~ArBf~AQBVZ*?y>x|!uDS7sCxmpyPX^#m!5)ATnCc^}`n^}<vSJc$-U_%4C
zQhbq4^P^R(Sh;0pN;m9exAQ?4GGc^i&%D??hT4WQ%08;_yOrsc)aU98KX0yB*^~6e
zUzGg<6uc09q1D*9=He>OYl+t=N*D2S|IfQMUe%`Azy@DszS`>Jj2ICX#usvk`w%ph
z-?yO*K1qF2IPQZz2Q$<%w8eeUr~8QKqyeU<B<Sm7nUyQiT`pXE?wS9EQe<muaqO`N
z_R*uU4jRPpmtJDf-OakKO%pR7C;s-^)ZKPlexAFnWX57-R;|K&@WF-O`Hnh@L|GZJ
z7hlBa#-Mp?MFmxN+<|Er)cp3h`E`3^%umw?ThsL}J<!G8d=u~Chod+3To?@vWW!;6
zKlup&MJJxf;Q8|@KJmoDI_Xb8rQzOtsk`YWYOcJJ*!=lDKW-tK`8u6uL^lGfB3<Y9
zsw$kC#*{#S+75z`2Ezbd$EE9C3c{RC<?%y?L24VM$~_edv9r_33B|>XbvW4H?dGp_
zb?oSHaG=M-$B6`1O>6VmyZV?j+~HtVD#g}>jTzw6RH{&9q|#>N$6hb>4hL^`qbJ9q
z>->Gd00se<2Li0<#k72%#R5vPF`Ml?ExyT`Os3V;A04r28n;wcQLSlQSy#u34jS1)
zrb${Utk9*o`0Sd7g?s}*s0YD)S3MgJQ)IDlW=RQS>~@audbvFm!fUZ`gxAZ`rUrs7
z-*aiDNSJ1qzH3H0oqW}oLoY<X^H%IFZmqwSgi4T68Qw^|!5*$X3Tc#vGI%2N1ZlPP
zjS+1*&UYN=y3Xa<*t5J9f2-Z)9&db{Woj8$m0rcJj$K>4rfFL1fws*!EDo^1=jqQ2
z0ol6jI<l($@2-r>a9{8~W<_QJuqd^NjmAa}^d49UI6u#P&fMtSLhyS|$vNCH_>RID
zz?d21xzKZ*Uvhru7eaJMg1$ax9XvQcJwlV*#*JjY`U>x)e15lPx8phF5Uf>Ig=M0z
zzDmPA_t0?r?Zi9ljq5~e$r3UvRuGvzo8ZF_6MXn#V)N!<D=WiXwTeVHd+a=i9!mL@
zSE4UkMBuvX@&Q{92fC|x9EVakh7CjSLh4%4F~{JZII-|^@}rN?oKBp3?+t);;6OYF
zAB@)YFqB-fgvjjK6#ew4lwNWPu6_1l{n=;J_~@fOI&LAF3*>T?bh8m;qT9_i<>h>)
z>-;$o0BAEE&ZX<16iKDXb)oo3+%!Scu<JT~JrPR8Fo>Eahc~NCxjK_!sMT5svYr_>
zj5))GQPR|7lu?SBT#g0tI2Ui&z`8CxSeIBVL`;)(7tVi6A0-kDv|1U^tjFr);$p~T
zm>CXttM_mRhl88T%c;>crq<M8Duvz)#XfRP4^ds6>^!R!^@c%dH>bK8Ww&!nMFq9M
zl-gQy?Hs?eX@0>R`M+0ZQl^PPz6gq=j|%{0mExOhmSdZxkFLpNC{n6WDfI3^gLrS$
zs6tSjQ;KK8VW!vDb3-7&MH@EoUMJ)A%5<H&Z4khU{^PRx%ecGoZW3mK`SJOrjdWp3
z1b`Wl8SLWRg~7JLy}DnEX5r3(cXERF1b(^Umn=yxX|>D?kr()L?Vq{acR9Z+`(3No
z6Gnm*DY9CYxXL$%HScX3?-&mnEKM#24Gat(ZG5!D0CrJw5f|5A%xm%2P$*uFzDlWH
zT1fW{nIUF}XLEA#$?b0A>e{OrV;{rK18(l}^$=~7I;ee2cRHb2ic9L#Psuel;y$GP
z{BG~zhvPfyDC(w7BQj$~kM<vZ{dI~aPsUnN@okTx)k^W1XA-{pYQi&S;5+u%Zf&!C
z>QoZ%yhG@YJ8<r`7g`S|(oHR2js@@>aYUDvw=}Pgs1(sR-^4z0B+k*JTP>@UqVeH}
zF&Y}MPMwNowNiB4aU|x=qwdNpDLG$SjzsUsY@UF+n|@nX##`|?565C0849)8TR7Be
z#hJ?yplSZNP9F5vWV4{_jJ8;C_wfU`*J9zKva-Ut8^FS3l6_sS!uZB5=Y9Jsli}rP
zlt#ngxnz<lUAS&G@(=D?Q`zyAXp~P<DQ>K*BdZiT`RnL14Bkm3_&Sqehi>$komEo8
zTZsgZB$M3T(7>@iUzf)tx2Har15IN`yS+<|X(mnYxvkjO&x(tgAB*u&D#cy(^&DSZ
z+^Vsm%3`6)W}`NnC14l~?PQx9GZ}C?8K!C74n(`ls%iYXv^3wN-DE*B$u15@VSMAj
zEeaPs5)4vgvGBX{a%`H$KN}l4ZuM%O8ak9CJ)Snx+#I@2dOIj8BfdX=?)^DmroUun
zcqTT@#>>NB=9c<fxU2pyG)-fGbpR(8pV;|^wnCAmh$n|U$v=YsU~0`&CV3{Yr)y6#
zD#N>pcUh8L!u^Bp=ak}8T1<i-G=lu2@gJ;Cug0l48EzZS^|jYC%sz}?l>CAb_7MPF
zTy`<bHY{U)Vm|)~{Rabs5%v)sPBOoPV+YQ0pTiLA5T@5p=h&iS+26fCFGOCT&Zr}p
z3vz7Hv4wp!XDEZ4>u<)YS$TZO<GnVS{STQ0ecM><wb!r>9g2O_xB1<fwQI2!7o+?0
z-TzwCmzJhfx2rfcX9R=f)~~1H&O6bY&65P+-e(_z4?RTel~>4Z*no9#*IS)*x0?ae
zr?cj;!w5{7g8RomM(bu}z|B-LNo4kHa)Smj__Wiyy}p@9kX*0;?@>p==7%=ZB>m-=
z*vE`P({)^X>_Os#5Ast>SgmN9hNZlm>~=68l;}U~npWto>F#=eA25Lbty#krb#+|R
z^ibN|7>9%1olZW?W?7a>F}Rb$9UnK1Lpt2s_g|7a;A(cf>oOUZr&65j_qSWbV;6^m
zT^tVnmq_HtmUW@`E~^w4TBqxECaM%`vstdJti-Kpg<d_UrV%zx9!jTqH5OxscBa~B
z&vliRytj5O*ETdzZna|XVQ{@HorZLpBT7rVG|on+={>iV`@6QPiucy8<@&}(Ds8q_
zJ&c2GHYU1UJZH19G?`?tPKvpFluV-Rb`EzqdVDQ9qd|-5M53n22k|&(mz1=5?b1r|
zU?jq1j|aP!f80I4q=W~8LH-d8a%4N7lZ;Y*-fJoPmnr2_sLR!nCe0x0Aar!@9(Xq!
zvK#PPyp&s7&%fH6oSKtM%P!>{|2Zs9Ev7D4hla+9MJMvN%D>^#TW3@GEq;Do`fC7e
z*z(gqs0>O|c(rdo8zq(!o*MELOH)f(nOVsY+YlzYCbrsMb7ht?9vb`*n{u1*>Rw7M
z`TOjF-UDgOHBx1*!mYQic%381eGT_9(mImUD^5p4V@7yJhdqL#b8<K9V~GzxB>0bi
zppr>cHcRr2H*oI0JC>#Z57VUaU;o1Bg9>4Zg$uEd9os74gZ%isqM!a0du=W8H{Wb?
z{f-_yoV)Et<@MKNt*s@uW(`^!ExU!s-ww9ZaNm8T7cHXlmRqn68PehT04T#C^wd*C
zUwjdO)Ust{SFgr%;DLo@(qDf~WY#RSrZ4M~U;Ki>4?bAvku(ztqA$Kk$(d(%x<4Vh
zs={ieVJlO?c5*nlxw4WqhQXf$fmXqzQ`fnmv=kf;W_MEbWkWX0{A7}$nGC1&a5D3)
z@nJGaPAMifo4TSVn{9J!l!7i#{vI+-imlczr$27?emu@dn~nY5ZpOP@?9ue!Sf`V-
z{eDO$nHdguduob-HXGBbs)#AYA2w|w)`PLvt1=nhNTrx$wKA!V`*mAvnnsz$vem_L
z23W03tEwVlnoO;!A=1Y2|EjbUEtli@PTq4d)8v&zf}&)Sv)br2>}yL?De4S^gFK!>
zk88*<Sl%>d(GDE%@i3%WV~Iw-_c+r*gG2pROm!keg|&ieYjq)o(WcoLZXe#~0bg@|
zi=RoJNt{}IDyI~m!oKc(+YI;sbaaaKVv6-*+`1c=?xNUIj9>S+n(W=GS=r0A7pE4V
z%0cdfuxp)XNZ2$RLv2F~0Uv;0_cOviqV0fB<+!@`YBuCHFvvcLd9issA9<cRu{qtm
z3SvtV^!2g8MHkU<?X?)O81c8?CL0Q2ZPuz7nKcXNjyq!OMo(K;<Z5eaxbsf54!+Rb
z`|Srn;}cJ`ntM+rlf>V9kHm)`w%ZC{a{l?)PC5ydPPf@3X-1>@@kCp0JC`G~W(^zv
z@CWLrO=G}=4^r~;pLglJ(#w`ncg{J5wAbj%FJtlf@@cey8IKd0HLFDtmlpe0irO1*
zL@zIAz_e*y+NTg*F~;FwRVS4oI|^>jE-B$$pO1B3FKvyGILq(nM2m%gg~NQ@!C0hw
z8yl%HO>VBNWKbtPf}4+~I~Clv^hGAa<+ZhZ-4xW#jmH^av$0dNG}ULLQ35@fvH@Uq
zI?YJCy;U!0XWop(II^8UYJ%I%J`M-(BochuPEixpL8|3Xd_Jc5{nU6oL_5pOXy>(z
zQd}7bU{i|e0|$2N{6^aCtm?ve$oBreKlXZ=T2fLt{<dDf*ym$TBEieCSi9%<uf|3`
z$!7U$SsA-^p<-uGgTnQh3|G|D@KMv};MHgpr>3#H(^)vzS7I?%Wio|Eg}+o*a(=T3
z=08d%S&_+bc1cOQ`&pgIFs75wkPtn!Fu9Pw*8Y{J!%y>7`YZmh=?~o3a36-+9%f11
z_HL`Yjhh;8;_nTA=g_r>a^yEha(w;q9abe3T_a6ceav&pDWt#tn&|A=pcKPidWpJQ
zZzXvD{V1idmX%R-(n-CyL#1fA?>=HLzf5|~8gl>n4`wDq#pRb5QZUVMn7ZlHNxc6)
zxgB>z+qjYSzx*Z6-FBm5>Qq8cKTTxjOwylyMrOqd(#w}qdf|mFil;z64Ylf~n`nIa
zVKB`?CC~U9ZxEh2ll01!WJZj@{Pa^cU3zKZ!AYf3WCH>0!-g?p-aH&*$9DPjtV4$2
zJmU=PJM2LHU3cL<<Ph9@?@eU(Y>Y^RTwNXBNt3XT8Pj@Y)1+bgbVwu^_Vm-}#l>5B
zk%ee&g3Fap(c6L|pI){km115Z!7<4s`?}pYG_A$MuMS*aRmJP8R*`OFT%TRj_{ZSE
zocYZ+oU?8n&kP;PF3ldW74Seq1NYX|amRoGoZ<Jk+6Lq&f8RX*uqKzowAqLP4Y?d;
zRx7HTDQypgLfjb+Gui7Urxf3$)A)3~&~x@qB7vb)p{UE&`aGNEAh)|q0fQo6Smf<^
zod3k*9OCg{(z2D)Pznv$)#c(tr;{hcVXn2?(KQXbrjb&L)tL-)qfsV$Jp9CJ#SX2C
zo?Kp0!Aq-Glip%XVA?dXY8v&X305nSrhRT6BbHT)WliG@*JZQJ8akA5-JIfJFPDoa
z!(mLN+N@H!I+Nk`c$^7tH)TE_jy8^eYI!+xR<9=0PH=N`RTUA_<ihpq`S*|^9Js~b
zab_gKUu$dmQ%MPzmY28r_fh0~)O1ZFkjs(KG)!HmK9{4&V!>1jyRLUR7<@Vs;g)oo
zeX?1qZ8kp7WGJ>+3gbPOCX=kqWVo!nyv=~O-Z1#nrcL~=tc;U8=$TxR$uPN_^IHnh
zUHiHAV?Wn^Tw5jc&;eXgc?DNgUh!QYM!%$~o(vijol^=U5Wq~OuvJ%s#e$hik=w8V
z-RHwvS=sKY_0y&inlXb>@4nk+`eb{|a2RD6`LThf2}<PyoXuZ;rdgP7L9<#xDO5I#
z(lo54rI^tuDw9F8+w;AA*(|!(i`LEqiOS_#jOkN}1V%IpRx7&IiZV@9vsQjh)6jjs
zcDL6VmC2CZxDkuTgQcPZ$d6w%8XK`zRiU>rK11bl1Rr_`i`R?4shVo!`R6G*?zpWw
z1|hceW<1VsHg4qIkt6Xp`@F_Xlj{QkK1d{JXsWh2!R_X%ii#G?Z8j?sA*B?jx6>#Q
zH%;yj2ALO&agf{1&JG80rFb`yU}HAR@5{?Mq=Nu!WhTSD_4S}>tjuKiCX>OcX^eF`
zDYICpv|72Wyu8IYy^hR_#rRiaBl~+iq)d}D{C*w|2FWNzmCc3?IK%J9+eRSyVIslt
zYuEDjs8NjWppZ%+m*ddYtNB-TH50l};kUswxxTiR58`oRN>O65@awWNPHT2eKTD^%
zqoIKnsT2{@#HnfQWVdsq&&L^lKQ{ydycLgAo6Aw8>x^@`xU!<6&GD3*dkQaXHZJg=
z!65G@5`2}-(wNIJ#Aai(-Ck&`4w)ty)8qiRo3lzv3YAT}<MULC<JPU?<)K3v)vTew
z1a1rjcsr4xHkZSvX^eBZxT2z>MT+BQ3*vD;NvFB6w6x6tD5n&UH8wIM9A<*Y!yZm2
z8Pnu{$t0hr)BLKml*v9{yFH4vxg2*kG>|e))@8G-%w*7j9qe`n*=%@poy*G0DeK}j
zSe#5Ut-hZ9+-{Pl$!UH+FGQoP&14v1vylT%_xmYtV|%sPELQ~r9Ncu>+k2O9$mKY4
z%^IGru4ebG{H_v0i0z34ecQ3R+ioK~b7r@LKCuPUr1rY&P>BRZlPBi`+(d%V%$Za_
z^2m36bfTX~E5#A3R`JJ*3VzybES(}>_Fix5jWLwMAU`InCuweB(_~pPNzgE`X&OUp
zHpV)golen^Q;JkmPoEVERX4Lrkt5#|=<Y_Z3qVpSg4rxpHXBw=Ln%d_VW0u!7E8Oq
zKv#pl|Axan)Y!;N!-sb%Jw-L0r=@Ay0Yl{zgPK=YHIyRPtcOXFzXp2Kb=mxH3;7@_
zr&PE8W|^k#+cqBqv>2;t)pfdFFSLEfty#m-MMYe&MZlJA>dCZfTK@Q(dLDZ+y+qtJ
zS(Zvsm&;+%GzQsh?CfxKI?mE0{~obG>-U^enB<EAb?4a9N>QK7QEs*3Xj-qqFvuxI
zrPbQz-)U1e%YDHh#}^l~m(xkoG<hi+<%HtmR%2ZrYiwj@ILz$f!?*buMInUf3zFWs
z9f~hpNNnz0qA$Hf=IgJinK~86jyqC%!38~@6Yqzp{;s=dy!KjhN)f#ER?sw@N?~s{
zf1(gQ<<K;KSz5|d;c$zfZ*#$j&7WOMQy|e(#k$@q)vhb7nufQH`-n}`S{!G0xHOHy
z&4M;f)2Qr10SpsRR%?e7v@77L#zuZwQqtuwEDc(Wjccpor)7)D;x$^%k=J~EovzQH
zx0$^uO|-DTt=L9aTvArXwEB9^Eh#AkKhVbU_d*p)kFK+?yLI7(&gg)rz4zQ!UK59=
zwd!^4sHbpUCd2P)YS`Q5Vq-ST+H{&#*(`C>WXloY2JoLyh>Oe1du1+KA%xf-NKc;-
zLiCcXQk=hG17{Q$bF_>FYS+eGj_1N*K24>V8;fy5aWNxpHct2ZTg~w{BNE}IaF~ax
ztGhj2!w<!!8#l7M)5-bmq-XxnDd3`w8+kqw!3l+FF0#P%fde^xi*bEVghITRNO0ev
zL2^BX5dDS(eL@J)i`HhdTvJ=i)m2r6iK0bIY15?6Ft9ZBhNYFlREjFAwMEa*SD6eq
z1_E4HSxI#_CQtvNX)p}_xM>rYl$W!Ij6Z9|REoxSs!$i{dW-km@>GiH_4V91U;tGz
zU4sy!ACaI>2qAjeC#e+Ag~R-@q5_vp?z~lErpdJWdQLAcX2&+FnTnRyW->g|*vN0o
z%iAnqB03i~45ruDb5=<Sqok2R2+_|-&?kftLI@#*5dD}mK?@;-5JCtcL_a1$pAbR_
zA%qY@^kWkA2_b|KLI@#5KPEw+5JCtcgb+gXV-oZUA%qY@2q8p2CPAMNLI@#*5JL20
z67&fngb+dqAw)kWL7xyp2qA<JLiA%2^a&w^5JCtcL_a1$pAbR_A%qY@^kWkA2_b|K
zLI@#5KPEw+5JCtcgb+gXV-oZUA%qY@2q8p2CPAMNLI@#*5JL2067&fngb+dqAw)kW
zL7xyp2qA<JLiA%2^a&w^5JCtcL_a1$pAbR_A%qY@^kWkA2_b|KLI@#5KPEw+5JCtc
jgb+gXWB(uA&?OvdbDs?W0000<MNUMnLSTXc00960I64;>

literal 0
KcmV+b0RR6000031

diff --git a/image/20180117_010904.png b/image/20180117_010904.png
new file mode 100644
index 0000000000000000000000000000000000000000..ab4b5b860e9f330cd6fec6f0976703d8fc4103c0
GIT binary patch
literal 204959
zcmV+W{{#SuP)<h;3K|Lk000e1NJLTq00R;L00Bb?1^@s6u8BCX00009a7bBm000ie
z000ie0hKEb8vp<R5p+dZbW?9;ba!ELWdKudX>eh4bY)!^&fNe2AOJ~3K~#90?7dl#
zWZ8M&_dCnIH}}e{y{fCLx9Qn>mIej{2!Id(5fo`jG)ddEXju$9BtO{^eo@$d@E+l?
z`C=*LkRSYDnW7z*xyZ6Wi<Afw00+wq2922kX1aT(_wK5$eaSuVcFys`xtUenGXRM(
z0?;Vxo5|?Pn>WwB=iGC?^Zmc?|9vT(bB+@^krO$Q6FHF+Igt}NkrO$QA423$`UXzq
zL{8*HPUJ*R<U~&7L{8+xCnrGSL{8*HPUJ*R<U~&7L{8*HerP!X5+`yZCvqYuav~>k
zA}4YpC-Otf36MCE6FHF+Igt}NkrO$Q6FHF|TJ#6~;xGIMA0;(Cax>)l7tSyk#$>5u
zG{~@tW_RrXXAMt2d!CKWHAdNxrIlsw-e0HJ@1g?D%uJoZASO!;T9tY3nWtELut}>m
z%dj_OXM2xGmT*Smtl}5G@K^Zmn^)P{+2PW&m*{lcR7({;@zPI`Tg#hQzsJMPP5#|q
z{~LVrlb_)Ce(!hL-`T_F8DSWqY(z;<@%#VJAJ9JB<=6kcU*nw{*C<z;JoVHiUV7;x
z{KMb*M^u*=kj*AxRA$ufqXB{CuzN_7WYp?Y2r1Y**eA_0l$0nZIDh&KuV48Nc_eX>
zrIKZwDp$~hKK+9|>a_|t?%w6E{>m@$iObKi^Kg^@=70H3YAa`X;i-%KM}O_#Vz9Bs
z|M9#3gn#_yZ}O?neU88KnUArzxy{b{8q>`RN!;O})239L=iS@8{1^Y_e-FTL*yr<~
z|2#>O@CSeRMXp_Yn`X1Y*>h)j^Sf{G+rRg_luA`Poi5!@A1M{q<^+KvNk^DGgUs^F
zzx=Or=FAz=EaxwL_Vaw<XMcgWuD(UR*5J&U^9U#DcDr1?cAam1=iBH~L~FXmOmmvg
ze&#b+W3kzY;h;;iH4Q@W&O7hW>-X5*-=p1b<D{TeFVpVq@ZkPUo_*?Rb~bjo^4goM
zoIb;w-+Pmh>9V*|L#mXW?Ok5}r}utDQ~t*zuU)^55CQ-xB@%&@0x2X?2$WO^DUebj
zghV<BtV1LG`BEaJ1nJ)kzyZ#IbrvB60s#_)kSHNQN`G7kq;p7T{W(aS6d(X05CWX=
z?I{ULfi+-rgTx_)Lkf!&fN&rM)>^D_C><iS0t7gRD{jhJ2YHS|U=ffTT$YjzM+~}M
z4i64FI5?owZWE7&^g4&c!vO+^F&1ZYoUsTT5{GgQfuj_Kl)`{O38E;ZS}suvLX?zP
zn`6=pla2@^gi@fTL`y{=1<Hc34rdH5&mc2|fksJLcu@Q};v7QwE{(-H-w*$CSZi_4
zVT8i~)`1a@%vg-`$8zT|){<LG?hMAd;yeLCgejh%vyR*va$_*Yk{gRL28%!|4aN10
zwHWKi$2fz{{Wx2|<o<fj7_4*r=fC+6emoQVM=by1fB&B+>*RRdkMZB*aaT$qguppR
zp63{2kWvB;C7>Keq*;bBhA<2<&W~SIDx;NRI2xgK062Qx9zqDJl`6UQ&nXB)wASP%
z$5}@Z1n3~Z7=tket(0Fo`1NOv0|8oTgc4+VhO-6`D6J3{jLp$XQ3?Y}r4sdO9jyei
zSfgp0VDb!!Lh1;iL!{DF$|XwWGR_*}IL26m)*2!FH3b$SB?5<#0;Rlmur4QeInFqY
zbqFL<X#yRfltOFGa5x}IM>LytvOJ~NYZJ#q2K@nHsX~@I{?6a~yR5C>A}qtN|IJ_J
zt6%#PFa7jITsUI;V4WLx*O^|ZF-#>7H#!)nm|vWuebAv=o?_642WuNFpQ_SqMrbW*
z9}dXU46I{i`7BaMdfg${uW$0w$4+5QOb}T14+OJwlFOH$Cs0#-{pD{^iYlC4eFB#Y
zu72+x@hIVm3#(|Uc=!4Z_I7rdo2#=hKS!fcW${#%-ta!1?k@HE6hRR1^{=n<)Kg{t
z$Nz5l<DTL_68Vkax{7lS2Z-X|M-&#|obd|gm`EjYj-!16yz+YFd#>0Q{2o<o8U6~z
zaZ&6o<6{7d_i4wC=cvF5z*&T_IEr=zX#JSk=>TINY2RA=o-vT`a}SRV0Z8jNHv(`9
zjYZoSlkD;K8(%}(KA4P4Pn_dBuY85&#TM;;pW56arTR1rvkTNh#roO<!bXFQ%}qL;
zL!3>iS0eJX%ihL)BAJ27=nV&0XDF2<&ZU$hjYLo`H8|MqB4mJ$683us)LQ45UVa{1
zI>pnMKTB<9g<<Z<ouwp7gt;cSmdrwq0ih5`unyt;INA4f*pK`8<%iSYgusdrCzRjc
zOhUwne7Hv_Vz$=bAP9#v7S2KN1V)@e=`vCcP&VUl{mQfNxy}!g4-6y@JBO5N8S{%(
zjJ5OzZT9y&EY2^p+diN<(_m|BjotkXjEIRMNp6O;T4k&qA*5n75(uja0?oNI=UIQa
zgAkJ4on2;TXDOA-tj=F#{r(QExh9B^+4)5-TzHxno`0Uh_5lwb+@oBnvi9HsfAin}
zTfFkE*Vx-T<cnYYL-N$IvwJ|l)8oR~vqWJ)o@Qi8jI)Mb_mG?KzRTs8K2Dm&v`Kh<
z<0d-Z$Ck?|6_5^NN<t!)B(oX9DWZOts2nj$Q--4vVHgo=#X>Ej6A5%#V)B@Zf~k55
zVfxe>5vhqu;vSW%;_~xP@~zG;<*9)6o%_ts)G3FWs9YhEf~Zkux3dE#qf!bmdB(8Y
z#=0TXtvc;qAL(*RVZiw(o*>K8$>usUJx#OOWMlIoGqWwGrdrI;EwHw}P7p){fudTi
z(jWAT&DUX#Wnr#GtyU!}l_-@J<#L(Kq}1zm%B2d%ShNu2nFS#U!!lv1OszJ>RHF$9
zZ|GW!b)b}DcXx+>{zrev3(vp6!;LlO=jX6OaM0=T^>4gJvmWu<x8C6L^Dpx6{Mz5(
zt*ckb(v%ywZqOUHn4YU(#fPu3SU$)mN^Y#c1!H9{5K>H(G=;gZ)EHdIqn9Ya0bbuq
zDF}iPA)If|Nu=<`rMH}Y`wEW%ggB;a3q{T`quE+;7OXQ!XK@t9{P;`GKw^<fBTFSP
zK$=6Ek|qgp9FvS<(m2NDmi_&G4h{~;)09Dfz_8b6G#HSketu#-P>8f3lD>WCKnjae
z9$;w&O8S0;TKjvk1{n`Y;sHiTw33s)i2`&uX|YmZg~CXQK%!g$O04w&#Tt~ecoXz!
zvl<&|Rscw}j<7;`5aAp~dh{i*#ghOh98&m}aD_s*2H_OSDL=5z0Rk%}IETqCS#HQp
zjxjlAd<#-}kf}A!Ii$2W>u|<_Fjy;56u=D!()Zb#_uq6sEMo1E0r7qX1ib-$v{uG_
z9lv+Z;+zL>NP!Y#peT{TAe=!sL7v2D3Dru~gG(&sFk+O%1!%T7llzzTfDvm7<IQ57
z1p!h>|F?BmEXEp~afCsLlMd%3LRhSIxI81bIXRAvy?v^sGUakaz0qL0HBC7xk);`F
znvvy(B<?XvVoFiS?CdP{dYx*eM3$vkYl+ICzrM{2a3!(U10AU)T1IF}5C{Yk>x#8)
zEm>wDgiu$I1V}<6t)U_iPSNYcbPop@qZssJ(j@21g%$4Jzr|nrh0kzr^BTi$4_($w
z&qm~?%+AgMO2N)nhNDj@(pV#KPEjpSA%Nj<M3Nc~4^yTa5v`d9rBaEltzF{bh$o(y
zVrF`lE3d!FR6XR*odhQq_|~`9dHJh<!bd+chf<2e!vT4cv$K0hpfquuGaPh?<CI#X
z&cfmnr%o+$@9s_JmrAszn*>pgQW~v8<`>FXXMUVh`$sBvJQuAi40OL=92ZsS#N%SD
zMMx&cJ!Wu6n}SCsV;_@Wi^6|UxT*k$96MWzV@F$vo4^SvJa8EUZiK)&fe^*+C%pH{
z<oP4_D4Yk^kMu?B_n6G@tLGk58N#VaXC($<bDT*i1(Mn62BXf1Zu=qq-HhJO4Q}tI
zl<GAGgH0-pSx&b;%Es+=b~o2p-`*m(mM{#wom8tc8g|LE1Sep9eVZ(IOf^cBqw*L-
zF&d`SD<#6f((MeXD?_s!VvVJ@-{<3h;WE`|miGRDs8$2vhzA`y?GcUEEJ0Mp<^t=E
zIscr);jrehIV?osP&qbs&SIVNU;+&oqEJzBhS#oqnVG6(t{KzsZSvq?jSDZdC|6gA
z(-h%Sl<B>9oc|2@z(C^knOS!Cwus}H?cGhBvy4Uq_7AryRm%(y+LUUVN-ZS9Px4Bo
zOsiF=(I{h`;#=RkLn)Lz{mc^tIv^fq;3PY{2UsJ(X+mA$*Z%Ea=d~-Z^7h-;5JK~*
zPyGy6-?_$Dzw%{jjWT=Nn`~}8<l*iHjn*{hFI?ck+C!o+!X%dSXP-bTL7rx`8cn2d
zOiwp?_SvWS@>jmZ{M-zcN(rf;H8V{gN1z0O7Nl89lII{CqdcKnsxgW)dR>bQ{G_!x
zq`5##M-WI#Q3yd!Qz{zefT?H}S1-}-98%Vne*2I>2^1O4MwN6bqFgPJ4u@!yacXIv
z^JiC>Tbd(F1`Im;jC%X1lB8PIm?S2U0n(*7mr<|RFvc5V)>$gmD$C2uY;SL}y}d(j
z42z4)92|Do-Q6XQ6Vfa}YlW1cltu}`{QNw#bF+j&fYJe_QW*)9N+qh*3c1M%0$nI9
zMGyqET1}jDWX2#6XsuC%I9no)W7gLn^89npv9@-f++;}UJ<Gedcc_$WOifjppK0;Y
zkGzC%np=18Q>#w_lJ?;c6@;`}wGTQ?e`2DAk7EhpP-8IQ#(F_8{?99Na6(`ZUN1U_
zv=(6<0#hhUZ_r8vfzFRW$rzYSq7DAN6i1tY5Yj7iSzPs4WI`4ZiK8fhK}d%xkci7O
zvN$HoEO};$M=^tbk8Y<!x6@_N>oXb+$&wVCo5F*e<8niu<yd174kD!pOJ$-kBn%bl
zutzrPA)GBdSr$<k;|7Zr-cVLygisQJ^^qK<2(=~@k{}F-bl^dS%Mi|>097d00EGsW
z0Odd;uvzY}<zbm0p<?57lSqv~=m3kv0v7)~jB_|-;fZs_R+~?Zdr^4yq;q}~upZ3$
zom^s#@0+nj6v8^3@L<tLpmgEQEABx!P~(V`#R)$L6rhy%WJxLil>rjR0mJzHaZlS=
zgb)Nl0DyBAYYcf24FE@yWyRdLSd)V`)T<R7ki<i@^iMENh7(Y4odaPBw3>iJS3GCs
z{j2`kIJEK}T8AvKqD2&Q%3*QVqNOA(MLyaH%(R;1Sw@<s^txRzj(WXL7)C@TNhm-k
zF-g*AIEXov4r^kfC@LHZ0-MLEFvOY^V{(*?uqG$ZG9q2ZjVJKLSL_`PN`TTJoHsO;
z5Dfb%N;!hCM709-TFU-@hkkcNJW7#Lp|s-cxmB#nX!qLO-@JzrntDrf|KToSXn6X`
zCvk3@a;1vaieW!vx>e`QnOS<hHn;EGVK9Vp6tH@FiF&QYy*ukvD^2<xK{p+6^VTNQ
z&3P&n&E*$UuDrfYo^7+RI7_L##O>R6xw3bQ#o1|^jXEZ?tUcIZZgz&*xl{CdJ?f1q
zvfOfNWd*4<yL<aIrb6274vUM6eB`5x<oSnpo#;S&5OI7xh_P8e1_2-@9w0ADd$8f1
z6A}+GnHZnP*WdB>d~|KRCXaB(1aSD+TygB^1W~j*-sha~k+bpMgah%I*?F`lG65l?
z=+N=&+Hog&Zy;hURygmp6Mjz<(jk;1Pc!n&GgIpI3b$@u<M42g`I$0N=-4^jq0wrw
zv$MvVufIa?V4FrGLS#9Ctf3Ip!U~7m9Y%42lmWMH?=U?*$HM$9hlgEijSBri&gOcT
zH(r08<%I<V5n;7Nt<|JAtYXuM#hDdG8Fbb*n3-=f9Cc~;dQ|IkSeFvW2q^`k&^$hJ
zUO4#lqj4aM^ZExj8589!fe!q>AdPoQC0zt<!u*iV`Wj|?NPDo&K$SUv@zaRt5VD9M
z7!bJK?=!mJUp_F9SeRSj!iCdxy9XS!cNq=_G#gE-)hfv_WqPL0gZo|HzIvNyE}da!
zrbW3@=Kj4k4i3GCvJ?uY8WpxTcIbqC0;L%AGfZsR-#TP&c8N}>&F}oq|4DB!;&Y$-
z99vu4{Qf`tr*yi9WFltu+y%BDJ|q({Z@v3nF2DE@f=F>@^%PT;28+!ZgoB;!Z9459
z!{LA|AEC9PQr7(RPk#h!Q-m`-wXn>J(8O9Hb%{_$WEDY02RQ8*CNX7QB2p!Sa>y`C
zQCgu3szv3X&0=OznI%WkEQeG>g-%mMBq>!QaEkW+A)~>NQmMpjqe<L1)O6&hg@zzf
zl$E1|MF~SP?BVhhts+bwgOY?wu`oMLwOlHmi1X+lD3?korI?+YCC@W(f;+eGkfs@>
zQsK=O5QZV6Q9_a=XepVRYO=h13TL5IuJ|yd3aC_kl*0Rx9V$>X8dbtjQ;I??4k5fp
z&{+c(lnPK%Qg2kbb?1;;y-M1S(ShVUZ(L!R8vg1p{%gGT-EXtAy~XW2x0st=q*kp_
zu9QfV9Hj%KD|6@O<_DdoKQU3xd&C8fpfC`}2EP!(Q;~{e2th6(kzi$^fSEXpCKRIa
z%O=?b5J(DuQYcvoMY~7JULZZ~=~xtGtdo_5Knns{7)v(Ckz+A9n~@9$j0Qut);HN$
z+rZ>Gqj<z<G$M@?OqNefYER#ip6Z7nEFyXSUK}oqNs=LnGYFF+U51hlr8I$31X>d+
zjaCAsBvL@60|Kp3QV=LfptO%x6#Y;|f0b08l2rf_;T+Q2;S&%c0aQ=`2`^)c*VwaW
z3$L4TMUR}Pk{}dL*uq0SHZr~XcA}s<72mfwj2r)597ke>kK_rd5UPk~6d+S7g%b*A
zJz(&3G>5Qw063m6&iT(BNbBiPj~fpkCK*$f#_~9IVGJhTPke+zcpA^734gA1P?#TN
zxj_i)H)kPG()zL2-YB!hByi5+a2Sr(i4-2ljSa6!bWn`F!^PUn{W|df7f}o=d~^aq
zsT3kbK$516MnlphW)u%-PEFI8nnEaxb&|#9d8{=I1_L&>))7K5H#f`d+#KCrhl(is
zC<y-ALRq8}NF_13_W&OoAwR)AnkCCJ4?vXHFIjFd)*z&y(P$C`Rq}j?*7OWU_Q+k1
z4g`nY17_x?>1Ky)?dELnW|Sh$U|<o{ICn;~wY|sY`W{k5gt`iDNVhj&(DQ2}s7REI
zz$&CDla4H}zOv0zPbscl?eo`u^+gsIr%_6A_x_i8{<){<_X1x3&Mj6?HL!I}ua{5?
zs?@6uTCEn1T7`GtSz|b~Xr(Dd6`s5FBKOy>QZ6-!N&(fXA~%X&FDHtkAJMG+@yikQ
z(oOWOP{$lYjMs^O*2mYBF?j(%6iUho&FDBN85{Xy@camH7=Ml^){xg(&f23W#U$i$
zbkEMY!qylAh@&<i?VG2hPVVE8?~C`G^Mgb><M+V=@hB%iNJ3R%XTQUDzw=Fg{&O#}
zy`CWgL1TIbv}R_ZMK4Zh8cTbS5Je@<uPzbCL)x7lN(HocH<+2Kvxg){ar(>(_1YX^
zX__0i9<Z=5&2+Pckd~-4;NE%{EkjDP(*z<Smx}qB279}ANK?qV+l*|;!Tv*xu5<Re
z7eSWDoFX^igr`Y4mp?*TJ3fBOdG`gAvGI;eDGZ@7<at7)8eq+kth2#fL(q*AvOyo6
zOKK&_aDR>2)>DuV>FnP{WNW}L|CwWbTs|<6xc=51s<krr?yfOASLf8}Ir{w(kqnWM
zV|#O#;m{F9C2X!Z*dL<W3A<Z8+J`YOee8KIo`c<;1J)nzvcI*@sl{o|pFYn*GbT$i
zcDD9uZ{KA&9I?Ez!tLAdl4d!>QJ<)$d1mzqZr;64y;|mpGppQxu+EJ;S6Nt^<Lx)!
z#>SS5XP!Vf!9k}(quyj^dxJ)!Ouu)??ORtle}0AC{Q*ikuD$vyA3c4BJc`JW2rH;B
zmI)B#<j9gDKx0NJD8(QhF-#JaQUp4nQZAD<YAl>uAr(0??K4%@7#D*KP-%p73YR;K
zg|Jp-zS88}>RC=LFM(3@ZANXX%9(|EoXr{bI+RNRv(r;lB7xR9QKd|~Zz)C6Q%{bG
z5Z(xDHm8_6oZ{N`s|cz1>}NmEm;U&V@l;<&lEhRhWwZ_$4HM!~Ob`StFE7#S4oEXo
zgiaMv6yl6UYK1j9QaUP?h(@D|5RNF+M5PdCGo+9h0i!sk(Wr9a{1Y^$8tm?Fap(RW
z27?|_I4)j1$CtnIFQ``o7MJI_e*GFe>Aj5S&R^idgA3fdcc1NzZ92XF2c4!rF-eki
z0vwDq6Qf@i-tsYEP(|F?D6m3JRQN=JA`sF|6tuu0oey=&vHxfcB-}V0U2F!{`WEEa
z<UKOLh4AzxB|y6(H^W)1$uL<=nvF=}0iA;bdhIs%Zr<j>oqGgYd$6Dsfzp(;CeWeh
zU`y#K9nPYqLM!FHU=EzMWO+uG8gi3TtAy0cHI#xN2#LagQWO#e0fAB|r6zzu34xLV
zHFkVC>vM6eDY#iaf+D5=TUdv%o<=3CI|5?XdH(vb8WSEoj9~!<<w@ekMwt*eE4;yo
z@E+$e=y2fVk;l)!Jgv{+Z*5E#^Q+W@ITc7y8avK05wh@#3s2D*1C&R0-?6~}-~r9}
zEMY#pK;rSR{Nq64xH0j5;<1>As>PAQvpKoKk+-vuBLm9Qq7Vux@N>%9NyAd90vvm)
z-Er}`Dg}4Q9r44*+r4+LjA;js++>Ar_SDefXhfEKM^vR&LMx5bf*=ZTPLpIYxichj
zj5vgxoInTUHpB^sv4+h0yo}sgl*!36JP2}<BTaDR!8O(cXrVlBI?sKMj+Tm2xr7Qr
z!m{RLAO8q9?!Z$oo~Ao$v)kS#bA6DKbLW~|d2^TkAVo>ZtFOGy$3O8gmgZLJ9cFYo
z1J-)$R4WnI<<u&Y+1UzV5Yavu@Xp2>>ko!R8X_e*y|h9WkJ#TGki~|lFFnob$|;r>
zPxHTi@fALLd5Kyzz$85eSxBYa;+bcjrW}>o+S=gBi;Dy*Vl+sYX)50M&YN_H+kE<S
zm)YJ~XLompZf}z~jyZq+{GWGP{!1rfqMSqll9|wfj@HchY<EOc0-W=dW2whcac|%k
zTB-mBk6+JC+7uJrQ{+F$0=O4#`GCY&SBb~kITmSn?0zTbe7`>P{^$Q7QTPb0aSo|u
zG1oOg6f(WI$}s;nH|{<p9>f?IFc@Yu=cbsNou}4ZAdVB}=9d{9ZnC+105+!_R?s@&
z+V!_tK7Ec+oY5VPSUkN#dw<A-hnuW#b?Egi^Ye<?)&kqR_fTP(dcBH{B6jz7Xw9r(
z>>j`U+y4_!oWIE4-VWq3fieX3v#jp_G*i<{I0U7zLXwMuwp(}xZLyvoal8QTxDIs)
zk)ed49xBpNA32KIy7MOQe(z<@EtKf@_Ys+8Z~uV0tTEcVhhEvCrRv<dca^($zXAX8
zfBokkbNK%OB-U>2W2|LyX^wiS#>U+kV>NrWL%mU_)6Q90xxn7e9^ZR?htK`R%iO$i
z3tW}f)D)eAgl4P6<rgneE#2qZ+qbc)WPW;{q+<BeAAXHzpL?21m!9OCufEFu{tm|F
zAT0g3N8U?Op<%DRixp)$H+OM_9PS;k^N+WvhBazom7DLTOgEZTTP;qVTB5UmNRkZ6
zvJuzceVayeiY${%HKw`OJ|N8#26;?WsnM)AX@nJqy)H^atJS0&1f=}|y}^KLV~Sy#
zFc=NFckedOU%G@=hO~3wDHI~1(wrr)l<0JZ2(1VLMXfZ26A@ulCGRFwrX-8iY46nx
z1VK3@%yVxjnUqK?q;xo!6ORTyQ8QCW7aao<o-ZtfpjxX@8T8rN*<o{YlhxI;l&f|6
zgFZnZn4WGi91W35FdB^rbco3f^YcrroI1s=_%28_N&HNbggiAgS}pJDbC%qs%+1e`
z8AI+2&gNK~gOp@h3eM9|9NxH#N)g5y*4Nk3f#&M<@6u{D*xi1}{PYwzZ@tTN&wPY)
zXV0>Gu*1&w9)T7(n=m``;iEPk4!Z?Kf=OP$IN4eWfz;l^BF6+)B_RrMN}z-)&J`eh
zj)1~*?6nj`VF^_L3K)BhB;M~W3lr3NOLyYQ5)+LryyfFP?YXCgc!iXarz5gtKsFjM
z>i0O<-{oL$2bT_5nQIb-AyE`jDwPO>z$c*s&e$R$+Z(wP08oGe9R!3yK%lgzw}p~W
zdt*nA^FoA=B;b6qv5$}xc?QmaapX3i^h+s;4n4KW*c9h--`yg7E(;*x+)+FBu|z}b
z98QR1kqLow5+^0jDW5SS9M+Aa5uOHP9Yy3oGd3T`Kmu$0<}Ane4leg385BtAljp1}
zu0L+UdSKzRIbghTdt*>dyoKYn?nD7PKEx4;$7Kv0j^{#r-*dqm{DCSqQ%_IwbD)S!
z;DLr51B8Nl<ebA=gSCbr^fW|QM0Fo=tBP@g=h1OjJiDW5<!K}DA2;zv*(i<)0!<i(
zgu*9A8)rzem{BsMtSeY7NisqRK^TS1&d$*9_vrO{bUJO$ox4yNW)kBJCbvcMxdBpy
z(4I;%_FlT9+jijdD3nBLANew4<siXWL!6D+Yi}@251BvJBy)Y9Jip32U;Q>qs|)N8
z4!QEi8kK5@5E3mlapG86Ugni=yi30`<oQb%84etqn-4iW7*Z;inQ1K&>X40xd#v3V
zf`cHe^YdR=rBbQ$!gF(gWoK)hdZopMvrqBHmACknUwW1-vAp)$HP-G8z$#3VV^Tw!
zB($c=TsXhN^=s=G6Y$)nCEk4V3bPAS+_>?8(WplfOAhv8dOdjJ{D*HJ8Osmy)Q|st
zzvEKLLYI0lEUY-1AB;hQcx;^=-&<srJqiE-AOJ~3K~#=WaPi>fDEH1y0LJ5MWYYez
zXvOyj3`NlFea;zQdmPpHvqTF?j`jNl8mB|72^eNMPd)z<r&iCgdE-^Cy>g4`<}}GD
zq1)+EomryQnx$5%@a8vPrM-K|p&GF`KS!t2#u-PWInB-64_R1QA}mD=;uKkioA2I1
zMJ4t-Bf7mU4rdaS4sdQrSP@i%fM%u1sNdn*ojd5LLchPsVSC#bMo4p_QI*5PJ!a-l
zktPNu97^iq*-6ACU*geWkOG8y6i7I$kYvRDeYEM*Jy_$xjVl~(-zMqgV1_g*O%j_>
zF;Lb6Z1*8r&LaA4?p?e3XAkt_<NiZ`qmbQ)UBI%x-sfYVe2y@vapB1`y!^GV@!<9z
zE31o08#3Ek#H5>i`_-$2fo5iQiqUAu{kwP3dV#oA!I(ZXGcAULA@}Y*K)8VE*$Quc
z?@iu#^Ht8AKSOJ}3_7M<DPg20jt$$J+XOOTG=!<fER|A?WB}!`jBtX(ZkL0!i&SME
zY~P{V&v3@FxwXsOY>DaVS?;ZE@nC(6Kl<ZuV~r)Oh6Lr1G|SOaqnu#aAK`?c-l`(4
z<Mh%z&6yUx(UA3x4TSX7Rw}I)-+AXcQ(+Z5h*?}}a%Od&QJj(+==TN;2MMKeg`iZS
zpISyq%5VLH-{j~1@)tOB@vlQr;-EL;>#tnl-0EpAzxXWe-5v5Yp;0OkR+^v!B1#N*
zhp1qjaAn7No#e*Q>2$fj_K;ut<$sf{tsVZ(-}$=)VZfj_0BcC|lswPL3u?-AtHrPU
z@-KpQH0ljTae`8w%9JJ<Ns`fUo?q*%;rhGpa_7MVD5wdm%S*iY+;b=)$fZC@kEE3f
zaL!SVDm-!iBIR<0upIGlYm+zL{0_^Dr<rXn@Rxpek!PQMlDDs3V}EZOAq<UHnMOUN
zR{QX60Eae46`maH3<_V_%lpG6(iZfmaiUueD)Y}$xFTU%f)W}n1xornmRtyo3Q<^;
z@S$oCNEAv5q)-L#8<5g_F0+gzP8cO4;y7kBib>)TCQHb(m@G|z9AR=W8PerQ49Xe6
z5jw}>$|CcvCc^p(IzAbEoJe<MS&fz4cyl<~v)m*ZZEWy4apc(-x&M~;xfDjE^GSv{
zH=%3^g{Nrw7Rg*rmOCKF6@Gu`yrC{#u|ZjPWLT<kSpSG5;L{n7?!BlRg|!OjyeBtz
zf?RmYQtli%U~r7Gj0{g-F%DlXsCZexxUm;0@Vt6A1|<~H8#ggZjT0cX2O-WCfMxvo
zm^LG@MMWSp_Ew2MJLLaikV(~%V}{Q6qcwrwP+dV4qo4y$INk-I7)J^$6j)mN;j$J{
z0QPaN%yG}GC|tmPe#>GWk3GDA8&gR{0VKTB#ksMe$K)kdvHSa`JS9a74;*Ddj}ksQ
zVv8G9Dxg{m5lWNgmTuQ`vny4fWNn=A&V}Nhg^=h_6`b@UBH_k;JBscAp0+3qDo{wN
za4u&w8qyoI(UE~5W^Zqu`obKC-7U&>&ECO28(aJ2uF7G@66ppyFf7c4EX>U^GyQ<O
zcM=qWnbsUTTRY?_7zHM=Bx%O5my^VT)s+Sp&!6Y=iy!BUzyF6E?Di;?B{$x=%Zo35
zjLo$zl2Ocs^B4KkuY8Tob)P7I;o=;^WxVyh8$A2;lgvy{aqHG?K63dYKlM{D^5z@g
zWvVgFnKP@rd;47$mgYHgW{$(dobP;R7x*sx?GHRXf1;wK^t!-WR1pOoQyPy74-_@?
zjzuWOJ}Qd6TgW5I5%>yyo`88|!b=JRb?kdOR_tU99*%rd#kKLyqsLe45%uX&(DNR7
zzeD1^{rf>80I3Z5Xh4=3s=9{8=N=mCNaKX5>1oR6pJeam5}Wt05fAr?`hA{x?j;U3
zcBrqevN$(`G6O~<#bLKk_n=Q0lv!9_pgj<*t?%J<g*b21Xez>zV18zqTesIqbHgBx
zY1B0+NoHfxQI#OqY^`lDHQhpm5$g}`QEg1Kzt=^pkkzy2X*SAW6QaOZlT$L7P@ARn
zJCqRe81c;aS{9q*SVviBe80?q&dvjR`**3AG6D^qUY~MVF-UR-X-YYEY;D|Swsx94
z-saA=*IAmG`GMp7e)7SSt>;%*US7coIJa_!%*Is1DSqY?KSPoa*xlRW;NXyRXU~(z
z88>g<Vt!$o!@UE}pI@eQZh_{k=H}ho>~8IFdSw}tP18QurrB5^h%`?<dyzOFAp=XL
zqDixaT0?W#9uTN9i}Pm~_EUB?clgV{_^Z5h`KS5v%U@x4cZ03%2e>KAXMW}{^6b->
z`M>_r|INegT~?N6nVy?PNXd(rKTUV=3YiHxXkRDJa+<XTcD8rf+ubJ!1L8RG4@*eG
zy*4@ogGFp@v$44e2=dG@-I}FdpW)`s2ZguS@T6Per?||$d+X$JOl}+~MdExVkFZoF
zmyUM4&((L|B+q{pp)_eGxp{Aw>4jy=^%>Gpf^~*aYwDF62fYD_vk0Y78o+yleS(f;
zG)npBfAq&Z`Sc~)-4S2<ldrP&;320@E#sV^*BQ{7o?_%ijPeAV8*0@VPAxA}ib_;U
zWgkM78e=R$5TSxHQYgIgQPgWqS~Dr7YK>C4#PaNPVE{uE2B>3R3auin6@)>JN~uY!
z)naF}O=mAgrU7%+oV5q{33SBOci-YmfAagBKYs?HE!W?9he~<$L8s|YOh!rHdx3<c
zUa$IuYgZH$bv}VQvxTSKS^}Y{mdofO$3QFPxsGEa(x#AmZ))x!vlcRgDZpT!XP7L<
zW(MahahlNWdrH`t*5gZ)8ecZmWLT3C1)6H53@%3t=gX*SL8N_BbEGwa5|jf;ATp!`
zA#9PGAtx$r0uUzejw}76YC{uaM)>48M-k*Y9xCT3RPK)#d~o6SH2L1vk39E9!ZXg7
zv>j6dMB$JgQ)$LjrExO#xE7Q5NDId4Yen!MBLumH+<E$laTH)e`ckpt=sZ(wUPq2$
z|9+gBXx*3s1{Q_&B$>jXl*g_Mrg;8#a&HbR1ePLa<Jg$~t0I5y{uGaUQu&Hw0XPc#
zrwIKBab!qIsX-p)$yn>>kdQ?gWsZ!O@%_AqVpSMXlO)y&m^(7ke0>9flMsdhQc8@;
z$?^o_3{oqCNTVZ-kOF5VK`8_aS)P+;1|b#A<}^{IO20p(*2pP~0P7T>eH$Y1v{QU!
z*mq18QJP0R+2cejhw+XF1zBboB?AU=ms&I6)ae;I=^dsQYkc?ZD<p2n?fZu$Iehxl
z=dnic%#$y2@9qYN`@6hx<qDm{`^?Wk=kS2hut)c>2RR7qNJbf@P;+W=fqJP%IcoCG
z^#{EE+D+Eh`m|=?{JAAwd!^44PrS+}KJ^@P3p2d@)vvI;w8E!9?fB+5Hu?6qws`uf
zDqr~7kI-y1sMo4odiEkx7+(42H~8AuzeTs3u(olF<<;|a4>QVP2`y`cdY5`-`iGc>
z|8j{EvZx5>L4|;#K)^U+;B&$d1@&n%KOqnjH_lTi*1@=ts4Nh}ag8l0)(SAz$j8Bh
zchnR`Ja{ys;dpfIj&t{5^3QvzO%srDWFn8Nr7?+gh~rcF(e}roH(^mhmxniAC+Qnr
zdhru5ije~1Y(QuKAyeg9re~+gs4%y(%KF_lyPKP=UweljoZ|k~w@K+^T@NiRr<Udz
zG@5k#IS<x*WO;?PwGK1$b8K!uBqZR4r_XU}`3X9E2Mqct$)L+&B4|!kk+#OWx7&0(
zZ945PmoC+5O>1g_q`UW!Y}n(%GtV$Rl@rMh>0p!T`6t-#3<&~_5f)sAAVCO+6J@_w
zSpP6hQQ%}!Qr9_3CgaA9msw~i+Uwh7W{3UueTE6_A3(h<>A8eFZIQ>4L1)Cq`s++J
zrqF7Q=FAVjPChV@n4ezY@Bh8OkJ6frt%q2bF+1DB$&8Jy`~0&n{S!VpH%FG`yzs&$
z=H{olfB!Zg|HMaW&D6Pa<#p;)%QP!3#GIyHog*F?_II{1Ntt+*)85}=W}!;2*Mqzc
z!tr2lomypzPkr+91iH@aSH8=Ivlp0~p5@ZBm-xsFm)Y8R$ba?U{%3??z|!0Tm!7`F
zzws-Mm;dxnA&<QWQ~UZW_wL?fd1Zwx&5%M94`bp{Os!TW3?n3xJohMHp%Bh691Mz5
zmVP3KK}5M+rr#bA>4-QTp_CxYa;z1U%XJ7#NTp~rH~eD95!ei!4|)E{vz%U@N9QBT
zQN&`a%5zViV!BboSg1Ffgyjk<tT2o-bXX?MCEY<A9fZEFxiu&i0D>?KIdk?L7oWUH
zv)RNt%k3MtI5^m0c6Np!)EJxKtR;#fgfO&PEu;<*N>i>@a8mhdPD)ZLl}K|BRusMj
zVxwNC)*s-Mq#Op+s#UDDBql>EjVpc!Va(V!){$j7l}Z(m%*@U4sZV|ylct<nUgR@B
z^BMl(Z~bq4>&mNaZtih^ZHKTd34@S$_~9$tSC{x?G;49a4z{5BNJ$Z4D9U|GP+B65
zAwAe3ABTb+IBPITPM)S@NkX1wn7qgfu-<~Qx$(**_vJ)wZm`y2oCgg)pCRzow6sQP
zMW`eq5Qsn%2AWDB5ool8NI@7#!axyf=>dfjNS8yFPBx!$!rc*9_PsDdOblsv<kWJ`
z8{JO&*Rk&%7dhc&z_=FecuTS35ht17B!zFwgLwS-NHOu~OgO*(hc}9{uH(dLH!1V#
z5V+!|e7QwYP>>+E(t`&#{w)cI5gNldQQPN3_<oIZDa5hJ1Vxn}F##{W?c?5U-~QO<
zv+n3#y(gRk{CI@q*ZzkWNQ}L!P(+BV_0Mx0!TLe`XyKzr!bzWWE*uV3M4v=KJp-x6
z5dwKEc%#P15yl3~_?%<cw8foC>5Z|;Cq>j~0;V5%1Y%Nk%!wi<Af%sbCdXKd(weXo
z5|jdvz5-W4K*0&fO@=iNsWm|qV5Oqh8-dWEwO{)vq|gPR6j+;KF$MZA`ZTWOGzR2j
zpyM35F=QquO%wXVF1`LfozWiK2lrVyGsk{=1A?5xy)ID&=9^`{_Vu?ocV>zG-LLW1
z8~6CRFMI|iM|2Jn|Jx?Xh;BP(*vrUL$h2k99YRI2v~ZegG|kul^a>Bx6SRb9pI+qN
zy)D-6Z*z7<FgG*H@BQ8vnOkUZ{@g|0z5WhZ$#c&(kk1O1mrn8U;X0#1i^jzZ+_`m=
zwYA%<t#8trs`1RnPthA%`rVj~^+OI1M%=%<&A}d|$)n{`KTIM7MX8f<0<-kFV2|Z8
z_`e^mfP{S1;UkL(!f_*i{Mpet@{!}>@$=k~Q|1wB)MKjXsGRJheR=%7INBiI`|q(S
z{CL~rh{w30I8M+4w)XFH?X3YT3-gqt5S-!q>t93V&l3b8Z@%*uAA50?uu|sK>3IYL
z+J^_+ymyQF)3XGTq*<*n7^HN132~x%=jH=Sr7F%^+J^@$&d#zlUqws7>)-x1Pd#yl
zhYxpI-`v6)NxwJXxo4l|=KY7nPBXK(z|8DCF7Hy-0W&KL4C5LLvkh*(^9HYc=Q@A=
z*Z)IKtzKkS)v==FldjPu!;B;yfmAru#Az&~2X)qZ9pFrcOS(L`^A@&Mp|{gzlpioi
z5)SqT^gBZi9}dt`&}_}(j3!MC&c+NzLsm{VNV6Y)Kl#8wqSx+|3{#et=P0d~L0Bvq
zH*Q_$<(I!sAT`si7D{P`g8@JFu@}j+9yf2?;>F9)GCMQPyVus~b^64~h-?s%rItWe
zF|lLN9w3}zd;NgL#aTw3gsq)@=H}|Os`I{Hb|wjlSUt7Gu+wGj-hEb2uQF3_@xs%W
z*grhr)Z8)$JG-1Yz0C5`JeOa%#Mi&}6?S)ax%SRYk~n2FOxWK$;MD1}l*<*gI^w%Z
zC5Z}p&hZ}t(<&(H`3vgxDV~1nX@bC)+zNw;G#%lbpxYZV)taT%tdpiW_Vug8Nk*U~
z+T{q7A+iiR98%GedO4sLY03(+(TGu!(c3>HDmT!j3d8<@)PhqXNot9c3@H@WCVo?t
zzT{h_TqetNy4^0%KJzTU@jv_q|H*&)xBX|85`#g8Exc@6Nmf@^nQFGM#-QVjYSov2
zbwC(KSQ5|wE`IAE3^huE4iuGA=&O<_HBkt5;>9Zfg_1>O8b7A<^GnRnEm13#Sv|E(
zzu)G$OD}Ts&Rqg^8%stOJL;7NaU6fpY5EhBIjy1KVmp%|j6M3%24@OBy!Ag~=D_AD
z{mvn-_;Io<%gC~fJWes0FI{JIPxH}*v7?2Y(3_N$K1mr*)lp$Usa!=Ufz}~92nd1z
z6$B`)k*df|DDn>k4kavFIJ5+<Kr89rPogNc_<f2Z32bb9G4Tma<am1P(GMscK@C?Z
zzxM!%qA_1X+ebdeEsyt%F-P}EWMPE)?}%~qW5Uh#7P!C1F_7>SCF=^%Re*)Dx5pV*
zfVm@zk*76{jeBoo=BP=fChP1GKww-9)So{A2SwV1MHEq@!n5f79a>BA!*#9z6@J<n
z=X|oAJECEYIr{d)hqEW5gz_LtfWzX($=7ZiHG-o$x^OhhJV^5e1Bx1DlT&QLDfZ7j
zQ2sYP#_95Yepzg8i@Y+96(JClx$6pWi8zXy9T`o2HjRrMcrNo85ZYrCw8&$yMPj$}
z<+h_JBr2B(gAh|Bc}o<T%RMl(f*^<xLJ^N*hNFZis-Sg<lmSwjV!jkPP8M{e&_&ev
z(XlG-r1&iYDILaU7?YA_3H^STZf~DB?%_;~B4>SVjdM>f@$Rhy&YxT2<!@{dl`Jc#
zO0-%{OsZL3UF5<22OR9~V)K}4DPrqkm$e5z;@W6Pn$<GSgxtIHkhkBwPp=D61X6)g
z0%I)62ufkV;!>GE`lCN(cON?45nuU}Z9eze^ZfkJeV$u4@9@HNFQS#^`nBu4e&q`H
z?%X8`BYOQF7tWu-A^77zxq}WOPOX#}#yJb~%V<#{lq1qn@S~l)KSmil=8wGk?*$J&
zmMQ&weT?ciX=f7e{Qdy_cwWQN^&hwX-~ae~6R98b`oMd^2Jm?E?|U!rIp?wHhXYK5
z^Jgz}|MpF8-g=Go2O~}`&a%3+N|`P%|H1!Db-GDV3AuTDooY}c$-3-xc97a|>f9{W
zDTJyqN+aHS>l#W2C>c_(m$`7^3<rmYw7Y$td1jH}@Q`*pVP<9;Ctz`Dj?5&SKYxyP
zr^kM0hl7J%hQkEq$|Om~+10b`?5vR_7Go4UJBRG<9#Wfsf=ac5&2yx1WLb*VWt6TV
ztiu>VX2daX8en~8O=~^1Y!JtEckXhqcZeP(+`D#-PXB;mY<c?W7pSdH@$l|lhQl0_
z?SXBux7}uCzJ|>#>-V?+KkD8*$kOXP@B5wQTkd{u?>#;H24FA%NDw5!4O~nuwrSJy
zB3ZT-$&wu>amsNjc9yc^s`!t%DoNRnU8y90*s-mMq)geeB$HZ5Nt8$e1PBoO0GI_c
zn5Da?_q*S3J12jf^WE+l4CxZeA%#=b(>>ka{l2@L@0|B}pXYsE<`=$?jKoZP7MlwK
z88Avm=s;7eRH#?meB|*@(V36=o!|c*PM$c)pr3N>>NSkfy!y&p)GBq3A3w!YzkiW5
z%?QJQP1EPh=`$q#HQw{cV|1RFciC5KICNx@z1?jF!y)6*h)T5vsYGkd1NWUH4kSgE
zbM?{{c5ZJ|tp_}O{vn=x>YH4<_9l-!Jjcyj*9k(!rOTJt+3jMi;q{AGh~g??7!&FW
z^=gAwqt12|Qxt}Jt&aA$XRTIal8i}`A@ynlAp}tn5m#!&afM-TK&REBQEMQzM2aS-
zPoL$`;bUy9-bAPhm#)6X%Hb0{{K%v924jQ_Xf!+g@z1=UO0|LtD(v+}j7BLRed1HJ
zW)=y<I-5IJAhWPHanCi1=}j{BdLz=z7hL*a&Gi`wh$6?5#8FHoj@igl*YP#a+1lPF
ziZxnmq;UN*I<vDV9TEhBY9Sa+CP<|ya^w0&Sl^_~0tliopxvx7JHJ4+TA>!lek1jr
zn7sp0ZVXXe#Q^m>gi(ytiYzybhhu^;!dgkS(%?`2i9gM=-+7VA`0E%HtxlUXvE<qJ
z$V&bp9kt118Ulw}I=}aH!el&VJQ^_>4H-{Hq)AGi<`|QqHJBoI03y#_aAF})imGy-
zSEw~{=)C1atqFsGFbD~QfH(-zI&f|kfkp+P18&lFxD`@)sn4`+smlQ88BSa41USkG
zXPA0d8|RZR{cd(ghRXBa-}@6f2sON}-v{URZe6X<x|hfJt;FpTCBtFw+*6$5$7Sg8
z0lH&Byu4^%V>G4s3v0=(aNVP=B{Oy!>>F!wO=5i^wEvqa19w}t?Q=|n5hZ(2)<Bd@
zgV|>l%Gc|`gt5kflLOxH)*fI*Y)Lv<-yz$25aQXB!h<mL_5$*E(<l<(oJy8XVx`rs
z1u03hl%hyo5aqi#J9fZe3yUnQw}m`l+3M|w%jm=k$c=l?wD66*gd&$YS>`37<(xXe
z29@u%=StkYB&^q_?`KS{XQ+fw{`yS2!j}d30{2-7A*e(V?M|C!vx(N4G|P}u5d<-l
zaRL^?AVf&TaFnpSwZmXM;{5sZj`d9@?iQ97Lyih8LMV#-0Jy>8^nAwG1Lf|1mWD|>
zp)e_7q_O#g^^LdK-rl5951DJ#D6(ZLvEk)sU*d^Rev+5pc$w3un{;NEc;SUNIB~R%
ztW@Z3C){{zl_JeKeCRNNj=22V27}!`^9xl188I0OW;-q3^YBSlZ{FsG7cNt+DD<2&
z9oX$|uy`ooCx7zK^Gm<<Z`t0IG+Kr%f#CqO?r`bSO)g!!!7DFcCe$G&H*9Vubh{&(
zt&HxjWOrx45C6zHKK<!qRBIvEu3aWgHqdA;yu8KIV#wEjd-eM_vHv5F(vZTjW92;e
z>#=aFq-5V1pd<p`9@v*a;=7M~KJFfo{@pbU_dHJAgLA$MSlolOcpG5)uFv(ZzeQn(
zfSB_SzK4q!Hdw#)I)T|D-Cac`aP6h<FmwD2AO6UvdF8p6xp3iS8d1h*CZRJEu&}ty
z^|!X!>x~%<#{`u{W@kIBtzTz$zC~xYLKtTx$u4_)s~9wCYUz)<WZ5=zvvbVMwWzfs
zdgE>0x^atYy~QLkY;Enay1GdvP+Y&h%F*L1)M{<k*VmbuS>RJY`Xd}!S!6uvlja$@
ztzZHRCPJ%-dR>ua&S|YE@@a!ttrcmOAhaY+My##9PQ9ua5Bi)wb%a~1IhQVOv$wIy
z*~e$7*coozSZ8LbL8sAT{nm)_Fs0LJ(5O|NjQS5a-Z7B)$N%UbQ>!(}Qj3xy0_RIz
z3F{nNZqZ(>@v+APUc2xr-R%jraF&(Dh{=8M(s!<qj6x;@OC@fQj1p|5>Fp#`bd#U?
zi$BLh=O3lW3ukXvqzLIYnZgvLX@<3uBD17vN)!qv<D4vY8$ec!Sy*WE;DhHG4N^wq
zgifo;2OoQk^|jkbDLH)P7=P=(`P)n;36(hHum0T65!V|Cp#b3;@+jA3wkWJ)8;XJ?
z8xY3<rC+yF0h44xGD+#QIy~^eIf6igu*88TpA0#1{1oHyh-z~V8H6;NO+-+qwQ!tA
zAO9qIE|FS7+(wuRy0O6fK60Azq~P}E8lCwiNGH^yfTA!|>vha<%%LL*(iKS{r6SLB
zg3wuWE-o#yFh5VVTIJU2Dp{Hl$1z2b5TGbbO08NY&kb5fJo$~M_}0_U^4ZUPmTG-O
zk|tOKlZj(iq9}4sDq3NzrBSbOe(rvvxZ>|<?>#dOHYI76BcvpZLMqjY4;;P5QaBk_
zk)-6gK?;S|icfs<hxpyE{XSQ3Tqjf&P=a)nywhp=0~?dKu49XWEKONoTZJNbZKAAW
zC7hd#r6QD@*D@zdQ?NO)03B+gFd~jC)T&i#wHnnpCJI8rAOzTF2gH8nrVQ1sbbSaw
zV1&VvVT;@cur81`#)7a;UWLn4Dk;zs0^uxIU2vz|;+2{Gh1=tTJ6tsmj1t(oLw!2e
z{Q*bP@4Fz~YfNQP<xXPN9sALpTamd_S6^1v`UVe{eSiJp01z<7l3Ph;t*d?TfqLNs
z|H3%wjAKvO2LdIdV!ceM1Qymgq&VAGF$ESDXMkWRS&s7kH&f72zBMI)u>ScK2LOdB
zO0Z#^btiUOl>KfUN@zbd46cB=@E@OL+Go#8G0Gs{iGcjPmlo;WtM<XI!3gJ2gMjg9
zjFiedD+zMnV6;q#6h-EOe7Rq^TwYUBu2)d9Ttbw#y=Ka$n8Lcw>`MC%_09pRC>+C}
zlq8BO#BofuQYH55X_jTK^LCn(rz4`Mf(#^+B%$9Mkfa6mdV|@yd4Fy%ZBh7UTV*ii
zI=WlqgGu4m8Dm{v7%T)~K$4C~k_oL=ok=ogJeu(E!;g@r6JCDlS>m9=2jBNWe&x&m
zhM)cEzshERgUgqGhfn?RC-~eKzCoH<u3z7x7Pm<!ie#b)Wdlr;D{pMDvD#<YgL<Vx
zB@Efv?h(i?moHx9%-Q2Kn}Q_KeB>jK@XE`tlO!o|)L?meg`fH9pW|15?U#A->06|^
zp<0!E@e9v!=nxz_RA*^niC%xml}l^9=aGjvbM_2RJ^5|oxI(LC`OV*aio=Ijc>Kff
z;mnz{oIZV$@i6D`p^$VUIdbIPmyjxlV~ib$oq|;VdzZ+uQ#MU_nt00N-W907Eoi^v
z=X(Q!djpAs-|w`XJ$Ul{Y6~~swpx|FChq;hr}O(iTx>1K@*JfU=k9-$cGd7)k#O_!
zi*(f<F`C(W!Oq4lu3TE>!E+zNjw0f4#P-$&ik*bcOohvr_E_6WnB;;mg7(}J?b&%I
z;~myF);WFZ5V!T`LyiCdAOJ~3K~!(AG8*;R?HPig!N$fWv$J(FlQ9?%dGY0!5z-J>
z>YO}rhSlm8>$h%@Oj2%dY_YpLrZY3dAW$MiA{q8~dF91txv{!KwZ6oA9{m{7Nb+%x
z&<Y*K1hFPdb8;!jFyzJ}MFBQ<UA@f&VY|%FSJ>$85LH8#7wX)+-lNyuX4p$OygWm9
zcbnr!me}3yF&evuvwM3(=I0g|jds50`+TqQj)BC<(<j-uz0Ek8U@fFY%5bj_LQ!or
z+1lt+kLQ?aFLP+=7|%TO6uMsJ)1P>Nz0EJu-%0tiKlT$`xbO=1-+v!lw>Mc?In1-)
zex7H(^&AVchu!9BoDHha`AmKIwT_76h-wfZMNYNaBG5J8k<+4dnE_RIyv)7s4(-`l
zR*oFwBOm<~SvEo%0|L^bzye8{Iaxtk_~KNzAvBu}wzhAR=M#T!w|RBi9T${j1rMG(
zj}8=36u3>kD2O8Gk)P)lp%s(K1ZxZGwF*D=pFWB;&e}6)j1dKA&p(bST-V+t9TJ5a
zlMXRihENJq7}COGq$UVrtj*C{P316ib8|fL(I+rChn<CmMgHBJ*GQ5Hv$Gx6Z{I>|
z!6eIwqYC5kh^^f&U-|9d<+GppGawaFTyq&{Yss^m!W2Y7h%uHxE5ab45{8~8cfqCr
ztaUCbI$-Lh4p0<M8}FJp0X9RTP+EG5&XA-Di;GJ%nr*aRM=3?W+k1Ok_;<lbx;x})
zhBY~})ewvVQ(%i6pGpQm;^ay}pqQOsLTHPY$}<g4jue!=6@+ILtk2?>k!NA18C39}
zhYrvc*X`Ch6G?A#x*sT8xt}q07PI?zOKHU_jSH-#5w2%~51zdi2d31ulT=LIg{Hxl
zx774MW93wqQ_6JY+qO0rEMoDlB3{#5{;>olQ=;Pl<Kds5u<pA4Euq|q3Ll(X_N7X>
zk=|*^J1+tGRAS^FUrL!^zfc;4KbL0^jAsoffrq<v3EW)Gg_lZkfc@}ag>`_-V5Uw@
zg=ZX!0te*%aam!eQuuc<j_}r6`wW1~?%OG=6b8PK*c5I~c!{JCZo-yq(LqbglGTzv
zuaOrMLKS*TMoW=9t7<7VDhM2NWyF5^vkZ)IKe{>N9LyXYw%=q6T<}z{*Y;T@W3XOE
zWW8;0rBb0@uhVEWh@u!vL6)UhYn-#4fg;O6=NKeuno$%5ffh8HP3rZ!JD+q;Z+P>8
z{c>vI_Yt*!E7+1MGYFyC-q@vDuW;<>S#Gc2WHQc~?JRQZ`c1B0eUn-}MyrTRZ(ifn
z=?D1Q?>@=Z)vNsRAN>rw{Si-m^nHB&8{c8JeH39TtdBBk!6Ku<kXK*2iAf7qmX~QY
z3)kIS1ym}Ex8B;o7(u;$8?CBz_fobtdtARh<Y#{Rv%K`u1^&yw{y+24kKPX=;HQ4-
z31kQ-k00mPzx?ZrMiV~rk&iGtGeef9Y;Js$>o>bBEDpK71!0g9hJwZALm(^s^MCeh
z{E0vH5QmSfaN)uw(30KmghuP#+mH_98dx55dUi|S0ajqj)Y=1cb3e&c4sq9lArGYe
z%j3%A#CKyNoQqPyL7k~6=jOp<t*>_z2NGRxM-oikFzy;<6lblO8X?^I_d8Ff0zp<3
z3`UZb!|!M9+71_<xk`6(n<EQV&YWIkq-Xg0i(hAF?IwTYKl|%kzWhAjes-JH)vH{+
zehXyatn5|5Xfoo-XP#wwvCeR?Lz)=cts3{;e}>7VpuVdZPjYT=?y$buB`XSyEkG#R
z?Ir@l%dfnO$)r>5)GC-FrxHg@CK+2hw>Wfo8Lbu9F2Bxb{0cX&Z&0bta(rc(*|{SK
zVyq3xO-hm(!Z4;91{B(oYC)DI1lk~#z+_{zEZFPaM#}^(1v8x*?Pg3?<lMY<i)1h&
ziZl}C5@7=N`V#^jFkIbZX|a0G&*FQHcMK#Z>4d@;b_uDtd2^jF{Oe!feUClLk;6xD
zeFOyepM8K=FTBX9Q>U=jvbnj%!w)~g+Uh!g^S}BV{Kjv5iLd_FSDER|poAhz66R*+
zICA6!HZQQ!U@2UcI%Rj>eLBC$bF3_o1V}=kNz5p+1dDaqenO-wkP0T*7_9@^9j61!
z@&aX@bVK-H%QezcSnW4&q;D?|^Rx4=@fA?o21=!-MU-XXkW>P#%eM9|Ln#AD(-dPQ
zlku1!2+8scL4dIZLJ5}{%~Pzgq}pH$Lz<2}D1pFAMw0}kBl5x!Mv8uKKom!WVMvmt
zK1gxdv%(m*ceW|=0<8m@%_hTfpV6pKQ4|aYBL;&3^=ge)$Ju^a4+@MaFu6hb-Vl)v
zyu*p0TCF05b+Q8=C}vr~i?3W@dwZL6=gzTw=n%Qr|0<=tY{O^x%I8Q)w>mn%*X?q9
z{WjJbhW#$}T7^!h@lL1d4{YoWcf5_BMGL11)>;s#fH163DI2hb5s}t}T2PA=N;#>9
z%WCd7b2DWzwf{^?`dJF$?OuJ@Bftttfgwu<ZWEDC%29#|iJX=KBV1Qpx8XQDKw%9c
zH!eGDUFTmRLX?bMme@zI<-8Ws0SO`T8F}MZ|7k}Hzqh%2$q0)v(j^B<pz&RXFJmra
zLja^NTrM$;@$bR(2=|bwG^td1l!erH%8yDJQOPX0*OVK`_hZF<AYsc8vjhnx5MT;0
zTrlabW!MK6)=r<A`<pocFsAp0?`dJZjH(0@{`*w^<PWm;Kb)!i!#qlxTw#2o0XyyK
z;c!)H2<+yeHST8G2cNzYMKEOu%7$G=0Jb2g1ZW9DI?(RE7g!8=o+Cwo&>F$Mfq?rw
zoYr4RrcOANOo&k4!OY7{6y%vD%QEMnr||t&Lc%blQi-WlDpV>Jq?Ba2rL-XiOBiX4
zQjEtVvMfgkMYCQbj4LP=P!tZBI8fk{073`~>Ff4{r0^EX{?$`TtBjEtTQE1bK%Qs3
zdFd*ZYDlBrVKf}jYR>Zb2M>{EeMX}l9yxi07hipW+4;k~@1q}OYp=_9UVMsYo_m?c
z-uH2aT}i##<op94;^M29*j~RvC}!Ck?lKWM)mn?ay={hrgt*dXC+#ycTjBQlE>Wy#
zG~k67UZ+}xfAUX$nPW#|{@&mFYkdCmU*MHjyR6>6Nv#oadu@X}FSvGXmoR(@YZ6+`
z79aZXNxu1wOI*G*<cW`+=H-`e^5&ak=4RK}>l#j-4te9^C7P`oyS-g%^%xmW*xh^g
zG27+1mmEoW<lv{JZ%}$SBX9sf_@C9=)?0VOm5hcx@UZ`oqzQ57|L-lO+Giy0%{&}j
z-48sc@?Tqm`g^<wcfVelk{1OzRVG=;RySg&8`9ez(5Oi|oht1bEOs)4xyHA@^F>~J
z{bg#6ka3o=+-b6CBDM!N8TQ76p(YG08=E_XLBNR<hq2VSc5Rn>eHLRPl4M96HQ3nN
zU}h$wTCGv9#l)2=JKH;q#$9T0h5p`vO=)@GBd6%h)Y;kTF~6`#GD(nuVrSzfd1g4a
zJj?OpC+Tfof^<M*<`9L5=nhh>sIjoP=n^P-LL9kRQU#JQkZf(ParxCNh~aJ4uddU4
z@P5)shSG*n0)`p-!;syrE_=PJSYg@N$SCZPxlWVe$jJu(pyM3_iM>G&p<SU|W^;rR
zeDq^a&}!FMI<!QQ=G1C2QAIPqILouoUB(*2#>OVghZa#<^11)_U+`l;_GA3|mwuJY
zmp3?a_!wJTTOKqx3p|t$BrITE5nb6xNJ^Kzvqg>(5<vl0Qku?7=>n`gFNgx1t~f8q
z3q!T;g3~~UuHe~NMA?Z~INyGJrm@ug_xpV+l@O)nfz8_o6}}MCT9CpZWw{Z$3~XT_
z%Tm7ijc@X6U;6j#Zm)Cf@Cqv{CpdNb0S+Br=G?inh@v3U0oE#V16C^U9F?Mjm^3dC
zDnjUxP--?dxB1s!_&nzxxSx-I{1f#0ed>)m2*Kv|7D5PGtv2V*oukNeR##U^vx%>l
zDA?_GU4Vk+^^0$?Js!AhxYCS9DOavsX4va<>eLCE^#-{yY;3I4>+Ycf7a+T=x1v^W
zx#o4AUMv$GPLnLW%-t<4j%D!uSABq$Bnj0@g(sePf`9o7KTjA)@&ekmcV8cgOE<0&
zDCf!)`7X_&R>WaIwGz{)RjDhB3ALMd!ZI372!wG!R%xV?&H~n-Qwr}MQ#Nw*n}?M0
zKqggyl;p;cXF1MYrd)!JyFYvy+hTn`2*8RvYGAOQJ@Vf6PVFJxXKh>nTdH46d6o3p
z`n>Sx@b{1P0b<D{?2`myKjjbmOhftbDa70#*3Ti!fhgY!4AMpC9#E8QM9GlgnVF(6
zPA-ISohQrzS<<vvT2gq%Vj9%qotVV_H39OnQC)eNQu1`5_QA0Kew9o^DPeK|1`klI
ze~se6F(v4+cYqe>|8J-7=eu=eCiBilK7f(RfA>tLcaJF>_hA)9p&VOe3WT(1UCwC_
z)O>c+HAXZ@Danf*3Re%IwLoh{Q4|zKhLoW*k+9bHa{wz0#=3n*1&S~XJxfx`=-fOj
z-BX6cAqdxeu~Lbt)hg6#HEQ)Ll}hZ{2TPhepivZ#aVTG#3MGM-B<{vT2O-sJl^}}9
zbH`rnH@&m_`;T#j-EQ7Vu!Rrk{GB5NN=cLm7z~COQ!q0#i;$MlXh^-@VRmtzjaxT)
z>E%~Bb7lo&6`R{#*4MT<`{2X;@Biq3<Inx%Pjl?p2iV*gG1F+XajVbjmD{W=p5ySs
zgFO56)AV-tC``g=xJMX;80+kAS5}s&R5hbfz-T;VG|tHj7gU};U1MWoz(4(`{|sw$
zp7{82UViNcTYD3>w!17X&CqBET)%al(Ew_dP2T^3$N0-XcOO6h^S{cIPhY0hfX=L7
zk`;_o3(C@H)v4C1oH=_69aLy_Zu893Z+?F!_5Tk;-d(WFT>(9%)6!k*<@E7oU@m+o
z`0sVC{gD0c9u9X{y^4JcW%nzWD7xc0;sFnWw>vYH<Lzw3J!Mk&7<V6Iq(KHw&YO@^
zX}1vdIziH6ZKuclLKRW;xc}%JgJh5Azw;%6utvXE$C!xMFRrt+bckA`!ftPiR-?oF
z9($A^faT>SKK-d5;+dzu!@v4hpJz1MCXDN(S%Q+5YPCtVI)f0F&CMakI(g#U+$={A
z&-2=a2}O|+hMJArJFFaDqS<Qm=C$iQ_TV{2qdmIaJ+fq%njW*eevxe4BM1x`5rPWM
z_AEu7PzZxD6RgolnIRE`fglWEYi-O*tAUxUvVOBmb0(%Y8Y1*E>+2b{C}7Z))HBKA
zp;>0;Ys@Y-+1k8~$tB_B`^ZRa?d>o>cZhU6AqoYdO1Zsug?8&4M~@!H6qa-{CeKC$
zqM%t3T)A?EC!c(Va}PYqOlN^F{rg|#xo4ikW(l!`{?;a^j~wCB8y5hlQPzQ)`h1s~
zReW%6aa3O+%6;7+g!fIc7AGKelhS3@0V~KSISSv@MJWF`rW?PHj@%W511<<d5cmvn
zao|QMH#kvRotkMNp_HTS3Lv%c&8MH{|M)-uFRov`%3!d=#deeBxh2MXUtoD@jz99F
zpW@H_<WCUR+hj$7%>_t{m9EpP2%J@*#5JV~11DSh%Rl?G^txTLET=O&1J-E;=jRr{
z)0#_5i|p?00fy7}out>@Ws*+NQ9zLw2q}2=l~=gEw$6PgPcxc~iJ}Vk-*-QGnxVA|
z5_J%8=+I$S4lTLO*0|s;H3rZ;_E^VfDkR1_y3<ZA6-x<%MG1)#hN*+Kaot>x9y`YS
z9(^DG^5_2*VGuAJ4(ZHv-sv>`fsNO$UUzNHq@Y==dv_TKv?SC4Q5aGQL&7L>07F4D
z3<xo3r3r$-N#eqoIF5;;h#+t_u2B$7*<b-sls0(Q69E>aL<JR?HmxdiI$|1(l>HcT
zZ)0pd_;x4NzK+E^)}Wlr5r7Y<O}QZm;X1DiFAFL$!@*2D2mi4koKw^t+m2wLo$$re
zr94O+IHr6K(^KNQP+K%5nm2w<l^Ngi(iyI~oN;fPuVwJPAz<Ii)%TOY1CpWyCuI=l
z0Y)}mnaZme|5!799?t%ieIQ|cp|;p(DeUy;eGpV&C^*nn+q$2zfGS<VOsSH4R}L%o
z4M@rk-OlOFz5hyUm;G19J1Dte$r!h;nj$AL&MW}WbV__i2ba{z^VB(~SxXcsL>v)n
z?bdvxXD(b_g}c6Q4ri^G=o#00#T1yrI_ZLSES?fhHdw3I34(}fwMw;8C5i*jD&lG~
zaNpA;b)W`UHz9<eC<@XfCDfW~HKtmv`q!9~O)TiZ0htm!c*@24@1;{`Isc^CZ=B+S
zHwTESwHRY^_PX0dQNYTHV{ERj@elu(f57(kCZG7^hq-#~Ez)8Ui{vN&!hgd5`j7r0
zf92=?bH4fH^Tf3|=4MWDdt-=}Z7_mYUb@E7!$*1S(NEH>F7WL0-$DnPR=dvL-WHQ2
z1(DM#8eG58C9c4D3~34{P6#%)1`J2Au#mI619_1UR}D!9{Q*qg+F^b!q}y|W=w8?G
z_y4EQ@#!CWh<2yV%g?Vf8AH;y#0|@-)6O~Z_WBlYTzrjMwMiI7bUJn3h54xI5O4dT
z47Lwgu$D=na>cw$o>WSU?heoI*%AAIwd=v}cmB=+`0v$dZhF1%2@LMddfcn-?%*hm
z84jj&b7N6jk>v@fjC1cf$*o)GkdryS^|fE&jmy`mMRn@6n8m|QmX_yGL7iuwxyIg>
z!dOiuhWUjRI-NP*^T>Jr=pX+fjvQG*%78C@`Kx^K-~JX-&!WSEok7nT)+mA2752I*
zn>(A-qB?n=l1vI_XC##<;Jpu@<@&X^*xKHp(`hpp^x5n75TZbl69<CragRZ_%L~u$
z(QM6g?2P2~S9X|NI!4%71aTOp3JQ~wj)#~+a^w1CmJcn_ZZGoQM<3zkuO27qzKSGZ
zJQ9SpfFQ2%=GAR#m07lmoOZ26uh*y67PMwN496pOdpXArFR<8I_%5H*cOUN<NSMN4
z(P$-Lvcr5e<>QZ@q1x_{j(YUR1;74lU*^HHXK7R-R6eF%wVYU<VWBm{fBU!oNB+*=
z-Q?+S{vLD97AIC#NYjGKd<RXzc-Tc(8jb=+BShhg>YSyhmJt|@rND>`RPO%{Sc_7D
zH?8oEcM1q(fEG@F9{3{VQUZk3$Z|8Ef(k=n3TL?|1lAfLL>2&LrqStkg@D{-U@cO|
z2qeagK<4NmAW7iYe&frmuHB*@YwFcSG9ifseBwjzrMtP#SHAc;#=|au?Qi~VtPrRu
z!12`uVd!*wLY82sKv+YdBC54I^?Jh>DY|aPVH8jMUkG8z^PCeWj<d13&f3~KQVZ&>
z7JGZUq<KO%Ntp?&*sMT+>*_5PMPWg?fXhlfy<;s3ghohbpQ$tyh4G%~K0_^BQ#*Bl
z!uR<_5QPIo)>4?l2awKPXm)O%6UR<4p7e>Lm_dK|PN(S)Y{;;Uk`gHdW2=x>IN4AJ
zA`^&-MUo;#h67fXiq<GmxX#y7A{D;q-xXvFD+t1XPOFJh3auq!7!pS@aTGZkHjL3q
z5e0%uq)`ZzQvP_ybRZSlGjA?CT1*$@0t>=1MF-5C$cv0TPaSCRHoj9fPWWbP!Uw*-
zKB6pME{livb+S%QsBG>eDpF0^4kHAG5mOmYUijJp>7I|!OoMidD`2)pfenDb%Y_`k
zy?f)a!jKqe#ac?Q4AR$)6z*|8<1f%i>$+N(&5;UIG8Vo;oPf;aQ?N8;S4!CtrK6f4
zwZ6dH>#<7N)qY29_x=<`F=aCf-$c+D<L?pcfjd}}O&JRFE=CeUmAY>qH2A>CdKN9u
z%{~+3nJrh3mXl@~Nj4$NU9%?Fuff}33hQemT%Dc35J-tBTrEtdyrvkJD6)lPucdVE
zbW&KPcF&_Q1zD1M7+&^%(FB1e&;d$?%+4(!w6|FHHrRQVyZ$eEP7rzH4&f3*vb4l5
zJ^nrW7lsi^1?0IQ%iU|$LJ$PO6p&cq)^#KH88|QqWw0Xk5<Cxvih{Dw5V=8V!OVP(
z!JyACe(s-h@!~}uc;J3M_VEv}x_+He+UMqT*BECB-+Jn4{_LOmag2=k@jrKtfBVZ{
zVP|_tyEacI1Fm#8==W1LH~NfwIrrc9Fi|yRIN78y6W)635<0LnTTbGY6>w+<#uGSx
zVvgP2Z9e#+Q?y%iWNE^&V<)(F;~IyKcU<RhYe|!Y!-tPh6qa_g#b`L@=8ZKrZm$x>
z5kLJ`KZsVEna(VoPMe!IuW{z=QEuG2NWETRVSb5frNJc0xc|ZXzOQrpKjx51`#sb#
zW(PsUbciXX?EdR=q_~)A|FApi3M{_R#(|I0SYY1(zhs;D*<}|EKxv)4Z!~*n#e!2_
zeRsa}05rJ+40zt;ZQRP;T|j)ka+=VR79!zX5(_j%K1MR)?CB2U?Oon`?l^Xw^2!@)
zgw22<Ig{~#PN#rEQL6}!pFGP04?Rky7W2@#Q?%MGZr!-WFaNuL$?yK&lf1Qhlk*RL
zgrldAV?;=QkTC4;ve&)MBpI;Y9}?A%u)K1Fw=TX8c0zA^%!SbnjvSle#OcFC5k!$f
z3%GdkGH1@LaOL86hyq2U8WO4slhK4C?@<p5M!h|fJw>b}yIWUiw%f!iM<gRg{Slit
zE^zkv99y?<VXflOp&7pR{B<go7C-W*KFiL|CPv3>u3ck$XN`rKc}9~7QB`y4t##r!
zpwS4(GkE6di>xf&{;r?dcN^~*NF;*+l@&<R0xe<O@AC3<-{$<IA7bV3N%oQvYd3Fk
zWPYBRdWTRdI*lgjaD>P*nzbtLea~b3&Tsw(H6761+hH^uQ%_P(oW74<cZZhNXjx%;
zb9nu#oBYNts8*ni!WPogcO@Ek)6V8@!`7iDr9gy=_WTTqN!>;ztaHB*&ePl&iI&PY
zcvA=z80DN&GK<s}8@P0&%PxZFMleG9TS>a&W1&Dg4e-`rhc_<0L9e&NI3Lrf*J;$7
zv@|??`UIyx{RD5Wukz;BuIpYY1bN}XQ`sTQ-#qwi@IeoBYaLTzO+g?P*7%Ln<VdM#
zG#Whq_~U&37e7a}ULnmgA{o-}4^WXpAgESc_B%K3yiPytgCC@$;HN8+Psw`CeKBQ(
z9K|YRsW;va+DcZ!7|%>h0|<!}l5sL2_d)G=G(u`8DTqsFsCUsYB6Q4|kS<{LK%lH^
z5cv1WzbCnHx_TkBE2=Y2_wT-(#7PK&NMLt;7a=4{3zU|Q!SG-~X$RaQC8&lPg_%0m
zxB$o3LpV(uS}UR`rUdASl8*KPp3gcdX$iELewI+u*{)ct1R`M+6NQnxH_A+vRMY1m
zgg{G+vdRMqC%3XFjCC?BcS(sg7ODKX1t45DxWEPdF38R?g$0|s7~VI7D_wx5wIG0@
zAjz{SFxjWi4OZgpMXdlU$r7-}CoVidC>uBl>F!Tw6I*!TRPsD7qm6V6gs{eg6*-kP
zl^f^O>h-|9afR{z8Q&{`=NXxUK*aFfH|sy_Lk2!PC}nT{yRpvla%Z>8BuQO?wNwZs
zd0sG162{{RNtRHU+{t&O@?C$O5Y2S~h9FQxp+*Lpq>yC8f{`rTJ)=Wsqbl4vw2*$T
zId)D-iO4fd?(U;NYv;UFt@^JzI*71Fl3C9>r0M?JECq2T_ACU1VMtkrQCfORAyL-N
zmBJJ*c_S5J7=YA(+^>=F_g^s$C_QKu7AsN;azE#sG%Gi*No8Ri-<FOhY+l)5ZEcmD
zf=55_08&ZTHr~X@934td96H5IufB{91Ag!8-{4n%^(l@YKgwVEEB`ewzIct7UbsrA
zTP!aeCYDvYdtG)nHqol!k%!MyZ!50fxWd}{HQJpjKmO<cG`;>7f9y|An44`d8V}Hc
zrBbO<6a`AUBKRPPx$nWF^u}H4jVj3`MJdJ3&MvV}kVv68d*%pX7`R5MNd^|;N`*ja
z4zIN7kM?-zp$F;qc2HU}n)KP++~(BDGvD|5{U2*c=^fxa6ITB2&T)`|@avVlb9E_K
z!s(c<-JV7Dk9DBj9Ux#jXQvFWb%0w;k8srL-AmRK5FGs5G@Lsin=0q>f#2V89^qt)
z!jwyeo$gh#ypjY}2=d{WKr14du)g&sH!r=&?&?K!p3rPmK?+{DxXR+jJja*kdHIE_
zJo@Nap7_`a&OiD=p7_*f_|9{$@teQ?n|$kA&+^8_s|?0DR)o~z6Le;e(@){}sUtjc
z=rG;gZ8mS;B+qlUheO7xp&G@++XGa$LN^<;J5IU2^Cq+N5rPSeb1gcJ2IGlfZ_g4a
z&GzOltyYz0vrbNm%rf4(c8OZ8%}h;j;iV_pv#-!<H8{C4LmU(gy1P`eF?*}8adoxJ
ztFK(7*uBm}@4b(|_)~v@Kk~yr%I2+gzVhYYLKI)&(#31kV$F6xXLGktrCQ_Ikz>rZ
zn_PMGB9q#HV<*0kjKuQ7BI#s=5EdmB<55PWD?~Cx8AYHfoIG)cX0r`8U}^CLQmpXW
zi#M2S&m)l7LSn3<QLD4GIM0#gC9b}8i$E1*$$&g<5Qb_x`CaEyuL(r}8P>Wk!NN}`
zS6|_>uu@7g>$>|2?KRRAjFKTj`3+netjXO5Z7pfyijtL=HE7{70S0#+q$O8wlX3{X
z)LuB+UHO~O-DnbU(yUvzZm_j>6Pb_c#ERus%uJ)keT#Fn6;!QZzFwzw=rBc=qLe20
z_MEOTumH@oSX7}<7>xH5)=DF#^t#{Nw@fb(60FT>H0nI|*kk<j|L32f14X4)VS9U<
zMzc;BhYSWodc8fy<338dB}ZCUFk1RnW8c0~l*ONJ19Y36D*df3h{A<(##$Fl`bCep
zA4UKGAOJ~3K~%uSQ%+nXe6U@KD~yH{hQpBy!mS~WqiH7Y-8Ae}M&y84xfm-S=9KcU
z{eZU2EFXNFMEPcG_CS_KD?McoirkRpDHD${OSh#!LM4#S*46vl3n>mX>e}CIq|`V~
zwe(q8SG-y3zg;Fc$J$~a$cz1qk+Wz8e6u&V3CQV&AU(*DQX!PPM;euoN))(;ctSZw
zPzLU~NXMF3;d;dgzlnO=1((^i#xoZla1;s3<Ou7|Z^|9Vx}xzib02Bt*ALHWc=p2S
z;SEJ$uvTL80OO@qCCg$E80oiRztP!pF58mDblG8-PAF?9%HKO6Qc4c?hkH}^AI}{>
z<LAyk2-%m6d3xquJHjv|%QD9<OcIhLB~3H3+!aDEEw50i*60t03`Qe*dp+{3px$cI
znVF?tucO0=n>TN9>((tMqcOEwh1r=l)mjxT1)XNgF}T8_B(6>_&&aGqg%x(Yd(>ME
z0u?YCkEm87w9*U)U8IDWnHDqE8NyIg3F9g22NF}jWa7Fy7cgbQN}%BG149&rcQ8s)
zy4nRPB@%%WU`;`mX452=3^Y<`(ljT}4M7+%@wFBzaMG-z$WT%d#sNkZSTmyE?Xt7C
z!)Q1pFLJUhVKf>r9QH}l3C89GT2rl6Ns3)YgCTjEBa~z~NwM0pv%AgV;wUSJR;W}A
zzwsL{QmuS}`_Dec*^{TpvXDHnL|U=5ILqGd7PE78(tJd}U$D41L#w^O&6~GK(;ml<
zFZ0%oi%6X_ztBKP2Z2YU1Y}MehGbcv-Mtaxbj)PpQz%jb8Cg1^P>N7TBuT<(R1n88
zN;q&)<bB+pBap&1@Qi{0TV!A?twx=G_YZDs`G;vtYZDGgk=}mHoyW?z9k*ZneD`^$
ze1JW8p8c=s8EhHsA6%dIAAiTW?*a|wWrTmww7}bz_O;x3v4cY@SK@c@qGDPe?$$^n
zSzCLHG`Ypm<qEs2uaoTc80}?fk&_kMEG^Fw)K)mWyh1I~{Ll}7oIm!XpCl;~Zr$GC
z@BW?tp0EAxx7oNoB1<i`dWW;84ii_~+}_?H4kI?VcX<BWPt!YfgF{OToH?<AP!XwB
z^v4;Sd)w5SAE4LUq1zqM@9!}l?hw`^^5Kx1t7C?Z8rN@VuHGDQXsJyYwAkwBEH1^4
zksl_kZe63*Y|@`3JoT;T5voJGQOBNKBA@IMYRIkN&1A&f@(CteS9sz>@8Pqb`4N^6
zEwa6SiAo&tna_Tl_kZ94KL5Ed@;hJs23i+Xbx5O9VX)hy7Aj62U!hgcX*Rxh4b8pA
zI|dTX_AG-madHHsY0aPDy^X`PXBS9K$SBR(?x!4;RaC8w4R%=HSYuo?8KwcoMpPSf
zC|#j2mYGhAD1drZQ>$qDdt0>Hv#7{r)P)q@!`mTe<MZVEnQole)_NN}4^@qIR&=p&
z@+4&i<Kd8YqlN^uwOErQuoNa`FzivUwNOFiidFF)fB`Ktq;Q!~fk1dy6(u#A0|A;S
z5LTc8YXnLNjxQWyHm)!Z75~Lw`f*}w$cJNAnjKog@a?aEjmw*xEI#xIANXT`f-Esq
z!T>`Cls@<+?O%GV7g&>`gp*}$ZEmo>zJ?AoN(quAL2Jd_+yaeelZVbf$bI*n<<-|N
z5LY9@Fd&RVCh3GYj!4EsUVq~P=kGsHTI4?XR7fkm>x_NdGBnj)+Hz4SGbR>O<Ogiz
zm;w=FGs+s4QchMFLz<)*lQZb|NRkQlM$BX~L8*5<O@H8{1X03g9RVM-@5{f+g<2x_
ze=eI2l}toArG+aL1)taUndyBG{r${%QTTw?OCk2FqwxtO?*wEf4rJiLhH&hj@IV47
z$cmgSPnm8O!e^qUlfgal(zU4s_9cLk!UqLj$`WWr;28=jHA)5OAVdcdK@g#W5FsUT
zTtNp8I9cgsSHfjrDSNqEgER%g6evFjOJNZhFs`{D#*i0wzomsJ<8bc^;`@78a1s=Y
zcMI|$#=1gnS9Dt{nEYo@2L98c2miVI3r)9NYu^SEN)WMs$lHHDc>bw`V0yiGFOo=;
z1PdrBeYRe@_uZtV#xNWVIDYaJ=N^0z3yel%)>hZJbonwjufIhQR!K9<a5N^%AP8&Z
zxnOl|7n5%QAdID2jhLUCWoc=VR%;fmHGz`oP&2oDlr$T&y|YPNZBVJlRAWuM(?DrK
zqh572PRdC>OWVXEcd|eONFCsu3e_~olHLwe2tgdj2;q8Ilt4oW$9m<aAkCf3uTrfM
z1QA7HNs<Cnq$m{-Rb#AyI1UKHkSLDH^OXLe$7nQWm?muOTwz>v8IOnb{Td1dS)S7G
z_Xt8oy<R2D3|Tf}yW0g^EuRiF)=Ea>A-mm>+!nm@+698B&QJWrPcT3K9AEhSZ}Hwo
z*7)FKALF^_US)1}f%6ZZr@Obq{6Y;K7F@n^nMONid3lyNvM4>|%A1#{)S%I*kfcM>
z+%?C`^2GNkvQwreO;eifhLaWhT9PQxDCug<gh&a40;3IDW(ZMuXT!posaS*13MnJ3
zF%((hEIIRne)8^<$d;pYDJ$~^_Y(h<mcTAS<bQQ{W}mxA3hoiN`xxus-}cY5pSdW3
z#6i$;_qZF7l+WSr-<8|a_o|~1>W;|cKmx_ZMiyMnCkf9y`RnYg#BANT&i1WsHrIBj
zwL<0(HCSj?_~g0A`P3&qO|8~qub=Y!-+YeG{o*h4#v9id7a37lr&(X7zSO2tZDUo$
zvEygi*?WO>oHN(%@U^c$&+8YSBMNGSDrR|cg_Fll(V1&=c)m$(WsY1PX0M+x=uJqv
z1M<O`JW1Hu+9s~m8DwoXc6ZsiF(MEXI;{$~djkTU(x^)&lZ0`Rv9<RmX(m}|)!A9Q
z#imX;y3}Db++#eM5DQCI3HYNQe=nc-#K&p3tK43{PEjNjm6*|RL|oJS<X`%eJowNl
zp8xh6eDn97B?tsN8*ALUd68y4WM;O3;t#%`yyFP1pTVu&T`pdHozQBkBEsg-efcIS
zlHM3Lc2d6a{Oed-Pzgg?%_T-^30qrcYiLlFHXnZChgrMyJndEsNkXF*Q;ijCYd29*
zl}fdWDGWk7=b|7C(V=p(AL;b1(iYxnAiyQBL!?qfaZHvaOePb89ZjAV48~)MK}v6H
zn;X|Ik&cI8a`G&J(9loDm_jhqo~73t&}lW1!jPsD!cd{4Cd&$>a@4aHE;AMC03luH
zL8pyZ1ll#I5-OruX>z#LW^MI4?aa{IUgP-jW7G_oWI!#_R4XA5J@g>OWQ5cetZ-R0
ztaBSFz2=J|MahsXPp1;1JTK^WclhEj{URG18$?k6Sb{+FGe7gQ%+1Xa#}$Gg;K<R#
zv^y=re#l_hV|RDQy%sdT@C*L}M8Tjx;(-Sq<grKJPg3O5Omyj7;w%o!fVOlIk`!6S
z>gFwG+B2ki!WX{q1vWP~k;-Kb=H_SUbUMUgL=c5w1uH8noO|#*Ns^Oh6DqX`r6o}q
zc-O7$olesq*tlo0m=9S?Ks=So2=;?*;VENT2J>asa({Eka`$;m-I5O2P&!`1LC#V`
zZ9OpXD>Y^E$og~o9*hSvMq=7=y0rL11qcz`nRJ@65(Z~lP;T}I9Fxk7JtYWr^%Q%9
zgfz{3u;uO-sU4UIbchZ@q?A;uRf5o6S89pY5~U?l`PvWZ7zk;tUjPM^phbXhM~pB|
zA~@)GoqSG9FS(Kk-z{1AdK8PqqzYlBZ_HYFz_!o89W1aeos=jE#3@kNXC&b5EW_Qu
z`))R_cRX%-%)J1~yKiKZ)HPcYiXaF)d*)<#uC{E<Gf#hudcDqr51r@CnX}w??i?Tf
z#K*aQ<xMVJxXjMpm|(ZZXfz_vGe#q4X>BdUQB1Q@r#~FAwfhzq-ncrgKMAxV2sO)x
z<_QAH((*i~&Yoqa(?F0CXvnfLMV=Cd8e0_Pd4VYkgmHk!B?1&W2;KY^Ub^U;SO`B$
z@}em5J5o98SOgd&Ah(2ZOrYJ~G9HYuR(M<50D~qkpx+zP9}Qd+)+izfHN(+>?X4}g
zd+X%vV%5mAYx#6-FhYQm<kpbnsgw8>DWmZaYYjo5P?=-TYpoVHZmv>qw&--`xcue~
zBsCs+=s^xG+($Zr&CPYroH|Cg+v9~7o}$r=ks@PhX^xX8SGfAtH7*bLXtt`1#tE;#
zeuEEw=n=-_jNV`u9asvJIEGUeSd){aiSG}kQOb~}2}zP*j3Lq?G6*P;6uDtC8B-WT
zs6#>>y1AkhI#g&KgOH39*PYiTEd)qKAnsP#zk5cRJP_p~<A3Y9O#i>TmuK-dM&j;c
z%H!@FmV?X6cMa~RK%h)y-D549N|xTvUX+i81FljBE_Lv_R<JLXonE}G-LP0w)`O1e
zv_m2(`R4EZ9t-sdVFXbn<k1g(h{rzsIL+1!)u_QMSFZ3YzxEY=`>W5<8%eZkG1I=E
z`Ff2&yF}<@lC#_ElQSd;wlPHjM$oR;Sek9J+1n<r#MnX;$4xH1e1%#VvfJNcW_}J`
zsdD7x60<XHYI8@CEy-}$BORt3I&qZF(IwWqT}J&8quw4ftr|(P$F(;vklyGK$b!9Y
zM6DJv+gM^}bC)QpuyK1AlO{Ck0k?1OFh93Ir(WUM$s^pn_9h$a5m6wK0gS_dIF8ua
z*`ePbaQxUIP98Z<vlj8(x1XceGXyI1ijjczwb8vl@9#0*F_75p_W1Hwe+!{C58d}(
zR#$uU_eN~&Y||f&h=L03PK%q{n@lDtMWG0TA&o=l*()@E{~!O~RJ7&c_kDz7v`r92
zv?>wv^Ygs^<|Y2km%hsE@)5Fek0Q^}IwH50Ns=<RFpmxcbQrL=w?!085Z0oD25Bmg
zs?PfDZCdRa8tp23JG(4(mg#qgSRt8dw|U{2@9;nT?f;I&nKt9mkbZBMXf9$*PLV;S
zQbh|%9BPuJ&!E3e6i6CDomf_gD-pf^kfo(XhQlFAI$>#fnNDYhJTC~NknwOtr!&Xx
zjUJ({lJ52R<on-`>Ge3&X(5Z0G%b)p#C_-PXVzFI>4@L|y{}Sf&64DX&CT0XYB6at
zA}=!1G-EIvP>E{@q51IRALG=?^GwELjvhVAkN>$p%TwQal1mrgU^E(#=M%ClMM%Y7
zx68`P3Ol<yNTs|Rm7v*j)IWt~bNe>G^h;l0JWlBK`+V@x$FZacFT+8&LVJYR*X;sn
zo^xyM7SBKb0t@pCynf*|9)9RNAN%M>`0d~R3O8<Cr{CY>%H`KwhSy}MAYeS4@Wc}z
z=l$<}AKiQhtp#ByQK}$G6SUSen$34QO@CmcbS>JaZ*c*-e-Ewy5@m2NKx&1sUZ*PL
zRJVVy3z0RJEcY@E&sew|weeQ2E_Y?D3sTgS?Kn`AabSVI!_Myjn{h|J+=3Cx**)JQ
z(<MAR0N!E9%R7v3zE(C-ICy>)R;W~4zS&ygn|=wh48~c8Oq?~Qo@A)NF;`kkf>5Ki
zA`D%ztJWGVToG%IMJtKc0wsh0kGeMxmh8Ik`#$HKyY=30-)6@QW-tH-AV7cwL5ZYD
zQF|oIu@lEu*^aAHNh*Kkzf>xJxGH7GPU3Q0+5Sx|JC;-twNau-5F|liC9w?#gW2EA
z+n3(gyPb3L$GzS228+sM*|Bk|Ud_CIxBGVA?mp-Ie%~$2$H>vd$pTvTJW_L?Zl{eQ
z(J86cQ(B<4;HgrEu;c}hAxq=VE=;}%3i9AFjua70t)M3tQctgKcC9D$myas~rkN6-
zSR~|Ihofl3r?{AKL`MD8CPCYbRwgV2ewOMUh9T8TnJ|iY|GjrO*xP00*l|kb5(~34
z{MxVmGQEDvojV)cU0<isY%m^&#BoFzCZuVCR4&r7I9BCh=N28ujFXg65+e@U?Cxz6
zjtBhn-~N}JJ$IaEp1H)6Pd>`>;v7*DL7Ih0np9&nC?-gnLP$6Js!uczQcg`VCV_N1
zPNo|^DHV>B<+n^I9f{UNsmAKeD5MaSP|9aG8gp>ipxy2;7>?<7`}F%gj1YKUwlR+4
zh;h=#4N{~lkjg<hKCYus4qy@r!lggxFlhJjd<RGQcm+WmN2J!^I6j_Npx=)vRBCvR
z%ieyIa<Rth>T&jW`=rSp=gwW?%;^gp>^Hc2^(t51e}~Q89k64BdW7YbQyf2jl3uUF
z_3IztI#4JmnvEtxCip>sR0$+8N_iAZKGxd22ux9qLJ5m2z$gVuQSdxm*98MwXl&|`
zYK<cV=&Z2I=2nSu5`=U!eG&pC1wy)+jkfdYEhHQ{Np}}hN~2{Wb{2WR<iS8V%f|?m
z;lmECACDwV*bhu*ocjpHq%N3PH2<ZpO+q|CZ~CO;rpF#R=EH@A5tCrj2@4{pDr!TN
zj0t=fMVG)ydG6US<BekiG2%;KdX~AhW6Um{;?`D|fAzaR;0ND-l@Hc$fLowYT;uq;
z^Hi$y1TNfLe~UEgla4H<$~@Zo%*-yKt%o)O9c!dXm@O3;M+K}5(5gm#?Htwmh`MJf
z9k^^aciG?V^8UsZe6K{kvPR%kSXijzRV#=97AiI7R~JZA$!HuBkB9VoO{(=d_I9>O
z#$$%V5zThOwr+BADdqe_$LMuhjJ3<&y%xUja(#V^nWZ&Q+mwS6iwlbs3k8CLOQ9H`
z9EC^($=Kj4AHU@C_-D@2?CepUtJ65_5rvj=Wu7Sh$s4ynbs;h89x~|f^Zu=M4)(g7
zSb3DS6X!Vp^pkw^n=kOWXP#hoZibPL`NKbX0Yj04c1oI#5h5fAV0E@myPxvR7rsQz
z=~3}x?%cUWv(=(LH%pSlXg#1-EukF6y?eVjet}l2!NTGKOAE`auFg`eCKO8r?%qB?
zs49+Ir#iF1;>sGMaKvB#kN+0Omrn5JkKf^u3m1u!7>wr4H(tZ)h?!c2x!D=cK6!!0
zu*aQScX;EqH)tNTsLqseWQjX>nkdgQ8n(a&lnQg`xWmp?i*XX7rD1Fi**sMA`hAds
zqF2IEW%l=moLGC9&wlP1&d-*iu|>PxqvlF{BN>f*+-<zewMGLoH^<4xpP;|HO@A=t
zuyMf2Qzy`A#9-9NSi`}7gVAtIw=>}U`A0aD`<*+EWNmeo3+K;LDta^;2MmUNtj(N(
z9(w2@{^sBOTl}~G-G4*Bmj%)}j)U*{MDZ9YEWYnipQ(Z9;X2u5;y4OnRVK8aY>4vd
zMF_=V<B&JseGA|B`TEztPPJ6w{r9i%`fIQ8o4@(%NHm+9ce!!n8i$QThT{R_XpGhx
z-!D_G71`Qf=e_r?@YGYE1yaIzgt6cmL$UCa`x^hd9#iI~wV6;9@>w|l`-e90#^x5k
z;t0*gh+LqXrMgch@t{!1JE57tK6A&q|MyIDa+Hs)au=vfka`~t$vE9Q)sxlY{w6kC
zsit%`Z4HUlaD=in8556lYb}BA5d=Z5JD7CJj=<pnLXjd!$i&rBWwfJ-r$Dwh&MYkB
zG(n_EP8AV2u|hdn*rV%Y6h0-vmjYKx9HsC)i|d0!hHywnL5|$b&MzaBB2E(GG$Bf2
z!Z5~05lIwg9QD+aCJ8bR<kLB|X%bkMbIcw<C5|EyAE7zr<CD;czYJCQh;D*xb2@o%
zKkjiqO~Z3MQj-;uHb;Myl9_3MlFZeY7z_s_Nr*{fu3mkYYuB!D`t&JIoj8rVcR)~_
z<Km;|dGzr|*xlY@{q6>xPMhH{WIPV(_J^pzMW+VoIv8!~4f=FC9meA^?Tr?$E73-9
z>&`lxJ9oKt`#SGkxy*0;`Y-eFxibuU-CTgGvJE<JM#obQR!UNx+^4(cO$2N6{10O?
z;dG8nSZlHz1)Ez0o9sKL91pMHW38mqAJA&;&>xIR4JhGKpDVMpb^?K<-EOnFvq7`b
zBuTSCt7z<E#^l)=3fEI8XHvXdlsktf%4iegcnaT_7%>DiE60wpx^kSW@83e33|ZE8
z$eGjUIeFqNHoDFAD;sp%9lrdxe}>=ro!`ZEEYCjs7+c#Oum9*r+_?1tdj}0_l@naN
zc#+2*eTpBx+`y48^K+}*-MEHduvBY7PP;Nlp-`@qxpSE@!U)g;&j|=rR%}fgAQqby
zZ$X}+Vg*)P(p00<EKyj;nIVen`DjCK)vGg8mFSabGyndNtZyNv^YYQ#AkP!Zn^N$}
zRH5v)4|ALBM~;~k8`FD#%oKCKC-upQgglCLPbpC!{|b*%r6%I;qbJK=Z`LSN!Xj*n
zFd9c%{Gz~7DS|PLUW>;sKF!ZO{bjn%d&FsjAH4P#{P}nPPu_fIlX2uwF4tIEI}3i5
z*@cHWbMjeQ`#stRw>a28WN|*gt$NHa%u%VYarW#bZrxhP8o_8dpw}MrrRSdI;NT1$
zU1n?Kvp3Q_ap5dqefAXVH(uf9UCph%l!N^dZZJ!I=?uf3WpgxOuz!!2-~B!n-{s`$
zLlnxhRF>u`cpeX*y?`}_Q^(KKZS^n-4EqtC#yyTNwJFb(*xoy26b+~p>r`jUv|Ia(
zVh9Q)W{PD*7!h_X@xanoWZ}n&VbmUCi!d0C>5j(ix4KAGMk`H>;oa+dw7b2JdxQSc
z@lzKPKYsb!+`aJ*<x&}?5*Fs>P}1Ygx2{num#Fz351(A77mfMy&pgK)Z{8*vCzMML
zR*aA`Bo#hxp+bMqL5M!Rw8?u{uCTG+#rX3?+HhjYVR3$mR%ZmH#8Jqw(_w#qkM+Cj
zl&VE8U0UL6pZO}4>MEO?U1nxZGQTLfaPcv^g8_f^&F|A`H@SJ^CSUovuc5V}*XwZY
z{r9-_!FyB-0geN+Cr%>$BBxHBW^a3slgCzYeUDmghBHozr&4B|fN`tKFdVaXVxHOM
z8Kf^b>>QHVgi5VKZxmpJz%f4Kkz%zz$Jf64%RF)FVSfB4e?Y;`(d!xZT1`|6ffFzm
z0_!Pii*sxq>~Lpmn^L*Va5SWKrAf6~B922G*J1TUhOX4-=kW?YFaPj|Xs!9uSH6N5
zj~Nbzy!YN^v`$IWFx!acoz!Z%j?tDvF{4IVeV>MrBq9Aln`ZNX;V`1nJmAfD-(Wb5
z@-C~vrU^nw(lo*KJZ{{)!OqSu=gvP&ajD1~Z@i984ZU8E;h@jAU-%B4PMiJxUHZcz
z+N6Zz5yNqxFdP#nhO5`EP^lI9_P4%6uixg%`|sj=3Z<Z0tL2U(pRQpi8}rHJF7DGF
zGU`yqzn{Rg6K?)d@cBL^Cc8;Ys1#VN$$d8RP#~ej6l$InF~*oo7o;rGs>~TiPPp4g
zVB(yjc9cG2r@vb=&wQD604HqS{Ap&lz+~yN7{+l%D-c%Se?=1tSAHFmL=&YJgqlL#
zSwi>Z9!Kdwc`l5}JG+U+N{LpPARH+eDF>k(lyY!mix+F0D8=#2w3rZ5(APtRQn}@`
z1X)0pN)*e2;`EI(w08H=VT{VH*{n4PozbI=y?^~P6N3C&S-7udGWX>Y$myH-6BP}g
zpqt3hkNd}oPjMk3EI2ZwrFequT8q3m6M|l+g%|j&E-z9p1t`bTXf(Nb<0|`mJJjln
zRBB7~`yJ}Db5zPjKL7crNrYhg-X<Shzrot6<Fvb7I^8~Lt{V!f6>4*H7^8`X1B6X^
z_0^Z?^al8$B~8X`Z*L%^;qU$3-=bD2gEqOi*FoVRtOTJjSfsMK*TAGfFln^pv`>|N
zOB75s5^~bfH5Tc5xNg8WjA=F+Y;10GaL`66kNJgVmX>B%T{%X5b_TapAsmf3d$7ly
z^*gMu-(m0IfN==1&Vm`G5;%?pX^=AW*7pMsV?CmHfRG;2@i0b^>KIFfQhAw^r#xPJ
z<#mR`A+xh{q_HF%8J3rh(Q15$nc9d>yTgy(c$J{wP@Abzp9y&S>2n+$>~XNa&-D*l
z+`hHN7k}m%{?>o;_h@x?xP5DrL}!%XG!`V0#n>1a5(EL-ScGs87IbV-DnlEERhZP|
ziQyR{E6I#cl#t*^d?lt7nhYVza*d=gSR>Fno$4n(tz)vOw$nA^zK(7Z=t#b)hx-M<
zN2yKrBZ$OD1=)al@V1X@cuauuzZ8*}mO4jY%f~_>Of+{>!qx+Go<QJb-y5MbU7Ro|
zks?Kkl9oy_py<??yZ9J`uHlETzr`Q^!8dsO-8a~2?&3KmN~JmG7OJ?eWNafkgBEj(
zF7Z%cMlLhnA{UN7!tvup=8w(u@FSlk(PfSuzrfb^E~$<w6-!i0ibv0%;a9%$Jf)N8
z`Of77{@*|PHnp<gKm6*m>@AI`{laJ19geuRz0bx$N^ex>#zvnpGmKN0tCx33TV3wn
zxQ17lr?A)N;9!r%#W^aKGK+KbRH{`<b5&;N1*Nj4D2H6XagBDjOB$yH$4i8v!E;L_
zv1V^)k5)J&kl+R`sZOZQ)Uig8q?TT9#Ln(M_nLiFWsd9XefIY5G8}0VEr4u(`$@-7
zT}Z619i#K@2CHXk)JqkLzRULZ25~sT_Y^kLC<|#aVt4xv;h>A>1UbziLHPn}44qD!
z^J@zntZxtqiFHa;>K^r_6O7}ST5*iFDaVejP%KtRQ^_!lxVN>%_SOce)mYo%!Xr=8
zX=@G+x|B)+$0>5^#A&Wvy}{`d53yS=Gq%ti_Zba`?C)&x?)&dxl91Sj_<_&%&6||!
z^W3<7kD_1T^;cfy#Ia?bd+teAR_A%~#Xn=QQo@E~R*o$~p@6MQ_IiihYi{t+g>$_9
z!F8f|#F;Z^IcRk$21|V5OJC*D&pb_mfG3{+GCS|T&2U$+cl`s#{UJ&!W>%M(TRX;`
z-92t>?GkE1w|^7qW&&J`MoK6Y3cUWt+sw}{vUcn^A6&o5Qf*0Bv8Vt5AOJ~3K~#mM
zrA5F{ECnpDEVF)Roh$FZ#}iLJNf;(b;UGmqtKDF8;~tM)dK3yi-R>AqT7qJMcBE0V
zK&Rc}`t=)ZtgrLW{^>u(RRy9*lO!prjwqMQ2mx^%VTGYkC{QRC3B!<78zc_JVhN=r
zolXa9ZQezeBx$BKaf=S)@es7&<yU^lH~#4NsMag|#gD$v(!wIj1J7}Y<B-F{PoYRo
zOt#kIfpDKG3XvZ+v2@J3K=+G?tk|$eIx`}FOpz_Rd1q=uTOtql6Az?A3$&0}kuAD5
z4^5mn@<Ikrt4T`o{Zr>Jz)m+sa{8pj{RuxmKKq-^9KwvvsBaT!;mF9CUU~Q4WMm=4
z5kw_lBrP@%Tg%TOA+syXXj55u7}!)`mB2`amKLJ`VNtO`g$c@aP)>w$T$Jm8lsImL
z%=0vqn^7hl&&73}ybJE2u*@zjVdEH`rX)#9l*A-SLXsvK4Qi6>pzkL^Jos{t!171l
z?}_`;C()XY{`;4XBSqh*xsbr*W)@1Kqy%9xWFls5vrfLz3B$n{DGVppmRVa}q}T1z
zYIkTh_81JuMA4Yp)-2^}mFmn4m6<t?9baZ)Ws!r!2GvfD+0ht;L^&==q8W}uqA<i0
zihjGn%dh+e#tO8ygi(UlhVeK=N{7HNW>(rpGO+~5-giM$%AL|b9^{uxl#;}8k`)k4
zG!oe--DpE<4E=tKZhu6YT6C%@mMfgD%wsGhiRGZ#Lb(MR?Ji!S!0g;C$Id*=;@TQ3
ztH-!{{TA16Y>^IQOqwB9aU7GRA=W0i9&~#lQ8Yj}hA4s{vglM1r;<Cjn~X<yID6(S
zolZolRN=YjevX6P1OA_X`THDOIe|73&+++Z|I0sPXJ?n70B^p%$+44Fj-9IF1amYF
z8;pi2N{o5)$5%M_@ChEhbe1S-ac|=`3rl4(H$jQx6fq`yeU9Vddp-(5pj=$?CV|az
zUR>ADNG%pz$H_R|xiDXAgHCfp1)I6gl>>#gnGid*2^fR^6c-W`)L`1gf!r8F96=sF
zIuCp#YJ$v8{OFKJ3SY?9oe#qX_JLXK=woL_BI4*1d*FQbBezefzSGA(!rndlT&AbX
z8(228c2?G+q`{Q}-&Iu01sun)y?KuhZr|gFfAK@U_k)+YyKzWjiv)!^&Y%AbNzx@s
zIz+u8BW;i+g(nM?JdZ$0w6v6qlCM4Sc}|`y^XON82I<Z4PyWeo(;piAf|q4CxeB9G
z2K^TAf3QQTKV+_cj*6ox_nU|h-s6q`{_k_T=x}oF6hD7<6@Bas&f*2Uzj29MVTYTI
zYrOGxfsGsM+`D#w6pO5`JjQlVC)Q*3wsyFA^?fSUGUZAQYbCX^X8r`s%~UXnW;hI)
zt=GAG`zED8aqH?e+;b;6IbWpWNs1MpZa=14a3~fl_<o6QKV)P5F5i9ON9?CAiU8j$
zq9s$hyZ*2m|6gPL)P=+!eCsvl=N}>NDh@WfoIPnlNlKM69u7NuF~hg6(~0(JbQ>6z
z;^32nF-6x$>KHldQJ<SZ`5v)T=CB>I*;dTV%+c)h2;(7+DxsSZ-F}PaK?9v=N|h2%
zJo+#*walwOD9!Qe%eRPA#h1VGi`=}i!Sl~QM)UBHdpEA5tfuVvtSzr__2yMJH*P~R
zX13-NCxT%b(KADe)j9*+!;_LUNtmCj(P=jL<3IQozx-=IN3W;2eEBlUReb%_9F@Ru
z`_{X(`fbKh%)$HDvdK{t*xHnMYKdR?@?YiGzV_EiQ%yRG@E6Zgmu0$M9d^33hTDwe
zkgfd|rqySCdyn<4eR};6BPEH=5C9=zd1-;UxdQ#JW%J&3E?>UQi{E~g#~;1KKl+FN
zkoK@eu~<MAeCCfIXQ9_e`8C2gn>ci8N#dAtv4qf?T2MeHBMzHwT)#x2RHM@$u(ooV
zFFyM;j*{H;C8<#u>oOY0I7JuNcj)!oluLDlFgT8+-y1NF22`p=g!IT@{0QNhOb{!x
zg`rrefPh3rh=PZgW}@_<<WgR6nJ-tdal-6UiOyk|iH)6~+>Y$u^_cF<1-WZewlO!>
zPVG#A45_e|NdVVT5Ll4wBsemsT1(dYB(vYJSx0J;1f2Il5kjGytn)5%*R!eRY({X+
z&tpl=<cyOXiQKJ8nCv(qa@~WT@^dH8GDAi3=WVk0+I1bkWZlHP6KE|{Uw(wZ6B38)
zB1uGEEN8`sH5NMwpUhus)=e~1UNDnaI|*+?p~*5NM4Ds*>qO>`Zweu^gzunO#Pz+b
zxQJtvqj0=Tu!+dt1INOAy^b6B=rkcsHGZ080b@x*lBT4&?Q#@GdEi(6qwj~|O*qZd
zw=KVPAGURcNtgPg3-KqR6h{%IPjMN6loDeNNfHy;-1t~!VtOeBwQ8MlIHot~O{pE8
z=d!%A%<Swejb@j_W{>^74MxK@_1Re(t$n29vADF%%Gz-TgErkxi|$~E;}<BEt4PPm
z(x;_B89^Kr`Rr$(rPu4Qy?uwlAmPIKV|?y&&oMv0M4H4|Qu@T+)lSS2COV~*%!DEf
zfD>4zUpEO>Xb?HgQ5aIK8HZyA!vTZgh{I-&-XNk}sWU&f$lA&pvoi}|CB4CjUT;9Z
zKOl+{qA0@O^jThBW@c`N`T2RCF3qvG8<WICtOHu7jN?AxC_7%NEZam#AEgb=QG{hk
zvE))LRp@pST8(u^JvevvF}Aigx%~DA%v5I(*1>m6gu{>*zxzW5{SNaBGu*qoL1m`M
z-0TeF(SRTbc<#C9dCzaMx7%QEx50bwUFP86S$_6QpJ8?B40ks^AR1R$S)FCJUPn6F
zydqUT2j~<Bg-%kUapqX)dp?CiArFR?m^7n$I?6>N(Atp7?0agBMLL3FsX&~@=p=>|
zQWIx^sh`pzr$U1xbH&7sj|aQ_5A4Y~(x}RtP9I)P?;~j0K^Z;I9Jy`sI7erii5}xV
z(){4r^WUt)L_e3~<hf?e<d0`EWKU<`MQt=zX%dwohbEPH_(&sx7~eIN3!rRFAO((u
zJJ&worI&udpa0o6x%I&&p*0kXRhExE!s78uB(?&^aO>?C@CzX_aadS7LusMJ?Cc^Y
zD&hGq?LtT?81com84j=ii0!3WMzYSrYz=gl?;@3lP6g7s1VNosk6oZQ@`!Yasu9R!
zNJWO6YB!kQYcsy~9$POcHfsx<{k#7K7cM=_leHx-JTc4He)V(o+C#2i-k@`!2s@S=
zw{LUU+N0B5;+;2NV?63{u-9O5`3$9Ug_)TmfiF<f!*z<JM$j8;PM<!-@s$}0SSqf<
zrXhN0Aso}#yhl(dVQ?5n1{clp+#+GiB{V6HDq(aAQlM>!=eqy;AIyCG^kVDLm`0<;
zaFFu3&pm+_3lz&McnG3Vm&@<}nC2VzICJqNwb@nX7iSQrOsCnwA;y&nQ8-}xaG%50
z2v<s41H;P6$2flC1b#u%Xdj}az)=o!wK}KIE2@Pej;rW&TO_tXv(skhpv9f7Hox&3
z{}G3cHb}+7!Xh7ByGCL(o|M$wGJA(RY~Q-eC>r4Vf|CzFL~qcem&Wwdh_VfE5(q~z
zje`cRbWze$D0tkvyT^a^U;fuzyZIhg#6)(;<ty(nyEaSUdF<_O&}+q9dh7z1uU+Bc
z6DxfA>%YX8zW9qosYcq211p09PPxj$sSBLxMU2&DG%*XS3%vaLs~k34#K{=Pvn1A{
zY(^z17K=zJxq9_|dc7X5>mejK%4KtFo6A=&^NU~qI{)Y&{R4Imc8Su6o!wm;?GC>_
zY%@-KZ0_9Qu(`uSXHPR64(N4al;aSFSyo15Vg{oD?amyli?ev1OQlu=DH#kxDzh`(
zythG`rp(l9xLyEOQ!bWBLP4-t!y1cM6vWApG}SmB<hj^LDe?VGSeVKHR|OP>hcF4T
z8Z#P=@Jd;x#c(jh_lkI)|Ec7FTftQLoSH0TZ>nd=x%N_sX&Ntp);8Oe%L&RbK^X3L
zgCtqVma!ATZ<cQ`K_VvRpqZv%BDKrxgH4VykWc7Gp6&Fu>@mf3BQ)`hRZ`%(&ixIu
zN%O$A?09m`MwZN+C2#|o79oxiLg4#8j^kzyYiWwr>9lZ|Ql%tW61~b6%ZV6U<jzSd
zFGi%0U?J6+jieMROPD|MlB@xvvt?^y^_q<P_=O-BeM+QK6pLk~<B}RplBT%IVQ1LK
zm6?-}>$+JmVzEF$6sONwYfThIBuTbe3&W5oib!>u7e1DW)Y};IKzs0hz|{T1z!>x3
zhTubjLtxs~b{!|9EE=X-luzSG)r9^gQA*%BF0Sw4`CcZZcNBAriy&bz9MbD{>Gitw
zdVL(nVSav*a;47h-agI79^Gz>TD?xCT4UdYw3>TpozY*E3E95A$!Hwo2L;OI8s$<I
z#|`lO0*^iZBsXu~;NHD;YPC9F{_@xP>}Q|H_p2m~&}obz&G%;6#>!fQkd`PMX13cd
zNTW$igw}D6x`9>M=b<+qW6})q==TTg?CmlfL@0L#*PEkQTcW<ON~t=JSE>^D1?o!<
zR$E%lCP|XgYBp&c9<qMtHrrb+l}eRTvCiWc&U5S5CYxJZ2%X|9hhD5{9kvMLF-yzy
zEG#TA4*Nu5<^<@LsuZ0PiH#VHdK~Wc`0Ue9@fY8FgZJOM!SdoV7tWv0EN`QT%Wq%i
z*=HW%{MnOW`ux(beU0;voX(Pc<CI%BdW6vy?QR>bL&A~f#c#iiiBo>{KlnQRc1&x3
zkD0OuGX)$MG!fQ@Xp>-cg3&TVRZ^V^(}hEdK?sc%mSH?3juSlB!<!_Dy8`KCxkm=W
zFb?y?dPA6|8DjBaZNR5!$d7c1Z9W%F8VdI{1rHV%lX?6;dLbW}QjWH+ra1W#8rc0t
z$Ac}4tnrkkYv<+?Q}lg`zap#)RxwFNB5(I(kD3)LS!S0(Y6q-CWMdMcu^uFGNYU{q
zD+TV5YQ<758t&b^#!Iih%_~26o0ngGhgN?;-~^eTVd*%-5d7LI^@T?`=#A+0n-r^a
zoLV`?%KS0bE<Ay^SmosW8ZUn1WyaRhD+>}=Q`|k|)ZvK5lV|wx`aYGwr#!d7+wWdQ
zTZoOo2$zk6E>+LRr+~gYfGA`T1jHqWl3PL&fs;^6=TJ|6f#I`{^1r|PLmsc6Wqy7h
zu~4Gq&a%<I%I)=iPRt+U*{^?*LP=ti9#`IanE&;E`X^YUDOKk2E3<Tl_vknKL@`{w
zaf_fdLoe~TvvJ6LASsMBw>o>w&(4q*eLN>a8Hz#?#hO^B)QSOt)Hv4QBT+WSRf@!9
zLTu8XoJ#&v7ZN}J^IzqK7hXb}A#)37*xDYmeJ~=@f;4V2JlNp*pM92MeTLijcJK>|
zcs!&S1oS%{#-kRs+8m$#!k4*w=Q380xpeFie)F&XH9S8cj0OnT#fU6aD;b9bj)OEB
zhm7lObj;4)Ht)RuHh1pcWv|(!S~e^#uaR2A?*1Xt^GK2CIAQJ7L(JT}fgLEqVTXh5
zeLN|UNlZ-%RBue&jZmJ;d}WdLU_hLt%*@ZBb-?wj>)gD#%|quOLf~_J<q}~$B%sRi
z*&3bpkfiH#dg&s^mQM4f&;J|+zeG4prfI**cM-0`aGdb)<Imw%7uY}CWM-kv$;Kfw
zON;#ZcfUoYRHE4&;y5aIM~Zp)p;HtC#f=-+DV741$~NVtio^V}k5d}+hu`|=)azxu
z%7BGqE=e*(_&u7vJ-+#!Z}Oc#eKAYm77nwE3+(P3AY_$tb&k<spK#cx)ftk;k|-LH
zBx4+3((W~2D3B^aqG@%SxL$p_VRJp7@i3)aE`#W!laMsGDOD<SVsShHBq(V~BaJZv
z<4T0cHgJV%iEd|zO(b(O%k<k}ZtMFooXUUCM-cea>;xwlI8O@+A*QyynP_?v1b6>7
zISq!JpbXjOMM;r)u1~vCdFRtkAmgn4WXOsQJ1JI<JoY5tV5+?!PZEaQNh&|5$R~M`
z+3RVOV#yYB<cAjxo1q{1auFs;*0oPH%FVp*rBaOIl;LPVG4Lq(9$F`W$rE_<j;^^+
zjVhH&xW0?l0;4C?Cy_gN2v7n?I^a53XX5H{lqsAofM&WOH;80RoQ{aolqd=@sm1er
zDwQ(znHkE(I^AJNDjZTQiP4P1aC+T5$06{8X@TLonY~`ARLY8qBqoX?;wU0cQnUfj
zagP`**$14PvLL*y*bIUoLs)VbsYx+0`M;DBjGh)@Iq3gy`{Vp?ZIov#*@o8jaQ%$l
z;(9KwleunXftVShSu9s6m8%5BGVNBIUa!w!IHpoA^U&#2^ap+R_V#G(@6c^Gm|K{q
zTAd+D3`;Ak)JrQ=eV=BtOQX?Z>&7mlD8(;USy);j@IB6)KFer0;KcD|o_Xf;42LOK
zuH3};74x%oip2t0op;4ET3ebV2qiEkMJGvyPRJPH##mvHj%EGcZIU#m*=m!f22d#F
z(d@N|W5LSoapvYvvATMS<)vjxg+ivQkeR)>P=;!?itGE#&CRm1x<aqpWi;qB91Q7q
znjBj?jcYX03^_P#Fbrb?N8mY%X0y+@TtqI+V-ktNLkZ9!gi=!oip*7uq$Xu)@dQs?
ze45u^e-)u6cW>Nf<K8`Nn(+Cj9-><E_`)+!QLp$EoC23FJVmiw;O@OGzV#>n2XDXo
zW9H|Ua9tnYbxGrdy{!)GHx7CH!gKt^%P-JrCOEQ7eZj*o8Bi%<IwXlh0#(RRN>3sb
zq*4=_F;N^LfKW%6ERGXxGrHMCOO-Vq3`wH#JP&Ii))7KTJm3F!`dR<CHI9mz?-vh8
z|2=|EWWOD`_faJD{_P*0Q|yQSp8Y1Kb5K^OWa;cj?`36l|2I3)0!pxo-204>5bcc+
zk)o)|INHHi4rw~TFB)e39(p)N7>Dcc+~B(}{y8tb^eVS*?juBvYW+A%^HuynVojU<
z{x*$f#POg;8buTlh*a~lpMQ?0PgQy93tz-Nevbd~|N6gCp~6uP0!^I6bd^hcb`?Ex
zm@Td1);+wk;r88iMsXkOL})+eUT2@z|MU&!Zr<jJQ_nJ|W@wL77L6da*$)UD3u7^0
z>FMKKQ!$%2H#r>im@Chs3W|l}3)IUq+*yB@SKe-5)mv0*if5jDh_8M1SNY1dd)&Tt
zK(p_V$P!u?aAb|cgAMw<ly<*GnnV;==UG}@X2uz#%n;9Wv-K#<=Ep*@03yYxY|Zk0
zk8;UnI8KSRCAM+a_7Yi8=1)3)>O$hJH(qDZZlR1%r`aM&YPhO^!4l~q7cZUT^UpuS
zAAIwN1f?Y`K0(o9^pN$9n+$qQo_qdlw1zPeE_c@N@W_QZzWd6%B&h^xX!N?I!a)i_
zt>~hXn8wZqhr8SS=l|K?<J5^Y{9(%0ev9kZZ}ari&+_ssukm+&>+kT=OE2-pkKW?k
zBah$(0nKp8D2;gXOFs+AkXt`~gTi3QN}<BS%nacu<jmO%2*1d{8a6u}md~DMae0|e
zr^^?geFkMLVXWy6`n38D!eoFJ2}))uoR{BzkH;Rl#LD6#XHK19zP5b7h%i|;wc~pP
z<qFm1B^tXe#@6DL>-?*4`~llLcR6$RBylQW98)N{6#ODmDWWhWibB#PrdBN@mBm_(
z7eIB<=ZimgmS*P~-+%2oX*$LNU;OF`?%lh~Yj1yp_pZK->lXOUzxfq@`(OMHsys#%
zz^(MC29{B>MWRPYW!O91XD8WX9FC~f0}3UHc4CTUhvKZ_%tI&G-)k}+_VB$DCLJ>9
zheSz?8I>3fBFaILlJ7GdjnIif3P~K3xdzEB+1SR0a5O+U66+hf?GB}SnSxW~<my9+
z6IthZF!=OoB#On-G$GoZgj7umiM*pO#r-^qY?G*_G$kbjDlag|wFJVN%op8t?+e|y
zzww{yDKf@SMp-&ixJ=Gx0b!?%ZiLO~N%sYNBF~|iEGXG$%^I0Uy=Cov!-w+{@`44j
zjc}rou0c5tj^`ni1QA0LlK@id{C-*11xjF*<Y?&_8cUQ+!V#V9nh25Q4dl5Gu8^cU
zLYtUr;b5|*Z?a*ZlwxU`kfte83Vh$A<T)6}qEw2jheYj=UUMJ6x<IOY^e99Cj*|GU
zhwpl%7{(@KJdSW3C%?W5*L84R56=_`f+S09&Z$vxl1@V%Cq+V<^SY1zgkhM4oS7`y
zIZe|CY?iTEfLPJ<K2$V)I>*|v)r_KnV&Wt=<$K$#BaO8rd6rC&Z=?%_0y8rsdfgtK
zRvSO?nVX$sZg!T<txeX~*V(w+XLhzvwOZp~Z;Mi?&iq`BwdG}+%`WTf_t<Z=Sl`&@
z@L-EVv52E2Pe1iI^Ye9v!vS~K?=t9hIXKv(5O^%k&vEMXNlqL)o;6LZK_oG08WJTV
zQXQf^@ZBt}eK71W824DebDPv?2E!2`@%;kja-CACOrhvepP6BKX@!}YIZCB6zT-^0
z!bWGg5OEx%l*ILYW;~CXxjE39alcO#B^>THIeub^<<$k=y?mK>u3SMXSXi6`C%dlw
z;SlAzpai2qpH{Pp)+vGK;&_T;u|Tal!`$3FTElF8jvv1C65*(i@45W?ul_RM_{Jae
z!3Wm}!x6Wy-(utOO=cJ7*xNbe#PMT1^V!GfbVle{Qz@3IS8FUT%v1CNJmugB#kfDB
z>%<hxHG-nd5Q8*9iY%==HJMOa$V`8drGP6Sb7@j4YtR^xlBAh_FG~b>5r{l5!(go-
zP2+67`1E;pOvglLcXS-3L*Ca&*y(yQ84p;h{u@321PS@*x$fUFW`aBjE3wEdc-6@K
zHbtsDwC7Mz7SBW!-5Afc6e}LlXw3e-Tm13w{V`WA@AKXV*Xf2MiseO4Km1kd3oEp{
zO}6)M5s%uGm4`GA3oA<m<r#{F0!hEkYGC=5C(aOWyoqzT%&k@zp+g+c10|4F<61?i
z=4mWEO%$KxxBurqWVhL&)9!+SLNUN`s|cq~Y{08Kv=22uZrvv8CInTVG<8W*NrFIF
zhrpz0D=1e>d~SY@)l;B5f=;W&?yUnlhXqbP{~Vut^l@Ii)+800Vbo^tu+PlQJiql@
zzeVF<%<up4OKfj!ar^E*TX(M#MKK14$QnH9Q!Z9%95fi~Hm6U_F&GZOrUagovjZ}#
zXTMOQSS;i;Tn$(p$H5qtXGd9#Nq^$c$4^~I%mxM4K68on^?mMM`w@?Qroi(2GVM{H
zl|`RY0bY6SO=f2niFCl;ev`R+iD=wq)NgX)*eZo$k;6uVNE^<ae}vC{;b-{Hci*5p
zNH7wDQUUEcxC(lG17V*R{`AiXJBR$*Z~O|STAA*k&(-U<m|a?7Yh#NOE2}*E@OfVN
z)^~XS%6ptTcNVK1MrlN9Qwm5HDs@gh`8hs+@(k`^M0>x15Q6%t<0K`Y?QVzdPJ_oU
zJ<7t`asK&l{|grGE#X>8sa(g%fZ4?pxCM)HG*)W{oj#{ej460!ie8m^Wr;y=gy*_A
zjwFs#Qe%k5DOO2B9nu^f(hfTy1u+UIs4@yAaqJ-+ABkpWc7{@^La)~&3?sD8as)^d
zlw)y}&%$Dz*MIaf)mnh#3Q`>rMIo23yv@?$Ecdpr(C-d-<l+Uc-u`pe&RS}<BCW<I
zrA5K>&ppNWzxO(uTZ)q>AEi<*(QI_Md2^F<=T>?2(lPe-ckzn}VLYHz3OVu6JVwt^
z2r6`1L)LHa5JwKfUPPKGD%E<n;mcF0qbLg;N|G#uEF2FhdLF(n@Jb$In^33)6iWqW
z3-csVOf-xM!%=3Z`zaeiA($czlg)1iD`y*em7^8Yi8l{1%$#4yi;X<lnu*}TPAOt}
z9L0l01lht1_X`mwk1<WkzOThN+MmkVuG6N|^#2xw$aA8FpBFG$wUT93WEu!<GK!Tk
zIo$(+@-65r4LTAz3?8@?JfC<xpdW=f+Ho|vZ9??{kc`J;v^Kb|hm`JAU}>|83n?93
zB~T<})As~6KLYz7p)@#BWE+e`BVC23+{}eZ#~7Osr<(RKCNPTBDWHwOk&3|cGWv~B
zSZ&ZIOVSPeAZsMZtPqqcyXKC{#M?eaj4=#`qx{;~X@T&7dsdD*#Bn@DC?-YF#EnMg
zIwL8_x%!iQj(_7H-~Zo+?>YHrAp8Aj_JSeviMKX;y;5X3B0*51R0xPFB`W0-f$!67
zHre0Xr&KDkyu3`MQe}5%heoRbK$IjzVM4dtBM6FAt93r})Fp&eT)TOlt?f;=cXsIY
zx|DQ@zME3;1SgKIaOUK3UVC-G_h0-Tjb@9-AA5|ao_dPa)isuvmsnn2Ahl^WXA40T
z4{3GVbh}O3ojrPk4#rA6KcG@BP%c%G(q%9hVN%P&;v$RlOH@il3ciaH7Gsl)@(0=X
zLmNuvG8vyQqZL|X5K2<0R4LRI#bO1|Ef9tgXTsC;lMy#>uhZ`JSXx~sPGb6_5n3k<
zhXcCZHiK@5C=S6G3I&&^pL~MveCIn{dFO3rXJ`5DcfZU2-YyTHeTYXNxq#z1gyWR&
zz4$$lidwx+^sjyoltLR#7+Fr8ILUf)hugb1Ikox(k6t{>v17+L|L|FE-Tr{_sDq3n
z{GbTBh>0cRc!+c~wOW~QoMfVNdqi(!<+Mo=$4UOZF({?-qFm>5W47ivD(ih`*4Y_y
zr1hs4x%<nq7e49lpGcGZ(1h`E7O~h5-}Z6mx6{VeeN4l0^iVUg3(waKVJ%W<kUEn{
z2tmPhi8Pd?W~t(#M`P}+-(hoaj~8Befgiv63a$M%CGR*3v!_@LD)`kU)=r#f6ph*J
z-bD`^99s!kn0=U;`Z>;De1Z>d?<1TN((5V)bZ`IwAOJ~3K~&>vOTV*)?yR%C_Ve60
z7%{)RNO7jhSjW_@p<opKj^%&*{Z|QFU6OKw5|)BrqU`%b;Ru;3Bt^7I5lE`O!^%RH
zLp7jS5ePd(Gayz2G()6KNfVcGd(7-O#x%DPp@F!I>kYW{*wY+8x6F3vV&2(7Is!Mb
zRFs1pMcjP*GK(`S94q^@(wN;&LKJ&AvOsDKjs#@Po%K6Z(<*bv%9P6`q%f2UKDBCv
zFd9=Y7OBnD7)A-@aw(%J=M5^W^_0B;_9MyX|2pHRE+mdGt+KYZ!nMm+QHi9aTAVqy
zOsgOB*5%hZ_0U<uXiOA`#Hj;1rrU1QX>2l6E?~mUxBYN$hg1*vPyhDc;H}HI(H0V|
zNm3Z4T?&<eLOGz@ZLoRs3cvJAU*?q`yvYCX5C1;D`B(l5KltAF5T0UpbBiY~Tx8g2
zvobr&^Ur>k#rZkTpFN2alz38kxIz#Qx~$d8?7Vjs-R<+uKl)<^(U`0E?oh6m!Bu?j
z>%Tx^6K>zT$2&Lg@WwlrdF73_@Ew;?Xt?mmMS_xIZ~rc7(r47`B8(*+MWmtOAOC}Y
zOf-%NlPD9>4o3MFP%s>g7>8r#7G~%S8gzz=;V@+F_;F_E7fI5TU;O32N*IOIYCiQD
zpES)nD?fbcB}QS2;}sZ%DJ9Rr_bZsVL}RbR;cky|#YYGz6sq(N$LLYY?3`tGagM83
zZ{m9nCr>R9g+u1%3lvHodk43;cxj$5{OmG8P+}Y>wA%&FKY5lyNwc^V;ns$1Zfx+>
zGtZ)w!>wDl2#O_I%{w3!$4>iTi$o*nH+@bVJI&7SHrv~WD5Y3CGtchs9<?B#-D-h`
z&ZtMhcX1s}rS9QZeXy41;Vxq2Q7)8ml%W)S`htX9*PV88CY^rCWHX;55>o-R$TbEs
zM-Ir7uCv?oh`H&6eUuA3Nvxhwr$p}bgj6|1d7m;hrN$g7B}D!_;7DiN-hcebFv4I&
zc6@d|g(TzkYiqJik0ld73xQBBj*w`rNs=rlK*%f&-uFGyXiO51nPf~%9i1fEb;!H?
z!_gR{HLe$+qz6cnL=z{PR2#4YM+$tE;*vm4jWRaPo{P@JujFEJ<vJ)iCW&KWD={&I
z!<bYjStf;Y(ZXTB*~YpdK~SXN2PCOxI2sX+LlhbEBZb6jlk<f0_rS??7f$XJHF1KP
zXnl;yHa|yy9LJd!4!-YyVj<x;4vtb_4as<nusNdhDR!et;|ME7ws=V~{jMmHr>p0v
zl@u9Id{QVnj=)hqf$LK$l&RP1Y;SMTY_&+!g!)V!-**WL0o&VK40m^_*XyjVodi6F
zgAQ>NBBbE-$t6}-s;u8FvT<*N(I}+XX)qr4sFq8te*SsB{`0>`rBvsI7rw{$zxOKN
z{N{IATRYBU7cX+^%yAyQbQa+lED3`_hjw?LC>r7Uf>ODN=LmeqrQkc%YqO-OrPUbY
zdqq~4PqMnSMxj`vSS(E6V>{XWNkE#cV=rZviQ>B1eoY&aC?Xt<2op`aahKh_JyIiB
zSez#nklwk=!C`|&r_KJs0S5>BG#d?!(ag-$SX*6Xd0~Na$s^GT@4WL4mo8r9cYpVH
z7>!1pKYxM8E?(p_Pdv__f9p?q`ss`O`0Y2jd1s$WrNxa~*Vu0u{2+5w?hm2h!`V|y
zoIAJ1+0(0>I(Y)$v3SxjUn{e@v&V3FK(S;gm6iw`7ei)N;Cl{IicD*y^Y4|M7&2sT
z)z%u)G{)Mj!1jD6Gxczs3{SNpNB;mZp+5cOoz{O}#za#EO#l5bN-)tv933CFkQNUd
z|H*~b$6CUE%yW96K*`U4^l=q#ew)E+jgTqA#$Xd1*THoZK~d6aw=n%Nm*3su`!BxA
z_kQqWZf@^j9nIWanUfFC<4KS1pu^7I0rS>lDOKn`oT;ARsf7|xKY4<uzVb_4y*(l{
zF7>)$uQenT9-b_t7EUs5Zx99x=s=Pxc>T>=#MZ%eBxR8@FeyD_ppu~6J)&VB6DnGJ
zLssTj@N5qmm#KITTX!~)=8&j+4{ZzhejT9=DGkCxp8-R}z%Wc9y81pR|HfZq_L(|H
zd+cm(FgIJJP^e(MB9ZKp#vnE581xuC3LIZJhD`({DQOs^+#;^5pmmJ48X+Vm4Jiag
z9y)W1*<zBLon*9K$E{=W7>$OMDmBJQLYl@@%KsmCZyF;>dfxf{-uI0&Bk!y3>h9{h
zd#2|iXNJRDA}Ns~rNvr;2pKl)wXwiLYcFiW{^k#BfA#wKV66eeHmp6oYfJJj#X}}V
zax^oXyXWfrtoz8Us=PDfj_`-bs%}c!L$d~m@e3rnt2?SHGb1u0p6B`hfB!srCm|hs
z_z9>K;wcD5{Uy_<f7SZfg~VXwvj5?A78e)U**;*<ZF8`j1Kp!mRQ&ND{8RqJzxiLV
zxjm*<Ez;WC;P&-*P=w?SgOxMqXjUvvFI~p46qDhA6ALrky7>@Ox9~j|Aq1ntJ<Q0V
z;z+*uTi>ElDKI(MA_+r2dhcC!wl?_UFMkD*#4Oh9^uv_*UVDXaefi6%Z+;V3DN-pY
zB!bSy1`iI}tlhqY8Abf;=1n|Xp-wK4pR=i2IllVEU&5-?h#qW^FV^|fAN-I~W0B^}
z0);|>cDsjDtuUS(q8F>Az99C;>~C$;D3*EY(=RYHH^ayq6HgO##}hZ}s47Y5hl~dk
zNKNXs2Cf?r1_^Jyd6li59SVg4DG`3)(j7vsqvLxaX(G|hBIT;dV0cKF_@uy~A5bYd
z_=6mW-7&hJpeaSEWYcUuMd15vJ?yc+<)i5i`J&Bkk|T;G#k|SxYL__jdFrXN9PVvU
zZ<c5s>{Be42`59`FlK#okAA1e<%^fNeRG2-5sXJ;f}o4<Cd@ReD5bOC?qX;L()QUr
zc#pwkM0K`Ap=41g3L-6|0i~uQ3<No=j6WW8_QENwib*I!<{OK=^2hH}EI3%Y;@;{y
zw)F|rwjRlh5Xa-+M~~yN!*si8w?>HLB<rIj@kjH6DfvQVVQf>S>7$FR1jS<~b}_Y6
zi^sedf35=#Q~kNhBm>hY{_`eaAQh4zjS1oy#8GEl10hHRQxkV)xHAkB!?LpiT4bc8
zL}X@fkW=)fWTu!W?^x5DLYdtp8ybd@`6+bG$nqYL2&tj#CQ382hHMCa7!!n90V4$j
z;~ud;B#C@{&u223;JXvt$r#_A5C$G;7~)PQB-)rX3<%ShC{6JU6W?=5qXZotbj6@Q
zL>daES?F3q6uCs6Pa4J;nnupbk+bbgE^##FkrFXY(^e`(s;L27WFCN{_gzh;Zb$F^
z<3+>cMa3go7HFDwJe4ptMZva_=@D-9lRJ{oqy`e?lu)J#nR#=j$A92?(^PYf%#a=v
z1)0=M*EFP3=sAa(Mw9v3Sst#hvbniVyS0m*vsqr6=j_=PKD_o3z21QR_6|t`x?xdk
z%-}c{UdJO}Fgbr_fyLP>!{LOTojumqHo5xt+wASOdHSj6xOnkN!a%UK)uw-cm5Cek
z&b!z6!|!~D=4_F2HP769ljcl~QaMMtlqcupGx=v6qAQyyj%n@o@Z5mFh2{BWDupH@
z1YOD_LI50vKgua*M=7MzA&v<AfG`M1;+WX?*>APj+1umc>MA$x++urYk3y-+{NggP
zP^@ljv$na(#`X@w@q|*T%*nGCX*3#?ibXU{k%S>Z?6ELEOSN3Uwj8R}I<vJpp6lZK
zKIhJzXK!a4Ls#5iU1g>@WOlB}m8YNNgO48a;NfkQO0g{{=1op6&GXEa3tYMUB%Ol}
z`@4HAG-_Dd1$K7sbN9|BQcNfpH7d<KB!W?IM4{v$WP(i7$Ih7mnODm&wMP=cB*}vO
zj*5>c^JPWRbjq1NA`5+zp#+efJN_!4^?y+g&A+UGm~O$N$?&6D#Gn7oLO!~-9c`4x
zSq{wczb7ebI+e(zXDPatA($;oktPxC_51wzdq3dKpT5HO+AagvAXh%i#Y<nMRL`@%
z_8zUnbprnoWfv*VEaFrOC|zP8IW@b?uRQ+}MQe;9b%LP7!;LmkWD}C$Vi5!d*4-w`
zd5-`3fA}HSdxCBp5hO7yGc)LxfhIii#+a77Milg!jJHXGh@x303Iv8$LnA;-1B^sb
zlriIRpUz%PqLpb>N~D2CqF2aYcn;TZlN^qalZcJ=8#HcTqx#a<IP3}j&wu)Vb9ZB#
zU%mJle*4>Jx&N@oAdu*WP7oOQ*le_iynADnqFrQv7=x83j1$5*&T#H&Je4aeyvc<1
zhYyKLf<|qHTCGIE$st9GWjSb?i83stZsLVW=HK&T!Y}}#qYI6rh}HCC<aT}RLSp-H
z!0zS-Neshb#I;+0#^v38e)HSkV)?{LBsPw&@r|$j(lkMKo_b-#jrZT@(#mPV{)qXq
z&AE%qtgo-Le*YH5${fpcHQN0#xk7<*)#k#<r}^mWb>i`W6U`cH_wVq#|H0qj-0AbY
zd-W<Wzw#<K@7<x4b2#urUj4zJaR0sc`QWLy`OSa#-(f(?Bu$7W1J<s8M0aD0n$&Tm
z&gS|mQ6<mS>mSgyBt<>PxzU86>*2))L8uc)4o^J&4C{Ms_I3tTDor|Gz}QPElxkRs
zMU+NZrilzAR?eMazt_gnbCgPDG^JtcCat~JG#n=(^df{)fGA~Y_6*mqUE|k&?brE7
z|M(vuRD>V&@uD$l3fns#rjf%BBD&o^IoqUKpCy(F<H-S0G~xceJ5(wqiupXIX=J1v
zKcv0errRA5g&CUA&~;9nbhy2{$7nbvXXzwKiV|?|+WX`S9xr{VfssE&x9!r}A2Apt
zH0pI6Yk{qM76<K!-k^`67wL8nXx8i0%NMwN`wo8K5DI}^(CGJvXqJZUSd?oe9LK;Z
zu23u%Sl`&7KbYV+MHZUp5eDoJ4(ay0xT8b9`juxmKl3EluH7MseL9`Pk9(N@!d9AQ
zat$Fw7Ek}!4ZM`{k=*I=hths-a*+M~2pvmCwvaqF>6i{Pj*Qt-9v2sh5RVla^5=?)
zqvrvS3W>*Pw9`W3=yH;gq(}v+R3u8zuu)PWq?Y*<rg&8)6hRO(90vqZLX--0!$dbs
z5Q;EL2*PZ_@ZtS6#*-0Bs^iy`O$1aH9;fM~2ukHDj#EPE7PghcFdYotM$=7{ZlWm@
zr39AIz_gnvnc`?r)>2FjOg+U=DVhRZLT5juy?4O&_6F^}T{J0ZRLdlBOuOA?cW0Z)
zq)&aJMilvYlQDxq9}%Y*O2g80L<)moz@Xp9wyZ2+Thp=vXi6K3fHa9o`~-x+G?Txe
zT?USe1K^nbe<Xi;yuk2%|9JmRNEvp!NRC4BK6!ZLqorw&3algdzdSOfr)2pzQlhC0
zDI6V9s?scy$j~*U)amzoC{1zx+!>lPRo2&6>2wa5Oa_eHJ}ak|Kq~IszRQi9H)u9y
zC|3$}JAF)3plcSUVPWYCy_m<+mnr2dbbBMVw)gnK_rK3G&pyw1?2#`NK}tHE4o=>o
z*_^|6G!FX%wp-T`A|+q6s8@?rD@Ag)Ng?mhY&HnPkj`NbLm4d2FVU<lQq0vEPXa7E
zKuSHkC{GJek_<o)#|e|sgv9eWI5?o&?H;3*JBNqt?C$b#bAtz~YwWcSkorFFU%$=T
z<_`VQg!=3}r%s=xT5n*OHinTkXTmVR^FopsD)~GYE?(x^hwoB3U1E1<kIA5)dGb;y
zmdZG}0%7R$spp=@&gFQx`Y<c9E<eE^{$aqz#sN+)$CtnGG++Ofui#jDcDFXrq(-w=
zA&Enb<_z<V8FqFy=<fHpd-FbxPKiprM5&s`_k1FPsW>s6BAl}tD~=<i%5rbQAjnRO
zX*4B1#rS?e7)B^*98doY!$8VxI{Hanj~5aDGC9+qzuo`KWJ`~qhyF!Hg`CQcjvyYS
z>0c-$ro5&{g+`j)gdY9OR0wpDAW|PeO3utCv!*6#AGCP)XCLtL%RlAa*WY7&Fu~R%
z%Jl+`l|^K3k#g-6?r==dOR47OaAsD>H)mKp{|x<+BK9Py8K9dH?X8<w^CnTafSwb~
z&lOqQ8Im`3f>01>dH(rNJ|aBaLnw{ZDNwNt#{QUo?~tBt;0Dm??6Q9EO{z5u0ztXZ
zK$8XX`3jLJ;YVXcqGQOEW}yiAi?}M!ILea*HHJOO-Q7HkU;o<}c7%D@XMAuUZ?MI!
zhqrn5$`wjhnScMcf0gh5=uOVeo#3$V@@H?p$H>!AiAESqh&92^!9M@(|M>T*SL+D9
zKyzjWWK1fLJabX@xkwXA1&3y{%B53fiiJFfoda~$Ac-S%T_L4QzEmLyGcu!+ia0qk
z!l%=w<;MqieC$G^(r6GT@X-f1S(rV+!NHh!uYN=<6PA}7RErLkVxCd2&BPm_8v%I>
zzWvv~$!OmtiF986(NDPgo`q=%&YVBb%87XlBgaL}23_*zn{V))x89+%v&EOb{1OLy
zZJs!Pk!G#N!NES;8(X~l<~!(lo9)g9&g?v)@3OhR&d%N*U;g^9G6EtE_BvY(#F&xp
zGvhei|L`^or%$mL`Xu{1AQLV=^(292asS~u&p-bqY`Z|QJVUqZF`huK*ks^_q^ZEp
z*D>svI8Z39fL*e9^6VK(l^U+=Q7zSp<A|JP(b{jbzrRl$r}$pT!rT(UB*d_CShmgb
z;wi@7kk5SPdH(VL_4_QJYNE*m&rcA#j&55Rwnlwsj&A1wshQ-Q62tM3!1obh4@v^t
zPVl@wgW;HZwZf@Wi^$X`j1uBBAfLB5f3CsZy8{9@B8dV7nJKX7l!zuJ{`mj6L81ke
zXG+Y?H>uap@$&cHq*AOA`U#N=2;vF0t)pvsZtZk=c>8^%h|x5iVmXhl<q&a-Gu7e^
z`w8Qrk5Y<_)h*nKPq|*BUU6vex7gg>X6TNo*7H=VMY^3s+H!|VCC}N@%bfhm7e4M`
z`U_hrM;5bmN<w<nr8(A<ibr2Rnj}0fbvi02ray3sd_5+@PK$_4)|46kk2I@FimW>>
z#8kt7B&9l%GCh(uDV3pAk1rKdSwMR9LZm=f2B~HcAL0I(P8yIPG!i9AQ;C*0$tw*%
zPDoNgA|%l?;LA?~P&T@)(X7oNr6P<Xg22NI0({?N90XHjZ05VT)7ruhHxN=sDFaQ<
zVOlvXyMS#MFbpdT7>i?)B+dLMfFwbR7$p)EnJ!n6pi+&4cAGo5uCaRm9?eFLZ+z`*
zT)1$N`2|Vk>;OlP>FwR6yT8d{dzao}Oq7OMwt*%|lLX)MGx?%E$wu_Lfo_?YmYGqt
z^rP&GY;T80hVjP=yQBSaG`ULC6eT4|nog%g*~&;(M^u`GIL)xLQY6#k=#yJWkR0J7
zk4*eo1)EOsxf$kH5QRxrR3p)pk-ZmDN-SfNG-WjI15mA3XwKEiIXc_hHiw-<+WRe(
z%43=~u0Q0X>sKK$7)<)i%`{nBSYR{=88bms25}5ZnJg_XvAAUL#FNk92NBn=-{k)N
zRgyGfZoW?Y;E+ylAKfrG90Xa1)XaQpfuFLw*JE$zfHaK}BBffY;5ZINr$DnlL%-`X
z8AjyoG6EkZC7LEd6C_bg=(~)EL%Q8Ay>5^7hwGS@l})EKMb37Jlay|+&+6JbH*Viy
zztd$r35e5xI91de^E~~j6`uao3+SfJUTdE)PVmE+B#MY*2t)9^h;eV9AOG|f{<Hu1
zZ}NA3_djBNeVt07K(jf+=Gq!}@7!f}Zk~Vm5B_()@y&0twX@APf9==#lRx=?ICc6o
zzxA8HO%#oI;khR<HG^9>?xNRq@^%hy;xgBm<^KIUn3iI$F~{kplk`XXblQEQFvQSu
z)EhQK_kd7%NU2boL=!0@Ap@2q5mDex$!=K#B8ZYKGa`-%f-FeT)H8Y$LI<Id0#O|P
z!VdHQFV^EX{r|d?iNCCn`18%AzwBp8#MB=rcziDY^V>YST)|X!rf1XgBYCPOM&wOU
zQm5bTvbWLUjo07dwO4<}jT^T~qJ(C3iN&SUgdE^9V0G(0bIT?2M5OM77tfyI{7RE6
zzw|}IT%I>>-X}0&?cp{g9-f{f&6{B7P)?m7ju;O59PaHf2_<oA;aDXGqX9-yBGVyZ
zxXIz(9-YCMxl_-AejYz*;`%*IeV$@Yqf{%gbn+s4u0f@-%$-{ga7Bwm#pDZu7e4h_
z<`$P|g&NoI4QZ{mxqkNs|Mq|KUvjnx)s<P!FRgI)RD+o-7f5pj*4D=;D`akAhX4F;
z{d*AT{IB2rQ=H<2oMn=VfY#nFGN_@Y4gAqV`spEwayYqMpsxZ_8Dw1)BH|>*kTJ7!
zO&X0delSMU%EzI>xtxurNi5qzH!XyoqPqc_rZ9Cg3s^-E3y7om$o=@Qb!<JpK6WAD
z5BnHeOdR*QaqDM<VL-WDrd~FP{Ruz$@!M?f9P%4~?XUC9mGkWFZ1T?D4!3u<*u1&H
z^DlgkZ+!jpOk$6{RvRgGW}6L`78fxz1K;y`@xl`RWXN#PM^hU0dX*>&dE@P?7>0qJ
z&rzMJQJ9^fQE~{{Emkg^rBa^Z*1c8wlbDe=Kobe&ame<K`|OQc#A1_5q_eFH)<*&L
z@;pzjoZ!o!`4S&pyFutq*xTRX{!WWxqfD4eEL{<dM<`84Dh)&Eh$y9K<#Fm3_iukd
z<+&Le^;ydK0){j&G#w>$+PiHMU@#gXq#_hCh9O9Wi|2<Jx@0_#c;Qno^6Klaa__-i
zym*3;0^f~^+A$}VPcqY}(&>jt-6AI|%rs3lMt8APK;Ejcci1L~L24$tnIj4kOsQd+
zc@kx_-|De;f0rlDU*UmVMam4RIT?>B7xD-@MkG3Z6jIg%FJ5_)*I$1Ruh(Ov-A4!=
zq(JF{#7enz=?v|I7Q_AkL)UNvAK@DuZUngA2xSbBI!xS<gb-UdIdk$fmR{vtb%lQS
z0QxDVIHh1D_$`;o2$oJ&ky4{n(7AK#kd23*zzcwo$0*e!`+$7h0L(O~?ufFHrWtd7
zy3(WD`gDpkO^>+Y5;ZljXS(sDo6#wiNj>scDEX)$(Ui)<u;3U4dt^vH4#-O%*`2fJ
zml-+}1k$px@+JHv%WjCGOzITGNk&--1aT@r#z@^nGb~aeas80J_91)iHWSaMQmL`D
zyo{0P#6e7)LX;>{%|d7<h8-i47)wf|(y=B!{lSR-a6)J3F`f(wV*#m-kS0=Sq)KNp
z_K9KvDwDgIra{g!uuKEf&@eQC5(x#zMkEdcYnGnb2T|letFayDiM)`=w>jOYkxnL5
z44YDYfkCg&{@xyktrq>>5G_r~TL$@Z0e3tm3PSwQLwX9$(6g)zUC%J4x`9+$whsl_
z&5_DvN}AFh?ThKLlF6iwIz(#f8OTD+GV|?ppXn)r_~&G3pTw0WS$A0}l^Lp~oEjNb
zX1W%VBt9aEq-dI&PS6BN8fA165@u#<q@;BEha7Y~Y};gEafaE&IxFrnSKoV=Nq0!8
z>acQpk=Nf?<GuIa<<f<7xZ@Fym1ALUk@~_s6W3=j91|x)q9h~D<Z^kQdip6o_5AZp
zCS%q%*13KA77rgjU@)H09k}SGiKdGzT+bborYXfjfl9fArR$icNxfF*{F!r<3PrXy
zx4D0Rla-ZAIHf#+?;lU4I-M@9y*4{LJ8W-n)9(*iTwFwrb#$qr89I_aoo<&~H*a$5
z_FYnGP^rv-9I(50K)GJyrO$nlQ)kZ8?)2H+>yV^6qw$y^3@~&HP0vv42L~;N-EEc|
zr}=OG-ru9yY%()5gDxbk-5s8L?$iA6hd;tl8aq3C{N2C%U$Js#h1t0UO2rzbVwDri
zE7&G%tnU!{0i|LE-wV-%hH2Q`zx#kfu|%AN7`lyP6-Y#it|yq50kO_x6cVYFM8%{e
z$W-TuT9*-J5~3(1B}LbCG%X9;%ubdH)0|FP$tImjWq9!<iHRcj7j>Bb8?U2@#N&Vd
zg=xYx2=TG+nqE^L?>s%4MEv<e;^=#`#+Cw-X?|%kHM&o4Gm{u0rqgjDr_cuwN}#C>
zA8Kg^k`#9oGUyGtcW;$H`h)NA(fc<T^(N$VRW6);j(nlX-hPYi&KjQI!7St`)K6ns
z3s`y;v@V~!JjY@wq*62398YMsHo<8ir65)&tzm*|p5SNKZu81_f1ma+V6eZ2X-afE
zhv_u2>Jh#D4;c3L5OI&Z9RLDN*_4Ymex%{63Qpl9U;R{t(+i68FPvuX<XJwvvq!!%
z%i8Wbz8sRP6q%p1nOlI<mu${APEcC(`O)YAqnEJuV29Sh9;_!28$b@*nP>LI1uia}
zA=fBUnRU1_*Q8iBIki~fZ(sNZp%44*LpldD%vW=0lQk;l1XF|BT$$xrlb!n+X(<&M
zSRf`QibFQm*Z9hFpQm8xNGWja96|_cwK}~)H)~|62-gd6CnJKuCkR54BnD-m#1vD1
zl<V|YTpzoT$npTPKc$N4wp#?@kP}Paq}%JUzu!h0cX|2Ge#&dF{*;vyGayo`l`1!f
z*LeMn*Z9JG1uu<hwc8{@@X_^;`1Etnp+t-!A@UOpB}tQze5pXM*QHd-!iR(u)N3{7
z78ek<%~Q`jgTKGW_rLpH3i%#xkl+U{!JtnNdgL@ndPC0Ui?DgXTz--Fq)YDPGFM7-
zeBt>QIdNu@ez(u9+Yeb-Sm4^7RfL}5I}JT0p5p1GOo@D-*h@$?2*yL^>ND)DZ*gjN
zhSKa3aTp<WgU;b0y<QK^$S6K>n&SE%<#GdmGDgURN~J)5*rjuDK(kik`ke`G<dQGs
zFfEOlnHrNxpVifS_?{uklN|s6AOJ~3K~%?hG+^b_X#&s3vGc^EE{5fhBoZY}q8Kd8
zp<1rcYiHDw6vgcPJf&iloL!<n7*nfNftVCQ&d#wkTPL4an2wGgy8P_bR|q4WvuBrR
zwFa10j`7Gx%8c)S`O;;QYcZvK5vAlYjYdlaMW=)^QoP7xrs2@*c95xH)N{$1DF=I9
zCgUN!zRTL?A>;7~$Ff=X4mf|}5>XJav$@5_dW%x2_wf(YU(ia0hEUmUUzASKuS~<J
zWfqWjR9Ivu?i3-CX)i#ard^#Z9T|=Y8Bz(PnidZ7k>@~8rw-XK$qEyZ2s9<pr@DKQ
z3M?~25g(19vkTMoSIEq86(<Qvnxg5MS3yd}L^l~Gl5w2khcRIk6Qv2U0Cb5E8d7Rm
z(UgKlifNjxuWxhn&I4M99SqAR&XvfAAS0i^_s|qLc?*aM{4utz)2LQ693-F*V)FSC
zvq^>Boi4*s!2bS-ZqLPaNBCaCD2Pei6qJc7mMBz;#7dDy8i}ccZXs<0GiMR$ioBEK
zL}Q-Z@@di}Wss|JtLrfs42eUZzLuk;nv{wS3Z~B7a!C2q4$j&t8~5)r*xw=WT?#5f
z8Zn9#lFR@;8Kx+yV_6Q7Vd05@D9zG#H7%Q5Xqu4~b~4Fi8%lu6jtikA=`_G`y2Gcy
z#B8EPk|IQmvJ6PWX|eYSE+o*1;*gx<Fd7YU@_7cs9#TsDFhJKdbX`LtiKFa2mT`)v
zt1Pt65QLFOf6_saqMKmY7IES;_D09D(@RgC$9Dt1_uv0_Jp23=KK;^joH%icw_bmj
z`}ZHRG<%Ai?a`PKcy3G-X21lc6jm;mo!fkuAo6Incd6DLe(g8D%IfM0y`f91Jz=+X
zNV~m@HyLAUCUG31q#_7FlZuj6#I}k!`6|Uyg%zVfyM4&DYd87q7e32yG-79UmHYP|
zu=;S7!^0ksVp$f3VY0W^!V6*?%c40q%Vg;C#@lbQx3kOQ(n*|RjXQTA;!YA?{LGhl
z?$a+~7s^>!msOxtGzfwi$Enim^+@7`!1KtNIZiH};=}d^FaPvqW@--AQW>QL8iIPg
zi4+>PWwE`n$z<YT7#2&5CwcDKPcy%;z|bAzx-O%>i=jCbD^;Q(hEyP>L7XNyP7%{I
zNz(*PnK({~LbV7YX5jYl{RAm>Y{$VTCXS;lC&tXc6|wK(y8$RrQX@)YqA)&|FBxW*
z-J_;WmCP@Z5`;dJv4<agk_(CSSa$kIe)_0$EC87%(**3JN%zrtVVX4r#AKm;sXU_d
zWL^}R9!(cg1R9CZNJRuPM3SN_4Jj<*D1%ohT_9zIMt1&51n8CyDuyINgk#ok-{+@4
zeTN^v_6}RSJNTYQvsPkxxk-|m%&uHwtCO-9wJ=LMXPZwkvwVWt#S3iT_elebNSOrV
z7FyiFw7yO}hLbak>>qgKyojOeb8B;px30dz#O*OkV#<~v@w#-<5Fv_G>p9Sh9PHe}
z$%9HIrQ$q(sX^IZ#MWjo(gal)GGF!iJ5N1<HP|Kh#90nQ!H4g>L392BTACu0m?Q`h
ziA|+gB${-%{YD$R^bBE;LXslG0Ml|1s)%JQQpzo$7b-}z$XGPE^Zq798+K}Ky5kms
z3Mmw7oR~jJrIa$)P~>IG!Okw0WsxtHXv~x`O@T-a(nu$f5vFG1M_xutR2p6+xwE-R
z99Ge_tf0%~3MkFS4SZ4+k_7_Bl$;#87%-L)l4Y`~IMX%6|4I+dUtAx%koeOd|A=$v
z&N4UK<len|NC{!!v%c{#W2VcL+4*^1``OQkVjpkZ;qxy&$L{(D2crSWaLkPxH$c}g
z9UB4My>*Mco#Tm%7ty4^kF$ztZ?8odMmSEMe!s`z;Q^N~U&b^|4)+gmV|eo1MV@%#
zDHcwj!Se&ckw>q0NGVOJ7Yl@=9@=0;@4+6kk;$pW26N#dxpNnpDa`U<Z5v@~C}pv`
zyU(55cUgV7!MP`&CX7N<>QgCZp<0@*5r-jhlrZdd*j&BGFTeBx1xqqpZ=gv<DAH`?
zeR!Cm9`%Ircua~QiDUZxA%X<UvJgVhtXHv2L8Y804FfC%GEGr3>(ougBP!)GX%u59
zjn?iCwq??&R~c*2?e}p#Khu!P3|Xmb`ti-^{QL=i^S6GB>({Qay|qagg$#znjL)qJ
z_In3hzOX`+H1Go#sR@de8jDLO*xqTQ8`~5L6^6qe+uJ)hd7aT{i0fvF)KL^OnYh$z
zHBK%rWKs7rVK5osdLt}NVOu%UC}lVpBEkg6wAmT8@J3?_j)mv?EG;x?R4c5nZgS!L
zX_}1&<|i;nC`Q4N4<bE6lJdxuMrNu$%633yk0gnYx0Na*IFTku#FW~jfyg?ynyyf~
zfz))Qrby+H1si0Npe11I29BMh+v^dB5l%6W=lg_Va9n)EX);ZD)`-FYFZ4)+q+HBX
zD3ytnM!PrSUc1W}Nt8xNU1B;Wc0NbW$&holX_Gf|q>-TC8)2F`_OHIrcIOZ)U*g;o
zSD0TuiR*e)$^{lnc`QRPJ6mBgJmlV;>lAWu?o6G%tqs=K*0^=^4&_pf3+Jz(RSoQg
z8Fq?8c6SGKdmi1MM;c5RYZ}Tf(5TO_u)IK$hD^LkCX*V4j6xmhSo9`i4gwd;&SA{X
z5hn=`h7**oW7`Gn$_yKk#;j9i-%Bt;m~SY~Us&esOE0o<=OG`w{!?yVeT4_Bw^^R8
zQ7JfBQbY409A#hxB_tw}j3*xb@c_-zF>_|-^UyLpE~!N78p==zU6N=5G(jpeiIWl%
zg~CV`8VZ%@h&Uw`0cqls$~Y?;Kf%f-Kkz`p;o$+grPJ$ouyPqvH(zw{J(n;Jv(JQz
zA&m&*7(dF=)eTFLFPivaKokWe#0U}+5s}I)Gh}mbhX)VWh{BLB{L*J}oFd!XJ9Gvu
zzVwyPvwwcb#)DmM+`7&B<{nR8d5UtSPPf}fXd1d{G8$(^NwZmFad{rsAF+S1O`Q0w
zoIb(qoW@H|4W&u;+imXLyusS~DsdE0EEMovk9ut$$8i`AC(O<)F*~=+VdpCU?4N&+
z_dfcFVkOUTG+;7uiNY97*NEZ--w$y8m?(}wD*A&l?alzDG)yZ`wK<10EVg%BtgM{p
zTUVau)ald2sbp)nP3$Kq-6Wsaab2HYx5s2S#5PUxxg5Htm`nyZwuv8R=6}!gFbpGm
z4pBs}*Q0Y7^YFnc&prDozV`KRaPiUw`hz~VZr`TU>rpP3C>C<WF$@Mip&w$K7M5d>
zrUApzgo)>4+a{hL;`$MWROAXaMNJSV5gS`OR2DS+bVv|pzM!m-GLF4Nx~?C0=96jD
z12_(CB!wi3Gd!*oD5)?leTv5Z|L00ckCEWV%GK%rJU)F;z|_W{2~>puksNy=j_}}8
zq#zTd%sx+XGL^0hi7*99W>a#R2=avz5h-5ev$?&&yKlY0+b{o&Tkm~@9~7uGPtYvS
zpv#!?WI(6qlIS`OUlL2jr!QRO`K9x`__;69L-6{C4=L2j?CwPzPQWOxp!71mo}jZI
z(B2-fzTU#L@{C7Aws+PE!VYobqVSNxgd_<Gg+gi;ekAZCjasG2iG>o?>N3rh(|DCS
z%X61_{|8qw(*QkgQ#5)+yCV+PRuSjsIgB-$)h3QrKua_F({K=Sc<2!XHuFo*(Vg@O
z(pj{yfR*Gp(OjZh(kNF>V3^A+pTEe#(B;<c7PeETR_ycjFJ0o9C+2C+mDt?v^V(Z?
zc=Mf)SYLaWPU{-=lAu(`Bc#H#Y;ul66o-UCrV!B3Gw+m$v809P2RvL`=iGdaTCIkz
zL8Ve5j3S67<w^}DWp-bdf+jP+QIaH}WdWH&2t@M8NBLJ-AG?sabK@h{*Y5M{f9*Hu
z_V$TlpD2cnjWr6T61t^v^}V;*Kj<+t+awHqw)S?|y0^-Fbq-A!92_2U{)r3Rz5jrm
z<DitHn9p<n-aQPZbM@W#ICJ&{xtx8RlI;6FXU?3Z-|y3CG-x)OeD}M5O0`fTja>f5
z@BS^$oIB6|^7sE|)*jyH>7@k@?mS?;w#qZLD))PP6eL`J=4oasIbPpu<3}+M2m4(A
z;cZrL-QncPQ>>gkMeDFjr?pKkU%=903|&#Hl}O@<et(SAK;<<CISt2<l$|1r&3Ssg
z9)&^y*LCqd57RV{cTT<0pwsDa?b=7!mc<j7E>f#ja3>>f-nh=VKVap=2}a(CTC>U6
z3y7i!SND*Kz;j)aIKj3oG%ZK2R3V8X_V?T9n#oLa7TYo?I0bCeBJh2NW0%WMe+JVk
z;uI>3CijU`!C*8*SCYB;8P2Y(WaDK4<w}*9nC-nb57#!S*PBGqI=w*`k{BnSXEF&G
zjfPAn6NHfXo=>q*Ar8SbEjBmS8Mz~LJ2P}ADdY?b%P~2<avF_<o42m<#Kj9NEzQ&K
z_sLl~0&l{5S3hK~*`!n|)85}_G@5+e!}J%nlF&!QN3tSuEJM<SL<xbEF-mACm4(*|
zk&?tdS_+z`uuX|=Xy{Ur#1SIRzF(;+qD=^t22!O6l_F(As>C!TF2T?w1>MTR=E4b<
z28ock!ya**P_C2-!Ys^5(@Z9QK+ee+^s&&WG#glj0-e#2js0y75`|u>QnGX83ORBm
z2P<!(3=JVt(lE<Y@!}BM$Wg46_{oo7!4CpTl`@)LAYU${=Nz^U4%lh$usq-3?3raA
ztUqL~QR10rp1?8^Y*TV#xydU(`96(Go?_8tbL|$EQK8-IQ!g%JDI1Ztv#E<_vVAyV
zJm}JL#|#Et3{zn`Cb^=6rt8FU$iy8{u2m75B2H6M!@x2uEGY@Xh)I;-PeM#x<Ickt
zm3)zAB}Z#3;Dfb8<|-Ozmlk>PH-3xDFFwot8}IU+fAaen+k4E{YBUOEY^O*tifHd0
zK&-G#n`*v9swenS$f(yxBtxW7NTHKTiDqdSc@t$D#4;jPAf|y^`t*WfBnC+YDi%mB
zMcF!uIFi48a&M5FqJgFx^tv7FeAXCJmS8w`(KJOmO)%D!Lf3Un+koTOo#2NfcG_zU
zCO!K7F0Px&c7o8u^Icru$1n^MQU-$&^?H+?);e}R$9OVir?rLa3QEl?nw@8DeUq18
zdj;PQ>2~`WrEFTf&&)MhSe!*SHA*Fiayd^fZ!+k2a3>a%aZEn%aBBGkpL*t5eBb5X
z-Miepc@x+3@VtQ8*)qjajqiQ`PuSYp;?&8Lyzs&c<cl_Io2!IzifQMtatha-FzyaA
z(pU<kp^IH8;7vTDC}L^p1TTE%b1W<^Qmr--82Elfr#oQ3eMk_cn1)HcR^y=4V>B8f
zl}@8tX0}!#O=AxC_vv>J7*7V+n&8yAb41~Q(DiX$7eXUTri>HZ@r0$tWi-v;tvBE1
z_1E7Z2!o72F9l%~5(WXfl9+~pr5iMB4d&+-DCBL5)e26|raw4j;p8%A$ztsF8BKb)
zzDG=mbVG8XMWizPt<p54rlE8_qnZJ6k`M*~VHh444@Y=pDP@+IoI(_3xK~ZfC{IBU
z{2~waf1`DT$%aQ5S1Epe3n@UPkHoV-mm~2wU1_?FI=16wp^w>a6r>_06(NWaDZ^t^
zo+iZ<qa9Gl=SYGCO_+>E9v@x5#See{L*9J%H4fTsY&}P#ahj8-pC$HVK6vB%H1ayt
zQW>kcf-EhOS|v2!<=J|PPs=v;utPi4iN+(wNlaHNlH430v=sMaj}Kn`Ck#A+)Eo@6
zNVz(PZBHl_8<1)Y20LiJhn{MrhJ#^RC}Cq-63bA0^((*3<+&1<p8qUzeu@9-kG@A5
zct|3m&?P4oGK|q|8&N3p^fNE;`t?;R6`xXdmaC(iXwpL03QXLDyZ819%tK1mQ*7RA
zqs0lcd7Cdh^%55^oy4v#@kif#gIf>YW98!0q*4(Fpos{X9$<=?oqIR2%~{SZ&9SxH
zWisA?poV0?WIUl#ZBlR4v27C}1g5DUOQGX5CKV|`6f)bK<IL&P)N(%ge4YpQZxe+f
zmTeP+A$}B)&*$+&|2T(5DGfzLDkY>@K2wrr2<E@)`q+hpX6l?fcaH6?O@bh#R4(zv
z<;(1~_eeyFl{4w}y9gl&0*_*`z~<%_x^1z2&}MdKft8gL40=73lH9#>hZ84HG8&JV
zsW;eM+u-h<n>_REWro86K@gIrDRXmk6bgCXdh1QjoH>&{nKWf%eS=!FNURbDLCE_b
zyw8(!3$&5|@7`^A@DLZD#gzunG?&@<NB<k~uYMIPh&lK9OC(L3G=^s{U7<UkuyX1o
z&ph`WH}2fVFtdw!nj{2)$9O!XR%|jJjrp_p-^3k`xPSK!|JJv@g*$dJv@C}F;NXDa
zaG23ofYEr2=Wo&N^^sDN&ubiZI<#85luJcS+v4HF)ocXp<Pkz6XIXfjhizue>~gV6
zzuzYbQ-0}-UuHa>@Y*Y{QmHl>j|R-tXRr*7DDoMP#u*3SDe(4N@9@^!Z_{klXf*2d
z`$Li_z%)(rg@EC3M8VSN^@enZBTUmk2#d)$K{j;`4!cB2HVp|wpBG>J3@1;XWH1=h
zZXd9;)I`^HMuQ=q>#;CD&+5i1fgj=e9_}Py-1jNvZ7yB7NHOnF$d}ky+ag~oki;oD
z%jD$p61~F?GxY`=Yn!}x^?l0a^2a?)e_<;}fK0Ovk0G@w13!~DsdQTTry(K%5oMDn
z+cvYYu}CqJ2rY<7!jN#{W}Vr<C!cdTeR^f8QH?W#tc<6VCmubbnAq*2DMcKG6m17(
z84O2bq!8qDir&B_h<t=d*gf25p_r$(w1D9_L<nx&yUR|yO}^fsGCND;6i`l%T*1M1
zEHqO?DoB$sGhRoa5`|7mcQj!A-d!esLNV`9ot>pxEfXg`qj8`8y&Vd9jY9DvrkPNw
zSD2|4NP-c)!##XA;IP}HR%>EgISvn6ICho5&(hax^&&wWAw-XS#RSV{Yq!IsKV;Mz
zBUOsZ+vFxitelCaOAHY)SF2<JlCB3qgi+K`nobgg1YSTyh-M2K3uSb}Vw9wGT$jl6
z7zst>n9Nr#tkNlFo-FX6KJ|G%c;i(*{Ml=?R@*Gq8q8N3n0iDobdgDlh+^W<Bk*0~
zAVQZqy5*qcG&3hiNdgU-(@Bk#SY^{FrD=pxC&nO7P4vV-OC=%}NIxZ&$*~9Kle)UY
zeJtBR7zsl2DO3$iGo4P?f=maT#Dt-T=S9SEfa^|}Oh$xZ$jI%nx4*^M8#3`GK#FPV
z=(?Wi2vv+UBuk6S?C!Skf-ytC&&e|<*x&DR=jJU=EM8*lyFA=l<<gZWxO?{@c9Q4P
zl`H(o4}Qd*J9n9xondQto1gw!k5;RPlh-(Zeu>$+S?pYylP9i_cNDQ{FdB`><#H@8
zF7o8%D}4L64Lr}|_kQp9_=7+CXAA}dW@l&l_P4*y@BGg1(3owowZ4k|VV=A9ZnM3$
zLl9=fuHnSRop>a1!erue*dGuC5i6(9^0lvjlP`Vga|97=Y;H2_POvPCT1`hNjZSYs
z7)5AO(ySG6avG!22zS)upx>djyUpJ2HoBC|H0zvNtaI4eK-VCb%b{r+wq`(@((iQX
z_xr4`tx+l#sWloD%O&#pJgE@u?Co*=`VBNqWnK;;aK~eYg8_l-k){#VN`X@+mpFUw
zB-MI}#$1(!Tm#=9((1I>+1;SkY2$chG%G>Zb#l4f@pB1+;5ZHb5h6KDdY4ijBa+or
z0(g`le`L)5B!5m+nvg{_K3YHba?+!mB6z%rc>HT2GD)oxM?Q#06AU56v3xR>38{!d
zL<o`P<Y-EwArTsYj_VFN*gWL**WTyHufEBxJNFQ2fSr@fH<lQVBPOXsqSu)8_c*t_
z%v0y)dFnHtW798kAnJVZ{%w*t#!eJ&cf`r%Wp3SWQ7<&u8Xb^Gg=X4(u-+o@TjWg-
z-IPpRpCI+=^aN4d$1nl{Z$QCGNmUJ<0!F!tG$Opt9wHjkuwy=VdX{AMBh=13YX|#?
z!9GcGCX;aKCd09YZIy`TFEgHKynpRFySrU>w)S}cqq_|Iec~j+FdZg-pFjN0_eg*8
z9>@|om7`)oLG{riMQc02Yqe2UjP%nZn-7+qV=N?blHe3d<edWT{RpKSBuR=8iYSW7
z<xCvQz%-0$BRw-nHyRBN_V!3ZFDtBtMj}FXTf4k_HDJD&P=5Y0^?H>;u|Ta>#r1u}
zw9qyzgESq2kVH|KNs$%D6D+~UyPkaPLgLfUe}+##|0&*i`)!gWA!p|R*xcBn)9G^Z
z%o!%b9!{>pLbJ(J&s^fwSAR@z*r$*y(e8E`PbTQP&gR-G#cGvz-hP|SwGFOZdV<#O
zE=io=dmeEd^YY6t({8tU>Zzyr=}&$_xl+NlZQAVvoV?BH)2BFnW`&nudj-!ANrm98
zx8CCH7e0#!TyzyP+}ov~2kh_m@Ha>7HZ1aA`xS2Ay++%c5TueyzDmxqNg^L5Q%)`}
z;JRaqg*<5-u-9r)uysnM0;{VJ+1^~GoG-Aou}%_27*n%n6h*Y#?F{$V?V~h}-JKnh
z6zYv8mSs^cmg#r9xb6hQRCIcMS_eI}k&b5D{J+$_*{@~UVW0P{wddi?=gzn0vFEut
zHAOZDQL<snj-)t<krzdAg5)83${%4P&PyI*1WANMu>o5!2Z^K@QJl%1=dSLW@2$G?
zaOSh;z1PaazSSfpBY-JDOfTS~>YiJ5frGR5IeV@3`+c9^aA~zV3`aW*M=?pFFb$L0
zET^gp{@tH`ogfSmn0Q{uLVtl?yUFg>CRrA9W^I);Nl3GtqyRtgaV-nqaadaD(`<yS
zEG;mPVrG*mr=EV2_us#P=X*4l7Wj)l{U*;m`vgTHnM`wR+dx_xAv|o`XEd5|{rYXn
zq9RM{LbOtf#~!+hWlHXCZ(#~a)A3kb@W|7csz@=UWICDQdI5!o`&&C8G&@_nJo?B(
zJpb&oIMQTmcZ)oSqod<rb(;R#M%%0~PRKmAt?E96cu<0VV6N76QIPtmvEi9$UGwA}
z%fdDcC`&S1k|&ZXH}O4>70*1OZ-A5vVQ3H)>crrzfJ!SWOCt@)3x(@xv@EIe0&Q3n
z`HWI!<SIv3uzYqMuiGY<29qRV93>300u?rJdkeG{7ZE{#aBM8QHgKyVM-?><$vWwQ
zIF?B=iP*e;16h{DlL;%G9%t6qa2<o~qa!pGLBqwcCAli-FZQW)#bh?aq#%k?-hS&H
zglVHOFbs=ce}P6LL}`mCnGl*5i%TuiBB#Q|@O`u)*|(rbBGM#64W`Vd$0V+e)d*-f
zCNfQGSznSM@)B*BU^<vZiK`US0NW6_EtheWGnq~ix}?!;lRAQ1gM{tzoUU)P(q5(6
z@p<TlHm&|e?!EgSdpB=zZDXI7WzuzBY}=$Na*8sABEzT@h7yP@1u}G5Qc{s80v!vm
z1*NGGrh&9fEW;ubHnw!Iu`n?~NUB7mPhuO=`1od<+@_)|=QzH@V7iTA80;O7D65*{
z6-RTTWJZ=Hbukc4o@XR!LZu3Xp;4kFF6QKAj+9_Z57X2bW}WdcJ;`WxOeqRXThd+Z
zGEJtWRf69Q*c)!q2>N{b#pk$ldxO9KkG_IZCjZZ0e2-6m{smrm@$>BM?xV{Rr7Q9x
z<@W7cy!pmml-i)xv{3q|7=}Zm(O`9Tl{06~5e6YgM@MXIY!EaWyzs&c{NvyKUB33U
zud%(m%ge96LYik>ym*l-S1xkq+<DR>$F_aqG-DnmWV`zu9*!7ICRnD+=fCg;KKt3v
zapA&68qGHQM^mQL8DOAM92_1p7>y~460Kn}pRu=pz~RvWS)QU*g=I?m?G{(g^|*Sj
zjcG`-BqmPhEG}NI%i>X7pGatdV>>J_uh8%IF=c)FJdY!WgAqqZ$0tBJ$(1WtIXXUO
zXa9g82u|j<Mo9%iVfhvr34i)$|CS)MX?8tUPc3rs(iz(Q2F;$!FqI@(jHwisZPsnE
zlek4$mZWKVLOwGvWc^-hSr)GAVB1a|d(xUTPEHKU64R&`mYy5@dMEqeVi;0?L~i><
zFVRQ#A91oEIKlQkxEK7T?`!L49c_BBm;jV6F;66^f{HrlR8i>)Lke8S$Iw1mTrnIT
z@!tEd@%rmO<J#*t7>-JU&MJ>T`Uxh3ZFaY>6OHG1?KQ&AI?4!f-6k)7`L}ueLYK~&
z3%vH-_sE;A`Y682IVemzYmf8OpWS79d(7zWT~b-n@2!%m8Pj5yadL|+JtB%S;>^Jd
zmsmOD<LR97aK_=$Z7f+5cvn#7B1P3Ai3U`Y2|>HStRl>G4$~1A&#W_=B=i~$!oUUB
zp)@^m8r&PF{BPfXn`HMEH@^DsnIr{CX=1r8u3UW-%ho7ak|i1YqXF?OK}esT=i{_p
zR+nsC;HgKS;KSWHtth2sgvi3cwIr@5$hE=I#OC&n#pSCP7!S9ZRykEw7YxI&f#;+c
zQqyP#*mk`DXfy)CMgt-0h>}^~NT9V~GMUnBp5w_U&*C_OJS&(^$An?PJerfFDa~dR
zg(68(OtbbK>8d(8jXEjb|D4_UA2ojEg~T8J;eX9^I>wMD=g(avil*GVe~+qC%*Io8
zx9&3=4KbC$?*03G_`zG4mZsNV;CM8q8MFxlAJ2CwiX6){c;umnSm-S<olZD9IwG3S
zxpQ}eB#D?zCPYz05CmL%|9viBxx&SZ7i;2&DHse786F=q84mFspJyI_n#;fOBGVh!
zSX*4c4P8=OVCFH&aDvrnGHV#z-oC{wGf8qVJRg-+EUm2(&88<iVI`Jjl1EcQ-{th`
z8hH|+1u*~sAOJ~3K~z;xlqqGFpsSqi?fd-J7rw-kPd$O5O^T{uFgRu~7@Tn675DDl
z!?JCHuz~COblOcCfkzt8XtkRN!=%EXy|m7~ogK`oLijf2I3s8*vVccbWO%MetGz^)
z)ePXGD)2pv#eSc3I^p%#-k{+-c#g^b{sCdw;HjrCa6Fi>vAIDS&u9jxk*Xq%=iItE
zL?CE}0XJ{l<?!&BW~;++bel^TE>S6ijeFbJwm}ev_>O~ZnSA)cbyikZP*rt8#;D)W
z8;y`wr^R4!M5o`U)SA4kYAdTHah;Gxr%k8TVS9g{AZ#K=Bl0XGD@(R_5BQ{EF&a-;
zT3X^$pL&k6{P<Cu7JYe=bFU*vhNy4)Ov}KwOf1vJJh324YDBARJ4nEi2A<>KIu51)
zRTikC02HQ_*rs_xdjcU(%6Dj#sJj>njW#9PwyA`stW5H%AX7Q*riE|<CUJt_@Uhx0
z3hA(X{vsc4Y;iD+7{&=vp=d3yvb?Z}?FHDrj~%#3QzC?}V+>^hy2OwY8-WxCR;f8S
z9&qo*O&YGlSPD9gkY1<7D2W*ij|f7SrR6q_z-I4o564+$HX0yQ%0jzA7U#VB`df6G
zT{I@9<#OiCDq5Q~+9r4I?l6zXbbCv5dM<G$z;?*X7E&sb*x`7fNe3}%IwhYA%Dh3@
zZIg}0xSo%vbRCh2VoF&cgv5~&X=*5QhQ}j@QA}DE_<@HJw5SZhY(C~FN*Lu3Be{1t
z;QUgbOP_p^vlkxY#%n+1`m1j-J=i9XW;87m-vm<%LeD`efzB0G5|ft|h<ZV&3PqVK
zR1L2|n*wPXl%_=~ObWxMlokdCU{YeBrFpVg{rD~<FcN0-G4n)o`|fQ7ntNNDsH!4P
zBTyA-o=}wquJ6(a>)mN#fbAMc+n@rJWg^Xztjw6F8PimO(kMV;;sznUACeb}Jg+z&
z4ltyN?V6lBf0o%a<=){<n#)Z-xcx3dyPUgnj{Thhy>6cuKKmlC{Oo1kefw>)EMcLy
zM&}a?giW8S(8N)OZM#^OLz<?%`_`Kr9uKLi3g7p+_Q3}{`uOAg(I5R0U;53j@SX2`
zo0ndGi9i06|BIECWzL;DOW=EiflpCY?CkEdy|qJ{7xa4zJn_`C{LVl4$M}tqR;z^*
zgmf2d{M05XDkh@|Wm(b)U0k=%@o>PKZ@tCOUV4e+!7)qAi=01uh9K~9EJ?59VF^X2
z-RAOzvn(twU^+JMUb{&YCmikWv9q(oY&4}RO4Nw}&M_^Dq9Dt2EX%~V0@6HZ7R||{
zhzc-lhd9lsiVVvD!!?-ABR010aXhssg<_Vaq=S^C8c{G}y<Ei$TozV3RHP`Kk!2-C
zF(o>Qx&0!xw5rrcw6BwWb)cqV8Uk#~LRa<4g_QD_<c=T5VM-{}3As;-lh52=-Z_@y
z0lMQC9{a`jh7-7z&?P)Tg`+Tqz?7g>y-=3IsCUn88$%k*M=_gs@9?AVzr?GrzRbbF
z2BnHvY_AbCdaRwgf@N5gS;d95Q(U}siE!l#Q_*K{e@;;<qO{^*G{ag<>9m{N8xJVb
zDS>D5_SOzR+`PlxRMWFUdhwhvu&~mE>3qQbjaSg#7;RL9;R5~Tb(HQPMGIS6EO#|(
zRx*$FF||VK3Mp+GeuK09t2kBzEFaZA1Dy$xY%{kl{Dt#e-#X+d&gj}uWfjN!hy3Ny
zP4sk|O3jE>g~p?0TL_V2SS5LxpoONhxIj5CF-#k%!5L>yKSVYipvwguvxj9wM6;M1
z_ddXHbjhm(!wq=-y#qeHGeCH+W3^mt!y-*{48y{*9DLuvwZQW{EX%}kER?R8&u2A+
z0F7aoWMxfyd$16^e}9Y4l{Jc@0BS;89SQaDT$dzEX*4Watu~G`My6>U^W}t+qBTnY
z9Y&kxvpE9E`SX{!eEBLxkrT%e*RNk^I6P!y<2I`+OZ2)cblPo{Smw>QUT1hbB+WES
zi>u706W)LSUD~ZS)5#RaIc7SY^7_lKGB`NIbzQ#rr5EvipT{11jJtR5a{BaXI=vpl
z;gBebI66AO^bKBr`&CR+@$@5)^Vnlglg%UY;{jW5yvjn`Lsb_3;#m%NZ?iW%=Ilxr
ztG^6kn}fkIv#i3+GTdlNv(sWaoncrGk3RYcaTH-;akzKD#miT*Jcl$(aGtUG^5z|W
z`lBE6xzB$V!!W7xl4u?=9*>#LW(<Zy@{^sER;R<l;vzxNpw$R!^KP2pdM)B4<=Ty#
z#JQrqbegc!=lSP8$-Ucmm`uhz_t4XvKD9<PoAHyM{E(-fdYF}!MZWsAui^$ie$c>`
z2B%M*;q>YfjxE^T-9pH^tQH0_7tXDN(i|V|5&AC8Mw3PuB86Z+k5Ecbl!Bd|LrTDP
zL(X2jLZj8@?YBRq(^+6T9<#r<N2}H3i6>St%@0v3N9lqj&6vj%_KsGGW^-=dxl5zf
z#&#SW$HsFSv_g;jyF0x5-uoOM9b-5a7$${EFdYwt;Egxm=IZ5(n5M~iGGRK2e${FE
zYa6H9ZXIP3y3XxNS?`?L7OvyqxE{7;);LRP)Hj4eAS#VPZSA#8tKJ<dC1~@+atmY`
zABl&A{)I2~5r<z%O|B~v4Zh=$O(T?oR&NEIfJr_g=rm|9ouV*3#s&P<E3aTS+H_V<
z<Fo?0XV0^I>NHB!<P#}0u4U9^?*c4CV_;(&2DTE&N;5ecGT7NCoknP-SzlUVd2s=)
zD@NlXd6luyU1WJ>fvQN@Kip?N9Z_Tnme3UG0u&iXM^nz7zC@$Z!4F%sJ3X?j!uK0Y
zrV)eDgeV@+?lj2;b3`R@TtU0((h4jrqvDvHcnU?DLKHDSIAYrF;w&x_1|iaNi1VDH
z%E7ddrb$s0M3V{ovpHtiq}l7?cmZ)zprwJ~bg;b+S*6$*q%<v$@y3+Hmd#_Q`~1EC
z;&=JfXTQkL{_>l=|H_ZqIohM^S}cYhzU^ZIxlWl!F;$-9*fxeVDbVPuqAUdnjnW#e
zN~)@;Uw5PSbw~_^u#r}yrlnM%KE{!a@BZM=$%+iEH1lYR5SlbgkV2qjL8BSsR2ErU
z;dtQs8m)8EEFnuPbSB7DSw~tdiR;wP0EECc>ucuTy&b}C1JgE0i@JnwIxe<hQz^~0
zTW{0p^tpKT97l%}UVHf!W|M-;7oTKp{UXUM=lkFLKARicymzf$?5wY@vAn#F>p0xq
zxWn4&3X|!GB1`FZJ1i_LuyAz5&h9?*dBnMM=lJF~ze%^-;rD+3_xXpv^E-4G`dq*9
zAqNNh+`M%Y$8qR%+GJVI;lVLN8a(;L(|qoWU*zi5hnY-fv^rh17TmkP%l$2=RP9Uf
zJr6Avv-ybmd`_V%PMu!i+2S$o-M>d!B;2|64wK1{v!_>>Ep#~A+os53Ru+3Wu0^-E
z$|pbf722IOu3o&1Qi}O#!tVACcW>Wj>)w5K_x3S_Bn+DfDVWb=M&k*2Q4lmj3IyY5
zPFdz?Rbto<j%^cQBZQ>g3s_t4vvz8M^)r1OUy>FRqI^bCCK!&wa~mk-QWO<Rl{Ma4
z3ZyiVM!krryAd^-R{=$(P<c(IG0-@Mi4ew#GpF{rq-pwVoaukNA*s)tYIBc1vD*Lj
z>t6ni-Q>S+DSm*V{s;gfG?r<gs_Nu~yY7?dN-!Lc`QX}z{MpyP!>#MvNbL~%E{pv&
zj)yxO4W|g(r(c;=B|LojQ9k?RX+HJB^Ze=e-)3)6P?ZHyG^cV_8KxD34{mbz#wNFR
zXT+JNv^-oQRJ=v2G%2TojlBV@s~4%lGbC0Ir?bRTx5L`fBI{=!C1{;v@33MvD=FtA
zo_YKc{@!nVnT^}8bM5*o9FGzl&*IcVpa1g9FYtrc?(o`F@_rN$dJpmK|KoeSIXNaO
z3Zf)uX<;2h6a>Yb$@~!CD><G;2*bn@CQ8>QUzI8-i-JOFT+in-FZ?F&ymyzuaE7TM
zN-gg16(nQD_y5JeVNyAW_A-(b+m<x?9zqHn*JqxUC~2{~w~L*6Wb>5s?JkC_DRqXS
zu<RORZrc{7WrBdwXhd06b$70+>OQ1lBV@{aK1Xz0G#U*==n;ltJu3_Y)3NY8k4o3q
zLY;`Hd4M(k9fW)kZTdSbTi3^Ipo{Wk^`mhdkLRENBtlda`3zkdMDv^?FW5iY=G}MS
zBFj>ADe*mz53gV6FaF|NJo(JCZ0+vQY_;)RpJ$$YiZkn{_}W*$hSoLN$h0idH0A4G
z|2m%M;kqsd2L}j4)R{=F`0#^ky!O&7{Bit$A{FTAgs0Cg^TdVc(N#>WX2eTtY#vOA
zi;B1Z@+VyW`~QIc;wniJlSd=0s$^?xla;m8j7I}hkzz}U@4GB^&tn;q;c!BKp~ddr
zoFs~AHk+I~a}KTb$&q`B?|OKiS4Vilfb~<Sab1^6RWzF+zUy(cw~uE#WLb{sI2e|T
z<A?MYRw;$e-oc2;B;n58Ey_}0x&a4!J0u0{4<?LeG40+GLgZY(b(g0exyn+$%yc@T
z%p=<E7NhBajg7lBLyvYd#IbBF%f`@}#f1ed)1uvKqm*Jeo)HF3Iz5*>ugJ@agWUs?
zIH%w1asJ!|qS=gnZ-@2MtITF|CX*@seizd;X|)<Bh)WAUXyCXmp6?UK35SRK_^!po
zwt49C6%1iApQl)kf#bPczH|}Wwy+G7Q!C4ij*b})2E6<32UOL^kJ@y0v0bA&^+`F}
zkac0yG%?NkjlnoEwhBt5kT|AArAt&<LaHg0Miq)8&(KwcKx0}auJ6^F*N=ueSxD3b
z4x}I}3PwdjAuZYqi%8qT)Dmq<?(OVw?_fl9e~*PT5zUn|{ME~^^V7H9<tzW__jvvb
zU!*V`CTUJ?Ny3J}E+xslq@*BEQ?fXMs=~7!Lf^r+Ej($lb90lU{R2A9CO2+x^4w=0
zrN6YqK{O{y6T1B#%}%R+{)S7?Y%n-Hq#cA9La@Dc!07ORPJ4-7XO;D}bu7~)jw(#k
zq*9vI)n$@AWi%PmTk0XlWo?kR1(j!?9NRYuEJ@r7866K9>>aYdu}QDprWu9=L5O2n
zl$D}V1)7@r5~Uf#*$m(FXaz2z>r!DbnMGtu;`lz6W1}j_;}YRYl$31l582(?V9^&m
zbLBL@^9TQw&wTk)eE-kC!H>WF=Zr^(^c;_t<6#K{41w#~C(lWdWeG{1fNN4nMJ4MK
zCMD}zB_VVz+7kjPU2LlZ!m8s4ALE6@&AT7s`3^-{((Sg1qliY^CrKiNltkr>IGR(b
zvMx{x1BD{fb>Uc1>ysQqB4qu!RF(xwDKcpwWqrL3ha+~=V^)^eF{O!PILu~qq%>$Z
zTjXiR{rlV8yR(aFIJmCO*48~t>9WvU;rxYlT*t(+Ax|rI?(Op0t8a1j@>SMW&Tx3N
zg=I^cttLWN+`o69qvHW<t80ArpZp##zw#PC{P7R?`ZvCcGzDMzt>5IuFMO8u(<{9E
z%F7s*iEDcR1VNj}AAg2N9(j~TyUVScxB1KO{?9!9)Kfh7+$UH+eVV+en9pV$93HZ<
zxxw+#A>Gg;^y@j5qzQYw_qo4$hv{^L=Q@1$g-@}v)aUSEhrONq+_`g$B$^RTmx+^z
zyn2(be(U@AVTW$3MXTAO8HAY9U_PBO8I5Q(YxDGAa6}Zx2q|l)g<&(FO~|T(z;~#$
zfzmmarO+bB2rIh%23H?G%f(BlF^mFf7o;jBRWr2A@B)eBG^pDEHomS;S5Y-$v^ueT
z+qQ+24qBgV(wul%pq4l0MM+V`NFlLI3&S`mYMXxx+WoJ27=jZok*+tV1nB>uIP9;x
zCH_M{e(+gQQ=Ez-$21Ha$6-7ka`*Oa-hAV2e)iLs*xA{|wc2!BYh1bbD1+kzuHSu=
zR-@1POApameuTl)AR3Nn1QLpv`QQLY*4X0te2XNH`N6AiGCJDe=wOFJ<+x#&c`E5H
zp2bpAs-x?al|Tdy{7xG)Y+?t?RQZ74`t;}d<eK8qulxoFGsR#2;9XkX9tVRxgdNfD
z^?3H_3tT+=2*F~-*S_^Wp6SweCD!<ecy9}*|1AIR2d`rc6ATloAjdTXwkuJ|2pM=Z
z&5GETR6x*dVu}!rMUv%oJBt*BMj8&TQv-KiedT>9ZOqCh%Tq>0&bNQ~DxqZ}4HM-{
z1QQw!8>K3etiXsW()k2OjHr@1J-?#JQ<^~+&kJfOO%P%ka{}MR_dQ(CshvcoL6O(#
zj0f%%AqAx>3B!={=g)C=J;1gs21hk5wAF4?sR~L-QPg<;s;c|GP<Li(@|nP*jte6H
z4o@U3Lm&(T<3yq)s4sL~mi4O33Mr+c(X;_UyW8Zy`LF&v-hclZ!{L}RN%*U`UI%HA
z=Q-2ygfy-TB-h`6kAAPm@BRKi;eY&>{}T^C_9z!FT)=ic{`LR;C!9Nf4&My8dHV*v
zZjUUBS?MqE^3Pu8@aVWcrYRw?C6`XM*&K|R4o7s_ZC<~5$eY_oJbJFpAdh)iNm{-`
zN<l6>UjE?^(T2qz{<Hs<(R4ztDjJP|@pO#mS`_J&R>Q*)isAkNvVx`d5<-c($d)FU
zrbVe0X<nkGh3B?tG+Qhz_31BkNYa@1ZoG$qg;^<VEkJ5|oj!%WM^!;p<m^tj$&-ln
zGiS+w@4xg4h}!ZxzI6xJs6}FiWfHcRxW9ME<Zy?;QiPsKmZvm)pQaz++7_mKU^T8C
z8%PaOb38ht+wCI^gI24<<;#~S%Zi}U;Jx?WWjff$rlQyIxp?Ljo^2Av5td<c?#vl_
zy&j+_%7Tj*E}n?)5>^)btS+x$n<kEFGMkK$2s|v5-{Q45zfBNGI-Mp*hx_QVV0meo
zCmwm2GB3%?oJXH{@~_b;J|3eNxM-yjN}qTiPN+-L0HG18K&!ki4l0Gv8l-`$3Q)DU
z%rt6)t!cP5O4hXM*FVpAaFnkfwB{a|fko|dP_|3h?hzFwM$pFh1XWgX?{LCbzw<qm
z9q{_KTU1WSW1svi*SGdK^U$L#ox2QPfaO55VNyxBf0$9GIi69Wi`upu&u7R=(ewjE
zQ&E`?Ig-)wnE52a5GKAC(rS0GEe9bo8m%UFr;Y7-q<MiQG@W)AN{w$iIMQHa_a--Q
zY;yke1)7ZoTFnLWG-EUy5H>7kv*;sIi|rZ+QDK`BJO?mv%nFIdPzqNVgpP~Ug4tw7
zKAmy<r!TSf{s-90%h;VR!n6>!jbXcBO0uFLjx%gSV%)loG#!NLp-r1oNJ=RXmWAiJ
zc&^1x9@Fv#O;_WPG8{w<CtKWFX|vP`c;YKx<jRu|^R<8VzY<NRP?a=2hhC>cXxWr`
zP83C0Xgt%TG6aUu6uO|$C88`qRcMNOk*PI8WR$u@W1cJ|KEBZ=zZC$QEKTZuK*MKV
zWSDOK;p+!J*aq`>j`kc%%O*(^W<`Z#JD7&Wd>m0JSm?JfO_TkDJ?8V6POC?&)n|Ad
zGnpg^45ot!tu3a913=L4FEbs?>Gf8)b7z|}a(LqE6QCuBM@QVb@jgG;{w9w+a+Qa#
zJjC+KWsVM~Jo&`K>}`+u!S`P#&gWdbx<JtLsj8g2o409&9c)MPn_u|?7cX66^X_fV
zuC6dV+~-?=_En_F`NEgJz}d6Qw7Xv-ic3bvF(6r8U1dI>aqZeQ-gx8RGZ+l`)F+<f
z(z(;T@!C)LxBupLoqLWG9M|RY<x4DdTAVqx&fVKLxpQZOoxL5V(+NTd8exN0vq@EG
ze80_SK68c1c*L{MeU?{VdWmm;``g5EN)Y;3w#hsilEwwIX&oi*_xf0tNhM$s%_+-*
zT%Yt)%AEOZP8=u9=Q9+F?n0N|LW4;hb1*o@Yrtbquk-mYf11H?hq<|fG%Cs@!m&*H
zOFaw`G8&8+4Uceq7j4RqZh~#g#&S$VDVWa^q#<!k_veUn30l{k5Zf^kmSjFnaSXe@
zQ#LdP5)13sH_`u=LkL~RSUK4_7ANAc8mM$K{$_Mb!$+vx`g?Wauc;ScN<oz=hDQT#
zUcb(dfBX~P|KLM}HZg>z8FWYz!FZZ7i%K*$FMi@hKK-dj=$yI0%kOS8&myMPh*B9?
zUW;i|5Y1DzHwRb(;wWNc^FDEOfJufWQ<8Ct!Y55T%!`7CwaBG&rwC3j(K>UE<84*L
zG4zBlwmla2Z!z0@h~vy*I*l+~hpLQ7lL3}{3N0s0(*x)%kogNJr;Qc`rnG5z4z5|C
zbc8Z8L@`GlZc_<^{o$C^(+^Vx0acz;RD$i{2qi(L37%`Bm4j_IFolmQ;(9?LEb<Z>
zhQV}xM4>CJ&<DRldXl1?kQK+2Q-kgO8IA5)&UemJm69?~FvI~juK$2Wv&ncWSv&JQ
zZKs8l_2Sny9URZWaa?Sx-W)JZ6UVhNWbIayLSPyeT9!=a6Rv%5ou*i0sc8{5>P=nG
z^Xk`LN^Hj=IGH29=V2PPs8*fCWJLx-)fV~x*zqebBpQw2<Y-KMG?#yIPS<fO{R@u>
z`uznSd-Mqawzs!&|H5H+cNal@3>}TexPecr*`(EKar5SN?%cl1jSsK$)U(g<r7wLE
zRaGo4ED$zBo_*$N+U*way!#G^yZbn{hh;ewx<pzvy#vE0t-xzH*%=Mk8%-GI1rx`l
z)#;H}IrHNKq-9_m5(LCa!f<%}QDHjvJuaR<N3Yu<%~K51;DZmYap%SjMn?nI*Vjqn
zgw#nf43oUb>s(-*u)cnZR=Zns(Y=t}tsRnNPP^G=I-b>wC&Q%S1@!xUnvEt!mZ8d8
z4&pZgib|0e1&;3#1U|AVFww{=$F?l|Mw7rXFshhnw8w0IOt-bnbT&p9k~GW6vYKeJ
zva*7dlF4L(=Xo@nO_C(WaqBFe?HDwg0fXZKv+0n_7tb>qk0`Pj%hY69gk?+GRs+xX
zIdyuCMk8c!JmBE)fX&TKR#sPNHbWX=$U?7!(3*ayOWy0Svb@awd-oYmBTk=LWqoal
z*<{Gk;Q<T%9=_+XyS>MJKIhTLA7|2EB8lg}>NNee4N(;6lU%OAtP6t3ld`o@%j2|0
z3sK_}1xVXOmo>sq8WzH|sV#9QehAY-NE2;(AN@bY&kIue1i?`Wz_k&+%XBa#nQJUR
zATbo1N4vas?KYqP?SIJp{Y|!Z4(SZ%y!GL2{^@7FMA%tip4B<oaa1r%GLDZY6zLq_
z$gzZ?%yX(D#}X2Yj8QdXlnh8GGY$_1WNFECHsRda^AtrzoMZ%Hh-@_|U583QS(Frc
zMlL136EYo)Sne-kn?6~hSm>>xD~mjZG8d@QKr53pNw{}^6QpKgsZW-r*p7iH4FnFJ
zB|&MDc}yV%j^om9cjzr8#D2(RYnyB~1<S^j7Tu*q+T9*ur;QT^ShkHNz*AsqRljbg
z35G?k1%=WGQ{Z|Qu4|#mF$@S?gN6^DlOxIuRYpuyiQ_d`d-x&#+5hn0vv=(_$6LEt
zTC>{g(=ct~*^GD|Bc*}ky3Ep)N>}7nPElr*Rf?`+RF!~Aktmch$P<B5vPLUc)&JL2
z{Qvcsr!l4>$*Y{S$gpHZlEs8pfazK!MTW2~0<%e!CXDA1(l9Yhn|W4{MiHWt*p|U)
z95b6th~k)LvrSo;+_|xZY5FX7m&nqb!R{2x3|L%TLn7JTJYad{6rRzc;bd4<iOwyg
zG>9e%lhJ@Y9kaK0iy$azH9M@XT_B!oR@Qp_XaD){^Jm}wI(vg1md{*eK22$KJ&yKw
zdG3?X^Z4UeSzTS@x4!auUVH6l2wkG8oFD(_hiq=%<*_H9;LBh6EiRmYlv}rVxOww7
z_wR4>-h1!z&O7grBr(2gbNlv9-hJl{j*j<PTU)2yX>w|9g)3LDP!u`noPYf%f6ROy
z*WMisreTt289@-R&|9G2U*f&@KHyv5`VJQ_T;%Mzv;4-3zfG=ezWL2>a^~Ds4v!8|
zN)tAltgo+us+dJ{1PaG<N#hu#z;SG()OEb9C_ooTp*VYb72mhHy}1dl;NgdtSwFwP
z>C1}<r=YTP3{&BSE|ik0C`qym3Qd)3Tqi)<5~M&WMNt$aS%NGis!|kHid4plZ|B6f
zV#r_WPZ&aC+181uQ`ClZe(_%9<2Nc*p@l$511$ul5+^jOI`jm8tq<`F(N|N-j~pCQ
zW|&5bp%rmtaC39a8!x}jJ3svy$9wz8u*d03FX9?-{hjaP*(S>uuHyF25^EcwB$t=^
zoHkRAqm(pN6mf)*Huoly{WlKT{l@F$S&3x_^!qDNLf1F(?0`us5F$k9GXhiM+lsZ-
z9#5Y-&u6~$+YHPGHx4p{j2Yd%M@J2DRhP^P=r5jQeq)Q3r6qRvhKM}I7J}Wq5u*#|
zusc_g;{!Ubk5v`SM96;g660>p*3o^ow_c*-x{RiCC}y<UOH}EIK$^IwL1nvmjSj`W
zLYRu8ijaka>nxyh7fXAnyudN*6EDk2P^Ja>KA{mZoyAP^d(0^@auYYxh#){IFilBT
zWHgOBiYE*c({`y42-9FXpOF?B(ysd{+SZt^h3k8`wufc8$jSs&N6=7;Qdej#QI*ES
zrV+MqZJ&0#Ls`beQT!1ad^P|Dfck%#U`R<>6qIFw?->{(MN}oFsyDI?U7;v{r7qF0
zypVW64N&Tr5rpESpFemGHE}@*@e%jgFlvm|AN;`|5JeG(heu2%W1=WxKA$rjjnGQ5
zxw(m=qS0>BY&O{6->t<s!y&it+~nn#eoCv=;n`=OB?v;M<0-xu5alsSS6G&d5(d+G
zOlSyP(;x_aN;HL~DLuigh%sE3!^0!I(8IQD(!69m8soS=lktd)=g-n=G$`^0-@!Hj
z03ZNKL_t&xfgnv%{`tT7=X6^gX0th$yi4?Z{g3$0(LBQQeb(34uq~JQJVBKeTbmo0
zmO;aB&|g|0?R1$Q9y2^15yufvJoXrmKL1I+^W7g3I3b?raC38$v?#%llx2l!fGrfR
z&^&SVD(B9fW_fLi>3G6?bihvnxbfaw7>2>cix-KLn5xJzP?S}{WHQ6HZMxk)mSr=Y
z&QO)cG%fCLZIfjQgTWDT5}k0l0Tk2Olp@bjNIIQP%_Nsl6d6kS7^cMYT>QXed1Z;o
zWK5+hq-i42G&?OeH-;RK2DEz}%pk-IeU_IO*xb0qrHkh|b83xyn_JwubBBI^k?(xx
zyM$r*u`F9F^>gE}svcY;^@pC;f~r(?C!&@}peSpxm~Ei7pg`23B>_l-LJ5jY)v_|%
zr%)%BQo}%6HkNH8Ewj!$3Q(p&Wtdcf$0&;FHoF*sN8yY}Ws6Z}qTCKy6?5<I4wI-N
zD<rchM~@<e?J}6A#A%KyYx8MYC=5$tSuU30V9VN?t+gPDb4G(HMJWiwHcDHZIdg&1
zwlHi5zuhKuEapO!S0$yWqg$fXH2o%pnIcMoZ#P(8IE8D5h{`6N*NYn0X&{t=Dg;?t
z;x{}(ze$uvIJSe(CepIerirR*^SYoeUrO6$MVh2}f!*nl7A2<V)9ChCSwF?X$}+8f
z7r)uU4{Vwa^lk8|OOA#Ku2cV66;PJ-%VM8AmY(40Js-RfR0YGyka;`<G?nS_+~;0k
zcKHbg+dCBVIe}r)aXn^(QH_K(9HcOq$0<dXQ<Vi}kx>?Ns$z!JF+wF&MM{~MsH)yg
zta}w7--SeyM7VB^Jua%8GRsNR2-`7nO_wN&Fl-Yk4W`p6lj)4WZxA*b#Bs)KGRIIB
zc~Z~_8<>WV?>JD|6tP8_dsLah?0AmAz%dsnbIsiw2M8^3Js-<xuyuc*BGahSU~l&r
z-}e~}CzM6S(@#B3vtyGaGdjIBhU0Be0gpWX4Dnp^d;jT|`QA^z$==~T&YeDoX=_{)
z3N_<+xI?EG@Y2ga;@Rh(B$}u6msZ%=yho?K#1}sQ+qA+3w(jo{_yMO+oo0V;kG;J;
zvMgg^q0h?FB4wGgvb@N}OXoN~JYu2Oqtj_KpUnt7hd17Mld>#WT3SGBO%z3RoEE)a
zmu|O5o@b25BW~Wj!G|Ay$aFg8+6UKo>ZvDLT3TWr&)L}AI1#`(G=hM3v(0#P%y2LS
zRniDUk~psWUS@5RmZI)+g<%6Jpc%N#=R+)6a^b=Sp8NC@_-zX#6dWHM<9j_So#Wdr
zFcq1KKpCJEp4-F^95(iDBTR*DnJ2sMbri?43=G4o7tcyj6(v=vFiq>k)nuTQsx#!$
zsBga210v1GI|7(j<;mYpRC4M;!CamctOZ(&pGTLd@4+giD2fx8ims`WW@U5j&G-4v
z_uk~ajbq9zA}q(Web|rZOd^Hhdpz>c!+hy8pTG{zaCcPl`i=X<RYhD{RKno+cuF)+
zDf0|J^f?&rbG&na<0+DSh+9Cr-3R57Or}Uz&}giKGVtt#$!HHhm0VeB@Wet)R~~UZ
zNf~a>Da{tsEJrDmEn}6icbdEJeZb9)E$(gXvbnKM;D=OI$xnW=$Lnvr#lljLsI0Jy
zG0j%UQLOl1zVRbQi2+`S8c#7=IffF1?Nz+6%c`@8<Mh$Oq11{X40-s{d6Ia@Xg;PY
zEL0_s!p1f|q!3hPglQBc>6o(7!EJRgg-11usPY6Ef)X~ZW*^#JIzdRYxrSwVm<Sxh
zp%pIjnNNHP446calns(BMWb;;pQbNy0}sowu`CBmx>Q=Cssf=ETGR<3%dn{G-9(Bs
z=V0%U!EuLn$H%lRk~Ad@LtN)X^6C5Jd5-HCpzBJ4Kq7^SQUyYnXyfk?|N6ix`HMoB
zdh&{2`Zo{09{kKSP1K2TQUHxGq!9%54lQ*~xhzYPB;kW=A8`57Reax})9Lb!Z+rt(
z#e6mfrMY$EHn!pL)DutBYP1<oW;7a2w61?wqupU~{WMut5Ip$(0!&Y0cSF`MpJSXv
zbUmA97!V~fMUj!`Iiul_uvyXVbojGxd;`}qu?#_)XQX+~wRhg3)#=h~w(C;xctjM%
zG#U*C<1yu6$Z$C1^x7HDoIZ_KisA7w+uPfu^8`bhEUzuo^&7MsZ6;|-mL^n6Vd|2W
z3%~oHe3^gwul{%5{@GikSw^$fB%RM_I3}Nb>Ipnik_?U*iIT}=MBrLnI(MEbnNgJ)
z4?lc`B#D69O(3WxJ=5tFAp~(8Gnq^=41=TNqZ4L(!FW2PEK2gM_DqZ?V=7g!ySI(w
zhO|2!@+`x#9X!`VtCBp;n2g8tdp+i}8IDtnqe@lK?Q}RiKBU=gVcQlrZ`|bKm515h
z-9h);G{TVm{auQc70#SJ$7nR>{>FWVqbWtHna`)c>NNee4QV((zq%B)mG;CRp{j}`
zsWG^wWl^b;tVpm@iLfME7*tA9Xal5;wmd3qk`f9HwrSOsLc>BhE|wSII4;t%>YY5T
zDHT-Gz+XGX(bhJ(yFk$H;4jB4o_~@bz5W5)!<5Oi;GLJ=VCk9X+1}nK=xozX71FY)
z5ICkoGiYE+7ok#2tCr!YqCzT#EhHua&)2Aqz`!B!nw-BFVtD~}qk#@Qa?3^;5=&~N
zQ7@hh)5St!W71qd%XBctkuF!xU&YiGq1!}Ob-~hiOwuet6@vAZGhjlJln7y=D~(Wf
zaZDkRXgb{vL8D2U7o=H%+ia67#lqQhWMxIJ6ozFJw3=WV#A!xWjhW3X=BA`@H4P~+
zmByA8-A2V?2Sh2!B899pVQ5kmDI$wW%apm$Obr7i1xZy=ppb^a?lk7!jeD$i+q6B8
zN@=E}F|kt2lNjH0Aukyn4Qh^fQDO?PguqZ1mUd{m4z3ZBMkCT{hTjNko9*8yTz<TU
zlmgQ-u&Nq|tW-r=7NluHQRF09N*R^)$yS`8%i8p;i4Yn*CqQMIJT6g|#Poe;(Tw?Y
zif1?Q+!lv>M=bSMaov#7aLi~p!;~hj<C8|3z3pT6_V)?=Hd>pcX-u<GqAEcUwCQyE
ztgN-sB4sieQsfn3Ah@&n7N!x<?gc#g)MdW&-EZ^B=bywd3i_RZJGbuegCCW=_x|h5
z<`Y`YHqSrzJh$%L=iJ##JoV%!n2b|)cW+Zwn#JX1in3s9>mG(7dHU(6sH%c8Pf3!9
z@p!=EVvjF=@r&&2Z1K`dFOg*#li>i*^;tc2hK-F4%CaPEG-!k&v)PO^O*wVy6!ZC<
z(P+fN!UB^?y&;$98K+O5=JLf$Y~I_%b3HnpHincO9qltXIwsFDB$}h6BXm{O&<Mw_
zZ|tRk<<+qZ*R>cN?h?(${J+$_S&wDed8YTQwf4Nv7$@e4oQKM+k+Ue08rW)T0MwG`
zh5<Kp>jAL;fPHJgzA${%fMLToEy%XI-R`z5w<Kz6YT!^+WEHDeQ&v{aF^^~7^ImKD
zVxLSFTSfz-0MoUAlR!is1mc`nd!O}v-}}DL=Rf@lpZ(%ziFy%d^E2|YW;QPI*O$q&
zIb#F5GzjC<ZMB-IR8^78D?HIgd8RP|+X}5qjH#)roTA7GqbBW9*Ai1TUHOJ1;UW;|
zs-~_hloc3h7QVe7`6xb#%bKTp6T1M)$wuxf{vAe!efm%HP_mIg)m4rF-hJynT|ef3
z{hj}lox>TOjjIIxHv4xTvf2%~e*FTX>teE!o7b;#X=Q`6(}Lo7gkM?`LOvWBzW)b*
z%_!Amb(_KJB|5QBIo>1Pe~+0?@OuNQ?gq8v;d&9MfO#@S8HoG{55-z<8$}CWw{T0%
zh3*=|vf}b`i#xmLWV&EhTYmqCcPXc*?48{sO%uw>;JXplHbs<j1VP~P<k20B@6mF6
zvU*D8DQqSP{96R3!;Sv)Tx`2UE9>+wTtWnG;=vlPy}ko(3&*Xvu)fOAeeqKWsrlY}
zk9gztd+hBb_<o2s8rSuxDuXK&j*Lm?9!u-jDT<1goUs*MWo_LhSia7s%eTlneKrTH
z?A+O5_n;(H;9Je-p1;k{e*OxVuUz2%;}br3IN=Ze<l89e5(h2f$R`Xue82GrD@TI<
z+r@ChRk2tF-CmFDH@0YZ+9b)WVd+?yj3-DXDa#UL^fN%P5DF>Gvqryk6iU13|5xwL
zzkmHb%+}_|iiD>W$)}Twr_+k3|F4vK28MZBfH*WGHz5S|(>T+r0nbSxc;%Is`LvMa
zMb7T-4%e?;;llO?j-z<^;9ZoEND0I9Gi(i^=VOc^@O%cVOCSUXr>CsAAxlvgLq*VU
zGq|wE$#hI-J|<0b!Z@H2mNyk?6X#n~78ws7-e<Yrr{8Tia!beId@{!IJcJMo1_N4g
zV?Y~?MvO*d41&pYk?*YqU--fXy4Kvfb&KuIEsjr)Ihzc5>xb{s4O_IM7$F3c(TK}8
zZ}Ka@@MZqzfBHZ0gKvKq+lq*##&ZmMHpFBpRRQH}$T$A4AJFT@4Chk<&m#ytvUJM&
z`U<Uf8`t#-0v{<X4)z%eb1+zLGP#SKx@wBHx^8rK>l<t2dCqt|M(et<y?HL4=TZ~}
zMOkxjaEO$Gt5<!ZurV$AzDFyLP@<u4cifmV&jG<?G^Vaf*49@@vkd7d&W?}Ck{Q0|
z(2ipAP8TI4@4fdvckbL}eQlGK)pe3IM~F|JNiHj@XF1<hrO~=ZhzjL2B-pyH8$e9s
zn4&_FRwY`4<N7Esz$l-rf+Q_*f{=KyLfGn~rN_$hI_<$S!V8$CIj6%R=c6(6ETO7u
zj1jnwN3S0;u3b*|M(F(!2WJT@mv7=NZ&5vXgmzl^am@1i2F6%U4x5x2<#|Zu68IrO
z=uzv8vP=krX8NI6_`0n{X`rakdD%oS`T^R2E(#J|Q_Lr%5>hlN%|xOfM#R!#mShM6
zf#V^qq8GQYUPSEqw1NOr8>+k@t4p#xBP}vYU12b2G=(n7vKrrA!cl;5n|y2`kgkL8
zI;bcjG*BZzIpk%@be@uCIpgzlP7aSqvy7rB&~=Tnn&I9KJ>S6>HPh35vhzbW`##&t
z9hO@zoj}r#T#78As0y;GBCQRnw#;kGB(IqkHEC5-8naLzXv$=YZw+1F=VbQ@fpA&t
zuh5Blh}yxy#aABvR*SWz4jY4*t>uVo7Y1~eV&bSxP6KGOG~OCxegaYJ|4)|ZyST2R
z(h{LWqkDH9jIBxLbIQ7+t_@|`<g82SB8<S+2IcrDp)dk^y%w(YnVc8s(&OUB6}qiu
z^0Z<pyh6XbOrBR{6PLBY3L9%{Xsvnp=mC>)hVQosf);fJnMs+?a-{SKgP13e_n6F1
zxN&nEYYi)FJ;EU1(Zh#G=@VC7{J_%fwm?>_ulLy9+2Ofc+Z^ui^Z4;y)>gJy9xQQo
zeneFleCE?%WI9QC{nfYG+P;XvFrD3JJRPyOw?|PFoSqzWdU}i$mbxmz8U&i}fB*YD
z_uLIW|Jl#+=+PtAmX|p^Jmlg1`}F#KUVP;h-hb~sPL7WF`q#hC#>NJZA3x^&?2Ir7
zm`<k@MZwzYDrKJY@cw<42LsBYV5#534}6TSIX{~*o6Yb%2S+NBWRCB;Xst=}3{^Gs
zbtMIeg8970S1{OIWwqbtWN(kV-@4B<&zM&=M`syc=n}RJtxgNqb?LTST-@5C+wPz%
z(|ks^yEs&!HAWj6iMK#VfmUF2fzc92IcO^=@@9|tUUSbAqVY~Ogk}&*qFe{h|Kx>s
zJYBA8CK13w!`e`Y|6L_W^Tm$}32VT2n`>(SV4wfyzy5Ezwt0o4y~oTeOIU6)=v?6E
zzVPe((l362Gi`YNgMEhkXH=zNHcL1>IA{0KE~8A4>oy-eJ|R!XgtFp%GDHMjuo6|)
zT<i9@aOovl+b?ru*BG6TX!YQgTR+2aa>m`AGty~7I}Z5TSAK<8-+G6_#LT^G{LNcq
z-rd>bgS~y8oS%V$EE%(#PN=dO%9ahx(*Y?OK2|GgH9;9wiSIP`_~F?uwOgQC3R#6*
zjJH{iJN%=c{VG?xnoD2!5=p$tzx>0$roT48xVz-GpfU+@<gwB-_(8~xt2a5?uQ=Sh
z*U-O_&EBH%$bIFDw|V3H$JlB_NzN;mH~IC;H(6UzY=7lzl${m+=^y+Nr$dM$56c)S
zX9zh5laePBe)#4AMmSB=!}BRhm&jK{K}8h$_+E(Td5xs)#|<&hmJ|{{@K{}4WjdKK
z8W~*IHo-=V=exLQU6ZDbjMj0Q2f|R-HC8wLBq7EBx6-DvEdRZu!lzjJryp`!>t{tn
z1C(hhBq^Jo+S8)MaUATzfU31_Oohg<xv{~8-}+6A(cHWD5&Qdlbh=%NGUKDWcNh)F
zU~7zqK>0YXkLL>fxWzaB>ThT}f?F><$E?<LS60!U$MNYoK@f2N!2>o|*HKEcved_Q
zeDXBIb$v`#b9Q>d>EXe`7`8%|7rgM&OWeDA4<Q6ggC#b%x9BhRIXE~(IW9|sW&Zi^
z{T{C4Vuj_!=U--hbAzbW;nMX>%<`1u^C5TN{($jh&g0!Dgq@gjHsQkZfZzJ1pX2}j
zH~)qtby(|!O;)~8)GZ%Vro8^zw<xAl@-(3`hO#QDtBSA{;JS*fja4pRzD(fzlzBp4
zmCslYO@RlF@(?JLYGN-v-)~Yc!V=H(sq2QJk>@#UYim@MMkx<dAAx|`bjm!LQRD@l
zAJB?phU0TO{WiMvSX*Aklm+MG(K8v;<x3ZlQV>TW7dJMEgOHP>0~{r3w_DtL?lvdK
zL-M?2I3AJZ1#uMqq}%kTw&r==Tpyx|Ei7$QKntxGx<83tL>HnY#)(jIi&;J=NlNNO
z;{<Jj_JDAyhZ`@U;vUv-W2DbsS~ER=%)F@3NW3t@i+kX;$>($OBtzDUD$(R3BGoxo
zNLIJ5vUTlw^19-c!$WrV_83hkNTsksVX}n0E^$2{-}BL4N|8DkD)Kzxcs6D_n^9F2
zu5xHa5uK<-H;id{5x(c+%0^yP>ypYqRaz>b5(Xoh_`)<zDJzYwYLr!I$H&%&e4dic
zQ*5nqluO|GSZheLjJzxw;;~v3Xr?BwbIJl7nIJ^4FphyiPzi}fEFKbzz;RvbMOV8n
zDy-I2c}bCGlv#!@D@4PRCJ0<yQ`2ipZmnP9H~+yG`SQ!x={YsY**@9$l-c;4s?y}8
zWtMA3S<NVeQLZ_kSDYs$r+LD?vjb{nke<)QOIy5h`!=ur^<P0{u$5w5YNSy_p2u`n
zaC$c7@xv!{J-E0WFu#3~`r0~!wu7)aO4;U>S<5HaY7JNo7_8MG49amD!>kl&T~g#Z
zeh}e#9nv(TEH#1e5{Dhiyr#+xZNE?Kb@1Gn(2;mfo0a7)sse^b2e>NW&ilK}XLEeN
zVNskOkC@G-BuRnm3%dO-Qn^@TaUGW=$xupA6>xZR%)>`hhQm|7^p#KJID(=~xOjP;
z<Kq*MITA(S`v_}jciL=kt+Fy05O|VwHDmY5G5ZISFdT97xlaR@3)>g)ye{Ku0=8s#
z_Yog{bO%51==Rz?x_=)f1?y{T931RpwB^a8$2dxIdU}eh1g$tGN#NG4+f1i3PEJl4
zo}V+FPH~i?9k&>d#=Q0B511!&jBe7Ndc7Xqc8A$~#^cA2$%~u|TU)&J(u?fu?2ydo
zje@{c6lH-H63_D*bEYw9T{Th~Wzo86jHL4spL_8NSGW5d9PRPeTjzZE;EcEnwGbE;
zlUD{&yF^Y4e2=779GQ%9ppgiI(9o9(ZEA$Dly%e0@&oV#k0^GT&!-gmoG5Bxu~bz-
zT?vd97{7sjvWQQ9dL|Om`2;&8z;Rr7b}ST)WXqbSn7}pxCyj!3QAj{Dy#Pex5z)G2
zb#*{G&AGV#A{VZ|OyRaUJKy2u&)j7D@-mO#c}Q7E%G}}Z!#%$H>R<8T;SQA)Xg6YQ
z<pt)GDULouc05|Gb^I{IVtDb^Ret8$D}4Fqzr<gDFr+vO8BR{=EjxVi%P%06g>Qb3
zkKTVs6lwy$BybDf+kL`czyE-f(?iNSp(4R|ERNKKp2D>ijxp4xVle0sx7(N+4i8Td
zvP4&!EXk2lQ3@YHiPh&6Wrdj;%E2w-sLh474rlkj#mdbM?jO$>&G&KU0oJJ~bwl$G
zeV_H^RrdA{@Vq`sy11@Gzu%**63U`LsV@EAfNNK-bN7uya+9KLN?-L@&S%t*PB`u@
zbJpqMkdmYj$`+YUsbxu_Q>-IdSzBYCjL5Y?md(^i(HNn-?TE;0jMq{+O>9^Fw;M*a
ztr6B@E6c-&4+*zBK#Qe8kFu<2w_7NsNRkwUZ4#hd57%*kCQ;H+4oDYW7hv==NbcWh
zfBt0K`bU$8j~5F+!m^8JAeg5x7~t6m<>_-AtDb!=7co=-(s6M<CX2F;gVy!phEa0k
z`ZaD`|IaCkjFXcS9`Ee%@ZLjQpsWo>DTc!{E?n4PWow<I@j3g(a(^<$^F2QG*_Vl;
z7~hYG!iZO2dyW1t4oIeBurMAC+1o$hi(mRO^La|>x!nKgF0ClyhPj0wM$L`5+oh^1
zI-L&3N5^b!ZL+>*+1op0ZDWOGp7Ou{^MA&le)G?{b^ArW@|B<Gg%>}~@cf+by!LHw
zzw#+ImsW5^10lKl!3VgMgx4;y;#+?0%b%x?TV%#?G#oLWCltEmyWjaXRhpvEDBs5#
zi}HMs4fZ@M3Z}CRDHKJXQKSjVX$*u}nv-Q&lfk{{XegyH+BQHj-vb=l!oe=Gs-v(?
z;w9+1*<^7P5=9YpT{9X5<az!~FI!d>CeJw>O=z`Zq=n7ZRXopQI-QUvbILrWDhrIR
zdH>yaiQ6&jtE)^VQ!I*hr^DIVh{$o!Hs$#A_$S?_Ked&Y1_TJD2m%-3NOWDJ^}@g_
z9cm4Ez3{&{hEbBxSzBg(Yn34Gf*XPpqrx_o@R^sEc~((a1CEdOBb3v`90=dXiNZ!M
z)oP(j4YgoA9)siIN{MnDI^7;|ug!d(617`gxVXi1G9fQAk~F8TDwI-9Qi{{00%>bd
zDkSkG!-E|T?mr;SGuoXFYGadr6cPGv69el8xMHDIHU<ydJcK2Zf=Vr>1!aY+4W4w6
zR#7Aw$0sN3@9Z)>JHu*A;Q8FX^*r5PA8Bhs-^GhUl<#9K6uP3+8iArLpsGPzsEwsC
z25Bs%`PhBLLXjkxTH_dtuPw6H=&~YDGxF)2GD)dSK}kwk2Y8;QCu^>)^m%c6nVYLE
zT4WfvL$DcfuxqJ`nk<L&Y02><=LAD!Eq+lV1ys~*4c5q<nq)p~(%>an*THcmqEg7f
zC-%F<ZV%J05k-lwOFF8i-&J(tZZoyf6{gBD(jep~*BkM4m34t<9PC2UWT`QxiSu<-
z10nMqm%xt@Mxks);KjHqq^J`de0tFuWoD2nCJb84#yRgi`H1tgDZ|qV^I1j|#YiQ{
z^8|q*2t0(e%(EHYej6h+wYGR}gwcYstWZjlr8VPWN>L@G*%Rv8a`DmtV{2Acmsnm|
z;_gRJ*xG)Ms)RV|Vhz0X;!E8B=tEXkdaS;1lOXtz^RtBU<e2gJ7|(5Sbhu00DmgwK
zfvCx{gx#GdT)42!r3+WNdG!jNPR#Mq5eEm&l%lF@M#CYaUJuWaq-hF3mZnXNqtTq6
zp3s~i4R5^ped@X<N#{(b6ONCMiK2+*<t1jbIbiAax*Q+pY+u+$3Q3-&WNEta8Ci-f
zr<MZW_Z#1VwTP#I5lFN)REy%=aV%>qEz-G5=+<1>?y$PKMt|i3SDt%;?qH3{EW`DD
zPR~!--`iz28*_4WPF)tbe$7kaMS6Zj7^)_fD?MjEosy;{j@uYQgTQb6W~KqOi3R1?
z7>Th>>!8++anxcFvWZ##q^@Uk2m5r=pm7}8G-$CX=^@b|nm`X0@vzTm*cNnM@TpgB
z6X<}i{o*fiHaEQb&K}x2%x0Dc_lNB6&Y4c3t{vWf_=w?nms%%44aEqOhzowetxFf#
ze(5t*txMc_Jfujb^p`xGFk_rPWRe|W>7vveTSAsq7+d3eErf6>OO4hQ*REgTt=)YN
zhr85Kf~YclUE^9yAOkjfTLeyo@+3Pa?~vzHCbKirG{b0twF+avmEMAPl;epENkNqt
zfY&spwIE3ho;zUU;x!&T9MkP|@LdmG)_AQpX<1REEoPIL^^I3J-8pN*d&-g^@Tlr}
z)9g@^!C<*bSPETAqj0Q;<AoGP(_dQU`OkfxH;+z;;|~4KP4+%I2Gzny52GTcnPUH>
zWOe-lXXhu(vk6uw#E~HI1fEj(o{yBxISnhRb-f4=XbMFs6}72Q2=XE)3`3$gMoQT*
zC4{6bE3B=U&*#K(3td-D6M4}fHd;0N$r`LSKM{-${vL(IbUMX#8}$6gi-V`@sjTT~
zvGMfr@dD)O^PaA!sRPFR=zwb%&U7giLV7rEbHHtWp2w9dm$-Oki+}L*UqRF`9M7nQ
zAhR`-*@Qp&(?28Cmi~I5&wk<axJbVG3%|&BzV#hGeD?#6PEN5B{^Bpb$x^?==Gq!c
z3eL{XxO3+N^1P%IN31L_(~3jhc>Q~<Y;F=R2&Ti~5Cj|?9B_Ji%F@z+&5aGt&qwS$
zdBXDMMLNA6-+Jx4y!wN;h~hpgYg@E>U5@6jv-{zFI=;`Z{KH@1?D&W~)r6xD-sFX?
z4c6nB%db4oD9iaDf9H4DKRxAZzy9mI^`^((?qed)#SsohD{9+-X7tm|CKN@{q@XCJ
z&{{Xeostb1RtSosf%G(gLy2${=%)J-MG?@v{{V5^Y7(ho6&N@G03ZNKL_t)FMg}F7
z!f_l{*VeGcGzZ7J#`iqxEXPzeMVV99C7rlMQRZ~pZR)aQd1*lG2c(rDF@{dN&GG38
z(`mx?#Vho>eL#_wIlk{=?I&*}T`qE(1t5(<NQDuW${MiEsJbdE%CZDUB3l7YXTad%
z4K}Y_#qTZyE~XaD3(d)J&dF%V$#6nx1xqXI^asmyqX+}krfz^j3WVnqxB;HyaJQJ?
zC?DZ8g@hk?2w71T6FRLHYlBtNeoRqh<XMT;i$X%VO~hbr(MB^Kj~MTtQk))9oS&c^
zML!s@z0&8x)*4IQE|C|YjDV_fe;I2V0FJd(!cYlI`83s0Dm?4pE0?;gI66J&Z2vwx
z_djAh8qo?{I7>^k0?SH2B=jXX9zonfI37i9$f_EH#PdC}q@XA(w6zr4kn5Vfw&cc8
z8H2Ha7HGFb)&@_5S7=0<Qya*OnrxntPG+QKf+WGKT$ESihynu3<l#LYCWnap96dj$
z6F3adPtdg`F9oBy=4_@J=8~lLsS1J2HD0Z0IZktUEfR{^jKjU%=4&gk%0Y<`=>}w#
z!F7FNKc=H#$u%su1^r&1I1F&?jLH~1cX3$wn7s6pxN6<Rg=?cJD@~nMXkF22wUAO0
zhauJ&vLq)8TJ$?D%F>dj71DZO1LmWOI9j606c6t{V(0Mz0*|$o4K7{0%;v^sb5BH5
z)fv_<3Km;a)&-Auc6jvYKA>1#-NbWaz>wz^Nm8I|2SLPqn(^Il-Q{3^nU`O=MwY;6
zxX;ny5L2JBxq1a(b?`jPcsOG^ozseag1|*NmbLXBlTpR-@h(#My!qxk?ChSS+=x~?
zra$O#@xmrS;E~K{+<5tAYF+W|d-n)~fILreJ(sF1nNB7+ssUYwVaR+wCttwu&d$#8
z{U$Q<;ll?wj>CLD=j`m1hWF$#pErfYU@*Y<2WVZ>X}7rd(T9|IhU+NGA}32y9HsC)
zccI5NxUSnU8HAw73$iqA{C4AngZ%^K%WJHzbm;C2s@iaJFd@qoh?xGMVrgZald~~D
zeD@AJdymPo8A2NBvOwFEG#_&7g$q1)^Ahd$GD^X8R#DXzRyDpd$8i^p$;OA|IUc?j
zU^M7T6L`+E&V1wF2tLsq3Awn$7pEqSsnDfGxoR<;sCZgDKE*^}EskswpTZ#E{Op+X
z^J6Y7Z;|VBrdiH3JHrZ}H-GSmKR<qrQ!QD#bekyj@LMf>u>wVm=cJI1>8g_d;1|Bi
zSAXtPO#55>$!qrsm4gwAqE@KR8o5|SkW-9uI^KX{lymp}L)_3~I)SPTnAZt!{_rEl
zdB%A$C9ormDv`qADv7R|S3AiQ=8j~ezk+lX`=>j2%3DlYBo+n2LAh=t3zij*tpE><
zMCcG(cgTw_VfO`!tjn|*U}VDj>J>(_IU?7nLJ+DxyE_?w_$PNzz9A8Fj!zEo0vE>t
zV@s4H(5B?<?3BS^gEDlnbra}NL~EF915VA5yQ7?83PHTe*-^sIgA<Gultm5r{P67u
zeDL;NgsjniqpYvXF@CR^!aI&dU=Td@9xoEfoF>A!IV;-+OlKP)=icD~OHNAUby(k6
zA_yX^2IV?*yGzZ)RDkFC1b%bwqcRJwglH1btis5@`{&8u%WVDh#-fz^G0D=8iU$_?
z`SRKKKVEb+sVe3fSmxu?4YN3$Hd9K2`51hrEc0gx4q%_bx<JtHcBz#lphh}^)%8_+
ztrmm<^Sa_}|Cr<t|A>5=a{cmk%A(@n?3CRnyBzMp;qD$A+ZQpqVlp06l{LfD6VAhc
zG@WyDK4fb)qu=e~D8*<r=6C+t@3OkO%9nrk%k+9nBxyn1ZsCU^X;$!L=Ly;hE?v5e
z^kObvyFshdBTaMgBdn4fot*K~%P(>7-Pd{R?boSZxXq_u{uGbzyvN<$eRdx{<cnYZ
zDu+9JjD|y$>yTC@=n_#o2-S?ggb-NM6c4lMly>0Yd5s=U$|ge3^L%{YCk(?zr|)?U
zR8Tl1Ns6_WC=8HNQfrM;vN7{YL0#q4RY_5nNaf%<3Z)cTo;PDSArN(qshVz3tKC95
zlA<iI(jbLoKAU4|=(O5wURb9xnjj3&8y0X;Qqt*kXc1AA8QT|L{7JXzPi<){nlYQT
zBt?Pmd5r{3H)%~u2uh>L>k1(p`rSS+{OlKqmzGfN9(Vy*g)J@9$%y0g2}h^roR6oN
z#dYSpiolb!A|HXE)>SjkHx^%21kxjNO5(^vc@4-5kztHQ)Kfem36(&T;d+{uk_dbp
zA#sGn8r{UvqR37XijzaSXs)d;(OT+p;mQ>*UA@TC@-n{XHIs;<M$1NSBdtK&hQ3=_
zD6FP1720Y90#_)6t|+q^RdR+cM?_AJ*L7G~?y|A5Mz<w!L{1n8q$^Mkl%}FADvF|R
zV)Pt^6dFfqu#Lgckrr23FyI=AH4SGc@FM&goUFpBGN@`qUSbMORavsqGRte`zJo0d
zWirF&WAbv&a5bVm>5z;Mcy#|ghNlM&=Ri7C)*&|@xd|v_3+r`|UY9tISrq}<Y>4Xy
zwEKPXd`dPMad~@#G%cuWhg!SjsbM~!;ai_tc~}WjRdl5!uUbeM5IP=#iU>moW2<Kc
z{3mt!zE4pUY;A3Ec(g~m-DWzSAf+S>0tAZl;RMg|a8-c9CvY7`XQ$X&vc9y&?4)9P
zKIHiLl+)vLy4?X^|N1{>&|l)@^aLT`@Nkc^PU-bqv^p_Wm2!N1NF2Gm^66WwZY;CA
zb4Xq!O&8Bdj1eg15d}T6+{NM|k?idx^g2_7jX63wA;~l={g~-!#_{2d+4KY{3$9(;
z<l(~)SspBr&Zk_wbe%YYJ9i%Q;oY}69~SH%oKse?y1q$o>3P=HwwTXneE8u9lzGNz
zG$cvpC?!$AQnybspR%{R%jWtzp6fBr#)NT*?+1->X%Px-jHa$iqA29*mCLkSF^5M-
z6nVyEGRE^7YVLeK=i1dP9334p8ISNB7oi&Y@>99-)6eZVj-UCvCX-2H=A2HM%~NjQ
zxJtJNXJ`9dzI=(5y(Jz$et_~_=939OeB%eKYz$dlpYWa6U*~jqj`9T7R%lZKnoE~A
zah1c92S@Z<J+9o?Y{Cshz{Yx?S#pY{#CIbaXtN*;BM^;Dw@Jur8uzZ_A!OrYEQ{(B
zT}U+V|014e0Vb{M3Trg3*T|KHZJIZY{am1w;QZ_qZ7PDm;lYEu92}kE=@q{Fod?|8
z9WfIzQOn`|JKqAGGm%|n)}_*x;rUSmifpeEiUi>)x^55UgzSz+<it(0smv(Snqd&}
z+PevR-}p-=vm7H^EU#XmF5%sGK4g~9NJWH}lC&!M;NAz!Oo??t)CpRb)B?08sjML{
za%6Iba(xa)VDuEJ1XdVIo#QwGm8nrQwh^TqDqVxAkyU^z92^niIzFkXdHwz)R9^G1
z{=47hBpWfE4M~y_?eHRJ*$L>FG@J9`qjQQXp)wN`F|Bx&+EmnahLAOr={Zs4bN}Hz
zN;gC4oVE%$nkIbX?vQD+%acF;Hu*GVq7)Q9J-1EemJH7ft`N*CD3cVUG^*{;>9tvE
z2edl^*VR~4H-AOpEf5P$!sB2t;9zI(8D~q=6dc+b2K^;A)>m0wZ4-s=qWRvOx0>R?
zCrMJus-~`WbEdWuX%%L1g8oSxQ$O*QwS94$(Rf5r6qI#|T#OmjqEp>4CYpy3O&U;h
zkhP0~V{zzRTo|=!4j0epW2P|^Nd!pQbnZ-3Pzc%N>kDboTH`uxtTtH3Hu4bz9*ULL
zfZzTPf15JTDXAHcM~tqHINm?t$#}w*>z8@=&ij-}hUYB~)HO^-W3qX|<NNn%wPLU^
z9X6!Ex-Pl%&f9FQZF24UO(vr`fAi|=xSmHG_qniniMZba&*Sz>FHu^{(dj8()Mc=I
zk$7o^rM1h%-9F{<h?}2Y<H4Qx`QLv38<dk>20=v^&4>5*_}r(ygq{`rtN-Ko`QhFk
z-+J>Ms4b$`MG8Z!+d^UZ;>(}mxm&j=YQvjv{eTbeyoci`w1KQ_a_5CLIIhI=0)o(K
z&bZ2<)rxW51^H9D=w1(uZr*z-QO<&ZDM4$CkO5U$F_}&p7!ZIIl$piWB?dva+gVJF
zz;zq1Oe^pfMTx@mLQHK@LgD!?WmzGl#C2WLEW=k0r>Cbp*|`roXMXa@0}0v11z@eE
z%*#f9ZN&l_CsE2pIyH`G@#C2O+7_M5&w(|KzaS||vyy}3A&;Kyb3UA6Y!lyB)D=}W
zBN;0?p&*V2M4?BXRV4EXWmz&j%Q-tAlcX8-(h|lP(jrGViYRVTOvjuT=gd5hx~!Ux
zhZPNw#x`-U7~5nZX~Tu3HqZaYuQAUulB%Q>hFS_LEJZdUo77mX2_28n^P3McD{%lT
zEG`BYjVCmfscFSAVHh@g>yFDx$K}SwWy&l=NktsTbUI5UX+~CRT26paAr%f32FDRN
zMuKSMSDxE+XKQGFe<P5_qH2TI23v!JL1Y;ssgTnQIhx~+652^gtA@adAeJPK%ZZti
zR2j3(kf#-0KWDjic=_UWxU_{VbM~I>5O)K#Qq(wD8R9rGR<<y1j30LhJIidgJ6trH
zO4iJ?F$c%HoR5!bdk(^AT1#sP+2QmgrQ3B-+QBI;DxFgo1*I`Ku0wyh&-Nfd>XbB@
zV6A=zH2fs5Ja5MGN-12|C5l3X0Hs_64vzF_#a$ffGa08S5uj{<5H600NTz2zythM^
zWqkV6pW()h8!Yu(oSg0P#v89uR2fo1)OI<Y6c|%5PsfCjkLUVax_FDt%~e)cRv3+E
z>^#|LJ}W@Dc&<krbtwvqunz60O<v6S-s|@{I-GL#+9e_nwl{9``l}yOX7`!Tj=6qg
zi^KgPlVL*OMy#%^p{t7VcuE|5DAi&(o?z?@*9(E1v$G@eJR!?-j*kwRPp4#A%9Sfu
zI5|0DeQlkM^$ouFy;m8JMr^Ndf`O{6u-4%DF12p1tu#%TPG`-1T}igLw`jHECaq~S
z#ORth>M|Ogv%a>@d_HG3nc_JvSWCU&;JA*$VxJWc)9I8T2mnD<)g(zmUY7jwul_Q>
z{ZGEmaPND(`}!Z#>vg$waf`Qq_<)tw4r^Q2+1VS?9dsEEPbkwlgQX5xk&xw@IQEGm
zkBb-9SswJ5OwZVRa?)@xI-q=)*{A>~AP7Um;@;|c4pO<)8j7r1cq;@_Nid*<gQGkO
zTQZ-2@_0l~mk_cESD-oUDb-Moiz4Uz=#U@?X}3GiWK9A~T^qjt=IczSGrsoAzs$km
z5z|S^el_C#cOQ{iA7^QW6{kaGQdU=Du3f)HLWr6syz<g*PIu1`iGy2ezVw-2VLX~M
zvmrZ)=IG=xciwx#@I1ry+Uy+{9GxFwZH}W0TFON%MYz7@EIY?Y1CB#hB+T;z0yQV-
zMPzwNna|M}w6%y5i~!$PNL!(+6m1%gNmZ8!X^H#@$BA&1Pf-erQsWAjUZ>BJyMnP1
z)3T(@Qfhs|w3htwYxfx)jVWm1`VNW|%$Vf-2%$7Z=}}1wUWM=bh{6*34tYLhfBzw^
zwvP~&C=99Ul6T(yJ~|Mz(lgw;&nT~XvcJ#S^bw)y&@Bam99Mc&l}5HCj)l<o>9o4|
zD?Y7$8^7=4xG}wOKonK@UV%e1sa=>}FhU@tB#NR&VIo9BeTQfA&vrYetShoSqt)_A
z)3lL0MbTmpH5Im5T-Sl`<CX?TIvA^<UYxgof|%r=xRAJU^9ErUa_`<fPEJmq-C&+-
z63rqeuF+FUq_sb0xVH93zwFaV2JoyJ5>lX0&!!a3)Iv2KZ($c&F`A!a8(^1mB}fNP
zHrhc<lYI{g7sJ}pGRwUsu3x#z&;Q~t@QpwIV;(=*#c>qEDn9qw&vD_>W&ZM;|CTJx
z5JFJqIosRYc-<~5t1Gx(1H)0ZAWbW>G-G&jLfq}}@bLqxEQ550YZU+GfAJsFZuR--
z-Xs3-&;E+{AMep#T4itlh{^q3y8RWlR=2tQ92EJO!~0V_Cu7hKn3pAg^k@H;U;5fV
zB<{3vTP@;#h?O2L&~AkkWr{E*n;WZK+}<KDD_(moqa8=Iq86=on>g?>x<c_(f@Z0z
zrcf|iQ`K{VARzEPN}ZEuDURoWH3XqYnbi$^NI5vJLZZNt1YXpP!@J!kd)x~tivq`W
zsj33ka~k5V5QM(Bm?o)bCVXoIrZ!FdW6{Jt&So>>IOgirE8M>I9J=}}LP1@90yz@8
z0--R_OaO#<Hg0Z6lg*96bA5WfC6<<!AuFNNLkh+2M-TX;Z~Q6$`d|M(AKiOMn&p6`
z*X!}p3omf>@;0CQ%qwj7e2Vj&C%cb$@7*78c5=`Fnp}^0ULqV9FASNdDdX7;Z6OFF
z=2_D4NdP4pwng*HTC6q=UE4zQ7nca#cn%!br*;I1sYs2c76RcpctJ?$`$z+#Uc|x*
z2WQbRKs2$mRzPhHW|6|8l)_O0&yfVaOX&LqzDJ%ooSp2jytc{m(f}ho3Ztmg5?yOd
zt+5(vTT&DS*5p`QqJ?gzAI4B<OHpacvWCjwmX^Ns2up*PrFip%V3sh*H2uO7XBBpu
zF-_*!`kZB7p!}FBlq8c8`)}Ogu-oPNpLvmA`;GsIm%s2O<~nCo<c!LSS!I}&a6Ha9
z8K<PSqL3MV6%i{%HZNG|FLCR_DwBMI@dbOwr+Doa$L9$j+<A|>3g|@x)>?hKzKie0
z_>o39f?Ag(X^GJJg3lrsf1^+CN|Hvdv$L~{l#0W{Lzb5M%;yQdXOU=J=}{NW3(b?7
zES)guui=V_dv_kO```rM4f*nyzr>ZRmq1$n;1B-=v-yO$<#X-ECA6sM^;$T-qAqj(
z`dfd=&D$@dYk0Ev2qj{cmshxSX@hRJ#lr_XjLs8W$3-cJJlB-Pj5zAj?`<%9@E+5V
z;qrwS*xI_t(qNm5Ti4Nb%IV2{dfgfOyF09{bTHauWqFG?-*|)3G~x4K_*tZixc}%0
zRXxY^;Oumt$#lZ<^4fwD-Eez^u<Y$BvLvB@<q9jS%dD=faDH~q!NCEmtE>3FPm;{2
z>jFOrh{7iCzA8$lvl;t)dz_!0(d+f-wA&PUPBi$@;i47CJiLFOC<rhM55&{YacB~g
zq-azHVHi@^nk>(lOdBTAZ+-pi{3rkEf5we#Tip9$&fbIXb2=Pz{l;ycyLF9&<Afk^
zSX$~}sOWZle&%OhVX(f+`RJ7W!+okcAuHyboE%VPDN!6yRuzvQ?$hqM^p^uVJ(o_u
z1E!{~swVNvQBB~YE~!n4))kI&iQ*2k=@du0oSvQ1YPFcoW<SlX{`Xo&HbPmWE37SW
zq+vcjW`F-NKX~&sl$2b*ag!U@Zm_n}=kd-%j)zmG>4cA-%n4q5#9-q&l)FzlKOw88
z^e#Pz@&nqD&p-K%f6Q0D^f^8lm;B9}_o$``U;EWxW%u4b-~IDfk-}$rW0^^zdG+o0
z*!hdQOp}Bx6IgnzZeBq}n&ET@Q_u0OA?&OZx-La7Nb8bmGA8PHP^Dz`Ii;ClMlRM!
zlqk`*IXp|iR|-!E>|*L7g}@dGTWf3dmsS|8Y?5RZ^R%MK9iHqQQR<qlew$ZrUPp<T
zqv446-hYQIc|vLq=|-BMQzD9j7jC}5>T<-+&K(YR52#Inr9hxDqN2`#N|PpsNEtCp
zSGj%TWlW_&OUiUaw^fkWGa@g?@f;K-zH3=s-NLs%L0KdGWjx=(^#u43wL*jiU;2%t
zTncI`JRclYpcD%(N`$a-!BKe{SY#Lu$JDi1G<O9WgLEW$U9fX-!0ijqlcp(3F41Xs
za2=O+x81ylQlZ){gp`C{fh!FXO<m_`TmmH!(s>54`@5{4xRChfH@``**JW*O9nbSv
zUS7r+!*nuf4oZuWC_qu<e~T{xKklih>-xvO|8Y{~$Di}mJMlCo_UUuw$DS*Mc$Q97
zFH#?bl$2Gmh>~l@JvVOL#9FcN3l!9K#oKTFpowr@6fbqHdGcfjDFu%nJ;KW7wXJlQ
zc>eZ_<XHk%6L^wHS>FG_YlJ4_!cv>6(EQ97evTJ=>umn!Z?bgb3jfuA|3C5S&J)%z
zU*q`Xh{<S7>^XD>%e36*iOq<p&RL6E#IDby!##xKaP9gv5)_^rQl%N5BQSM<?@Hc&
z>n&b=^)=F>#8`{#I$XJSg~4E%bUw!S{l)86RCSYVC4@q_4hE=<piZkMqdN?!Z39tD
zCkgFN3nN{s8kCY?1fCbMyxeM75i}dT)fS5ltjNm*Yif$3KnO{#ExIVEstU1)9&?rZ
zBhL(gfGCbpjzgt2*=&aIx>Q+><9I*mHvOrs(k>)<G*BQT1huf_T4U=9QI(XsYDO2H
zOW10`f=GMk{rCCj|KeZryZ_7Y@nq*A%Y!X$-F%KX3^_eH;k$qHP4*tFlMjzbPIg%t
zbeIf}x%d7%j7Mj*S}oi#;CwOzS7DKqx~4K3D<sNs(LimUMk_klg(AY*Mh^6BI$=b^
zgQ_)-5qLpBB_XLxQll}h!V3dTnUmY5_;3&?D^N|^`65-Qxwfqk%{bO`5srfpjgHrM
z6($M^mb$ch0li)q$MxC1xJ7@kL2VV&RC9Pb!<xqUud9+g%bCvRC{H33Xe>qws)eLV
z7=wcbTjN+mKAj-b5|!l0Ji)7TBA~4VJ}GH-Mpd5EL11e|7{>&i9@7#glM#nc9<zCM
zjg9_A1}iIwG9gRn1Z72S8(^Jd1Ukzo>KfP4c%kC??Q1;z@I(4h%!MnPq$cNsM<3Dh
zeJ)<UOmC^=?%f^EPcxJ<2-Ot(S&=Z-8N+eNWEv0(2W3iJS7FgKMmcEzbhi25d)3<F
zA{Y+O>GnFDot@KecbJZ6cwR;5MF{JW&U2)Y*jgd21KQ*Ce8NX}AJB~leC{)!;?k9E
zcK07s+XAanE?-|^YkQ3gmp0hldqNaRZoP1e!O{{Bc0M8qL$nqQmSWCMX1wvn_vv=q
z+`j!hx1PVk<3|UK&Ql!6q1}#{O*3>Y{vYbz^GUKSJ@5OSbFNKWS>AP5yXl@D?{;Tq
z7X;SKU<pGowActjfB?!whybbYQUnzt389emM@S)&0g5022oM-B3(W59>|p(lpK0&P
zS7lYD&+G3w`f#$UduA6)U=%@c-iYeVO52%r&3WGUG0ZM4GaL+wlL2U-YGsN>y~Wux
z4>9Z?u(!L3Bdhes9R^;;mG|$Erej8foaM#SEH9m6V`B%2VRm+kUO&PJIK8%t?^PHM
z`Xq78cs!<B2{9AV@XebyP)br{Il3s=+uK8H&C<f6U1Vx&6RS%*9jsO=C@JZ7yWG2T
zhnblf8jS{?qp0{kagta^sLf4QmY3Pu+QfIAiRR6QVM-|{i#zMtzqq)>wQJWH#Sx9x
z6u<f_zsj%v+OOgJ0UMi}v}PAMbM_&&H`iG`eV$8?<lNc#E3__XP1P7hDXqB{y}^J+
zUD29ZV(C<kER8rkYBP=!l0imioX~33aaD!w^&N(zkVhUpM;0rT76jE0Q<fxgMpjr>
zgrP(@2FH~+lW<N1#BofeTCrI^pU^U-NMVpNL6>9lWXQX3eVrTE-lB83Lp&aE<Na58
z?2*TK;nPp^&2N8=EBE%P&i@o{<w<UDXnem(UI@-D&hq8we+hTxELY#Z$8P%`i>+mR
zqv#)wVeH@&qLTul1i4cpd`;IGLsQY+>Y{|fQ4wC?TKXsnI_@zOj9FM&pb;#i^b(i`
zu2b;yzx2zDqY>BMzsu(Kn1LwpJ%_Szt<#>!aD<>yui{{AL&<UJb$S?AQT0Req|e&y
zEJ4tq>DQ5Y&i2tJzBi34L&`G65gu+m;Glhk>np3L5g9etL1>L%QAB0IxU<i_9`uI^
zagq^5F@=sOu&#Yd8IUPLX_Tr^sZ0SHVSJSKapj1xn&QPdB5;u^ry(uPU#bu(6|P&c
zi+4vNj;Z~}=S8V71{8{l@(>6dH%BQ4Ap;E7?bBFlfDNJ3u-`sHYtR@<V`;=tB6Nmd
ztx##y5oyYxH^iVBkH#n^h~o%%(&RN0?Iwi{Sazig2=XFF7%SNS+t$Yh5>hI<-9G#K
zZCuymx#yl^d3l*m=ZM?4?{IW@K%6Aj>si~-Iyvb~+RPLiZ~sxz^)VPIODpnyP@sJ*
z!af!bAOG&T*0%3BpW^tr$GQufcv+&Pi#8ggHNGEm>eOjgS5A>6F$lrI;UW9`Z8kPG
zC~}G82y5Spp)56Nnq!0&Gxf!oqr*drEWweMy7P-)`T}}1V7PvdvTQTgSm5sWUL)5P
zp8C=+((QCvzq^SW1Z=nWs04Q5?1mw})8ftd{t6lIQ!NvY8Vy?2I<LR|7TvO>tX3E%
zCBcL`Qk`njnw_QFJ)p=l`u!e7X~=TRYaI;-j0Sylo?^<J5<%dH7z{>Es5N#zY8`}%
z0-;>;LK9X(vO*)2Lw^|IX9Xb8c?m|~ISxW9s+Ev&6ipJaB^b-g6be8Rgf)w}i-No~
z<fTDj5Zd6n0wruPndiBbT9f5DVgf*=l#?lw`b7GFC(1=CdjQF@g2BZ0HFp)I7C6e#
ziAIE#Dk5}|t^l2Iu(i$q`+NU4|JVQif3UgV=F`u;z*A2>%S>w)M+n;cd%PhvM+dvS
z_KjERAMJDb;yL<*4!e6tXk*Akfr-Zqqu9Cw0Vs)74njg+<P)J9AS`IK`=p)j9Yc2`
zKnn|;m68}Gt!P@?#j6s+QlPSeA}=jaG~h^y)POM-gqUMr^T}%h#!(2*vD-_L;|har
z)~UJROf{LS*ExOW9IjtwFdVXf&|`CWewk|k03ZNKL_t*dki*`X!=pY32S2Ew;+UY+
zbOt2^HJq?QQIvR|Pc=|hz=_6@3Q2~{Vtg;AQp=dBXckX}%o{^J&2S<xqY8_8K%_%<
zx;^^i0Wl+F!_f4qv<KT<z5XVmnh?%4F~tZ^WO(GLqC{yy#WQ#^qf~<V=^Bqce4ew@
zON6?>4;`jk(<G)~6s1f}r!-n~IBvqF^QU>Ue+5S+=(0zWWtenK5lV^z;z%-93Kv1)
z<rq>h#{=$9X4Ps9l$zLe8iDVH7-L<{bP28-;JY<aDT&8|(613XKJC38x31sAQ68WA
z^fRn1FR;0Di~jhK`GqEzXI4R!>>l1k_#-Nf3cl~Kf3VMB7@_gm*g9fq=`>Oac6aZv
zy|u&Mz5$W*%rnn&`H?l=d-oRYy&==HHIgLfpxvb?=2%)@<mSyT-}~P8I5;@q(I=jv
zC{l_d<J_4G%+A(Wn4RYEV4K@FwsBm+?A$7~u*ufFefIV`6P|ycBu)vd6+G9qxj#x!
zsfNVkF-nR_z^BjQ!2$2*IsI<WPW!c{*Xz-!)$s$5EKP{UIofDE&ts}N#oXK+Q&Uqo
z%Awufw^L)sA&wGOR+ib?+?p74NXjAyM_PjoV<{B^yZABKDaG~c*BOmQgw-nl)qnY4
z@N2*J8)#$b_Xh}}n3`T<`Siowxx34~jW(TLLi=z;x7VRHy~uFfA<o7mc|vczi#8>h
zPH0R`b82mY&<hzIY1;c8+6VhMu3>I^m2uqX-8XOX(8H%Wb#4)bCQV1gX-1Nb5l%r6
zy7->Lb>*ZnRRe4`RGOuPpFkV&<1+Cc?d~CsYKW92S3Y=?d$(_}yR$<OIJjO&G|stk
zeVw~E?vj~^Za*dxT~42=lIMyv&Cza+r8AH6{L{~Hb!!VV9MJ6-?2UW|Z{23S-J=+n
zl%?R0|Ke3V$H({~{c(ps`s!E7BZ(`kWF}%*WXw#R!Hr|8`5uoyc9F*)f0_#~yuiCx
zN8H<!Y~R@@3<WQ}^m!ad@YV2Dwsx-IDMhIh5Cuv)7!%+MgDV5-)c}bmPg8<0WOeZr
zGp%WE-28x43mgH`b8rJ#Sz4k$jPU|vY1{5BjmmlarIf*-&s6h}EFU3Mi4Ymm(P%m3
z_Qv7Fk<e;$f|>wh7yX{+5`+PjijNz3IBpfsT|j6{`xA-@V6bZwDb<M%SWTSfj@cJd
zN~EJEbUTHT7LYq)@)+gdNQrPAl;c<+A>e*G`2(6_VQ`e<Lva#9k{21iRNT3{!Tz}g
zmRf>ptqQ{6`R>X8EeHa9-@^dIxWIL+h+H8_vvSgmmzGKLx2%s1B!<J$<V_*Z3%>TX
zSE<))eE##F=ecK}<KD(S?%cUOK}2@=Zj8ZoU5be{tSO3<#r{X@!P}0f6%UHFj|JX&
zmfN5yJ}m0~Xh@TFE;9J8_W&r7=(5CdtRuzgQ)?_OEwi$+g6n#er44J-T61u4U{ge+
zA<=M%$PGtFM<+o+rby^@+C&HY1i7U(_(HLHuT7NsR9DV2n3|^_513tDB12-5k~GVS
zVnwS~A<qi3@tCF43pmQ*XxK-FAyMauc6$$85AqVJ1&3jUpz33Ure3LVu-~Sb7)jTv
zp-m!f?;|K_wWjbY6>>eX{&L*op*3Y`uvs?(*9$-xMp1(A`bZ^F+F^nW$hF24Rsin^
zL8mve!Geyq$XhAMHI56VE|9Xs_dS&Ia9qo0w@zG!ag?Bx1!@REt~IXjTToG!AZ<cv
zo~7hv_Hj4Uzq1+{@T9`=ToP@FQcL$Tj<rj497$hiG@A3&7iW=G2jVX8e(xLn@$dgG
zd;4vE>Qm40m9KmSFQ{<u?mBUjva+zi{L3%%+BaU|{SV&b+Krn445AU^G^1K?(j95y
zG)CF*Q<RbuzNPgOH(FCnfH)jGKs>;Ud=N}brV6$vsVoq;hKds=l(mj4C;Mwzl<2ZJ
z?s=TN*2!@XFcP9Nr<4%54l>X1q^1~8QI#;N)JUi2aZAIkE7$qq+wXJr`W<fH*&^2v
z#}U)57E4R>NCCC^6^4;Sv|MV{CUKJC`wHI;Aj`pMs-8sWIblQL`+}e>sRV+lMo4H<
z%25hgN+YPyY%H*`S5n-_*}r>09QRphwYYrw9NWA1*gU$+bf?Ps#fvy1rWrbD3~?Oe
z<eG--5K<DyDNd153mta0*YSLpywt33?vY~%ye7si+1+Zh-|6B>W2Y@8#L18>$q?G$
zG-i;hLRwUaW0z7Iv>75qitSDP?K!RgvDEzh0$G+)U0h@^>~ZEyNEil$egz>ECKptK
z2DPBVK{`SgE=4BTxU)kv%y{AX=a`<Ya{bOb9CdaGs#d7Ew7AICYwyvTonr53oky3R
zA{uAB{oU{5yG<I+Rd%+INaB!N*KZR94OUlAQIrvW;1I<}EH19_@FS<t<z2E=amJe`
zO(P5`XV0xrlmkZNuC=J%-=II}P^|>qys^R2p~FA>r~ia+y!r}*ewTCS&oCGaxPIj}
zjj1N}W|Q-0AEDG9-Cj%*ryR5on4ZyOS%U95xT0!x3H<?~?^CT*=^h@D<vFcZi)b_^
zjji?e;^G2PG$M+|lS#0k$gQohDK*VTgCvg0vW&nF2!g;)kK>q1rNVeLrdF+D$^tpr
z!;xxY-l55h!iJXidej<qzWn8{@N<9v7br?i947=}g<35nFM2%n%;y*m4X?fSI@M~O
zQ){!_UEicRJx8VLk(D_Y&#!U*p>sH%!}q@bZGQ0fHP$yWTJ=TFtv<r}v*)RWHP*N9
zGV15}VV#nc+c)<>dMvF@Qy7UZ6+$RnSK)aIp)_TYk!Cr55RxPjm0Fd(y`4`qka+J0
zf6m6n1_t}Lyng*EgF%-xPEevkkxQng78!QN^rDzXtHRvu9F3(jl!YcqVw#N*=~d|T
zM_haVU9Q}|!N#o~x!>f~Z@op@JD_kR)6;9XL5<yZ2S+K2Lem@cF*3qcHKIIb6dj`7
zf*7BrM$Wubvgn7Lt61uF9vM1OM9i3wj4X>W#v$+|Q_U*IOw%34H0w=5zeyG+q|w+q
zv1vJ>{<;K#hwHgi8+8&P=p<wMX~w}QB1ua|qlCdQp5!3}93J@m`JcW{7<#zAKnjKL
zySCf!3c}E5YO0Po<)W0LD6@%;u+`rxCG2~;0mcZFrzlE=E^G8VIUo>1PSVmn>y$WI
z`y7LaV*qh{c{~|Ylj{<JI{_aL0tx9lw)yxIH45fK*K7mVTEi~P&EdEni;FV^fzN0>
zB=9}rIDWv;$c8>Aacr3qCFDgxrBcT+mXckT{{fS&k8=o)MOQ%(kYyQv{^wt1X?c+s
zUVNSl7cTI@l`Cv-Z`teuB}uaML}V=xwu?ETB0ZRn{h-U!G0o}tKDZA`l(P0`$Golw
zpZnnB!KR`bV>#=`w+SimJP&`u5A}>kv)McWGG?OfxOC|f0EIB5ag0+44%++dA0AMk
zNs|%(=J$S=$IhN*zUEMRhOtN(2O*0WE^)hi$SdFcHa9lcX?Px<AL5saJSh<c476t9
z)EPG4-$oljT3D|4^6D~2SpuUzN`dbL%r{$%$0L%76>HQVQWOQsRg}h%Br)Ir-VZ3!
zG5_g5`U=LBjIxwUwaQduihh4cuQ$MRJ%oUwu$G_Nl-2@FIUp5zp(#p(ps>7qWzj9d
zhN%fhB83f9SIQ;HGK3P7u9hOt3X(Lo3t1s3wMI(YrOxvl&vh_D5DydbJSVI;h*D6N
z;>7XG@s*`ieZs2K>*2c2<Zog}o@r@Q+OsSLS1>&@#oF1^%%44ln46~T9P#bfzrn`(
zCcp6V7x}H<`mcHA>)+<)?R#`OJ!Yn-k*8KsXy)f;xctxs);HGq=0Tea4_~HKicxMT
z45S5=xdjt;e>mPJ?rV<j0}1OT{nwYlb$lz5H~06Q2h;73_cC1+)&cCVDFId}CJjYi
zFiK;puI=vRX-byF=se?Kf1j^z@9^5|-{p<BKH#7;U@%TFNb2<}cW-1Qai6O1v2yV-
zrZ0VpW_^x)6j8(p;}Wvrm?BM)ro<0Dw06kj1QR6?57{opTq8xLL&{NyG8y1XL+CZx
z-_I!vk9xJr;@O8db#9f_i>GjxnnZD*p@8cfo4Az#6-rVKi8hRLO^&3%WqW^ztG8d}
zyWf8om6o6dWogKcwI!~H@O@ID8Kw#2IKem$+7YB>i7ryoG^f&YS?I@1PYJ@XYNuCa
ze-dY?;S&rbqH#=?XEYiOva}%ZUGh9f3W-u4hld@6t`Im?vQ!fdM|2J%dYut#r_Xcl
z{CT?lZF+-UHny(w)U%f{GNL!$<Mg>%;ylIE&>MA0#sZ;23>9=yq0Cc~C}h+()T=%-
zGxM|$*QwP5nym^~uf0iYYJsPoy~L|u`#zEij-Ru;e;3!!Fd`;OJ7{8N=c`1~5w~xB
zz>`lsLg;$zZ0}L#g4LCCy!y(wdFtt>dGYy|XwA-WdhIk?Yudl_FQL4{g>&aPd;UB^
zO4{vx@+`-h&~uL$C2?#g=hLkgwR)Y-;Ss*?bNS)RJo4yeuHU%I{{Ak#UXLV6=ytm#
zNkUncC-mcfzfTy3EG;c_@7`VN^#(~2Qx*lj=T7L40;8-UipH`7;@IX7jpLLr{Orp-
z^XxNhY;NH0w>f{|JW-tBx)QgL2twA@p5Woj3C3uK<D56&dXsj0m)2~HVw95Q5%0YH
zLxc-U%d`BGPkn`>-Vwj|uV10F`v%WF{UWDV*C<QPZhH@76iPa@5Bf;C0~qSl9znH=
zs|3<Zk+PsDGn-&O*3@cEOXV<z;c)ngwn_fs>wij?Wh8llK%!iaalc2UR%g^3lV&+b
z2RZR5=iKRYRO=N|$3d5py@Nf51E@c|O4S$aY+dF5eB&?K>h(#oI?dA$AqE{>lMuN+
zZqQ;b49MaksnJxz2BXm-FhViHcPc2Ap^F4hx_sfMK1=7`Et0r`$Sb(c6jf!Yx+xt!
zBF=KIUAaxQ5^{9d;lkNVjG`&N|ARiKmd|qW!e!!q!n^POkTf6TH~~d&^HIj}809L`
zA|pd^=k^W61nNp$1QG`qju+H{rV`W%!m4FE_$5I#w2OHu2m+h%th^G>cft60o;P8#
z+_wvM92bm0i({(1XU~`7c#SD=9S6q|CqUxCiG<@gC)bZf)5nc&iKRDvbRr=g%h337
zaSF#8OKW0d88-q!Sz<%;uym@<QI9+HIe&JAIEgGUBEWU+Qok%q(lo;Wp63yUl8W+3
zwI<1O(8Y)J%YW1Q*g(Q@Z1#Xsa<VWtC!PMiy?tJJ<rSWK>M7>tW=Ye8e!q|Bc_e9y
zp1AjvS&r{{7-MWW#>7hYxPF|L;=$XFrxXZ-lFmuI_sQ)adG3SHzaQ#h@3#kRg_8GQ
z_ZY<;-;V%^b&9Bj6`GAH*3O+HrJ&F$<#@z9-}w$deDf}|bJMtPKpbnD+XFuRxi9g-
z))vDwLH4?=tkiH2RHj-8<6z1WvorJTI38O&`-m*U6E0hO2b8YE?DRCcD5-}Pq=8eX
zSCD~6lq58Q3jO|o;b=^fCX{8)Xw>K4-F5!#PyPg@B)!p?Q>RaH=FA#FP@&aoG1HnM
ziX*hPplm!I(>>}Tl){-f0r-wfo=*}&jX@}f!f47YLrIDMfIqjEa$*fz+Ay4Q!Wk5j
ztSE6E$GS2A$_+sX%0gPpIxR_4ZG#6hYt`ra4z8;n0DhmGnr&1pUBHy|1|$41B=AFA
z;}Df8jw$e^%cyrmcl{oEbAvzs+SmDuzj&1(P&6AAuHCr92iI>fJv+}EZ@tSw`;f)C
zIebr2tJN4s5#4b_y-}xHt#b9&Ee?A_a2$fr$8!Wym>&Vx$JWZn+xdh0+>b8<C@}Iv
z`_GTNe*9iP>7=a%$iO4l1z9vkG^+U33Tc)Tr#ZuMOt*iR?|uJ=T)BFOc7H&LLs*$2
ztX2pEpFyt!LQ-qg+1uKpn}p1CHLdw&JU_&%H!#W}&Fl$c)Xx}?5^6yesXg*6B##DU
z(STwk$i|Sx4rLNU8KZK;>{ONIMjhX&(=I(~iKI`3$YdP#3X=Uc#*z5-2E(jm`>@Z!
zFhzz<I<cW$T1&wEV4Hk20&UQxH90^Va9s#PjO$ufnYNk-;Rgr}I!bW!f+!QzW(PF0
zoQiT$u8$fUd{crcKhYD3PNxSL#<dYymXanBLVzwbt`kxg21j`oa3mQ?q}kg!z>z+y
zD{CNN?_i7F{d=6futK%rGBa00d4jF&yY~24pW)Vxn<z0&k%x?<jO*9dSz0*H`uY+3
zdjpuS(I50d+9t=w#y#>Pp+7u82!|)0e26=@c3C?!&&`{+*xI>CwH}aWJ=%vGbUTam
z`fb+EEc3{t7peMHM#G51!w!z{IJI(?Je6#$@3Fhr<;n-QSy)`acN$~~G-^}4{L)Lb
z+xr~u?{UyR#Bn`_!vUV_qLd_wtoOSVf@n0taU7n1{&{}(<uBp5if;Fic6*OOe?XEZ
z_o>4VoX4b+BuUKP-Y!LvTa%P9u=d=hz*Q1sBpQR1);Y1%1xXUo9}H<tP4Vl${_9-3
zdV~M*fBJ3GEa%I={1txg=YN5<Q>(oB))l5I0r7aqYv24nFTVI`o__WPUU~H!h|L|Q
zW?E!L%6sp<&1gL0(I+mW)GSdnW_4wSU-^|^;Aku3>tFjWXV%X0!e>5%fAa>{Z(gU-
zs8X-ZaBy&h^aSUFWx|SY8*f=gUM6TVva}=~XCz5M82ThhN)UvkY5I4&vH$<5A{n4i
zl+hS3s8A1E^g2V5agOiSsMiAegOr2aecpciCNpz0)E4LH?%rnmAfQ%V#Bt6diUEr)
zLFCV%7nj)Ij?j6BwW*BL%ZqU8GX1zpB`f&Hzw)23y}ivFKX{A4$*rAsSt3kAB@krV
zq2+p1!aBRMPIu(-op<+n_xt~n!A`+p+9Pb#7-aCf|LPA(<CxXe1!iX(=sdt-n(4+O
zp;sXxr4m-j^TbXH3ah=$@`9_^uQG^7#0Ff~!x45(;W@5#dsHr=7ve~V=5&o}y@C+d
z;Yum%JSkL&qpH>_Tp4Q~pd<pjezg|jR@EouF}<g>L9$w5w2u(UNz<$>OMKr)oAO5}
zO%Gm5DG};EQ|1^*$ca|>cuFBA<|}Xv8tymDPo5`_X{?g~Ib%>#QI-V=hwa@qPpr=4
zxDJg*gGRGX82S@?|LjBxP_0yOoCrVg$%nSFS)gzog)s1OOaMPNkgyAH`=-aibXKrj
zkQX`CdV{0BO%I%&n`Lfc;lxr@0FH84n3<(stMTr;?{fF<-IL(7A6E~C*nL!t?L457
zIKHo#(54<-*c^9Y?}G^W5kO*5--m8{;Bi6<lrZ2Z94!$>p<IO{O3)5d^(H_4($Dd`
z|K<<5)*d6>jQ)5`w0^{^w|7`vJI_?DNpEK#H;1*gvt)6?U=S0yn)&Hj{`qhJ&s0oA
zG43IX0)qtKp%fal!6^*7C{ck+WoC*OKl2$D>Mh=R=Y6i<yurc20cBaxY*g`FLGQ3l
z5=Sg7EtBOr@4fvl)>K~*h9OB3^VCyMGBwpA4C`FJY$q?n;Rq=mT*sqx)FIDHgc2lq
zae}0evqX|4#u)1fUzQrzRisH~^(&r-*2V&~$;O)J)^#J*pd5n~f})h9MS*hcV#~*#
z#4=$6(LQMvDnY5Or*+Mfcn(y2NyQ8Bl_5Y=L}NB?UT1gX9>(?9-Pz~%#u1<Y;!8aK
z*ps~R<~w}v2XFAqv!CY7+4C4(aP!V>iX`UC|M2ILQcz0h4+q@1b(2oNj}eMIOG%P3
zo~urP#DhVQ9}S3naN_r)WhQ)SHJL(w7>IxL5`GlCf3!*rUL`~eLlTWqCdZf12z^T<
zJUnD~r_H-pt}_}YR4aAr)3eOZEu)Rb_dQlumhc=wtrGD5mFw(o-e%Yvk)6K4skO7z
zn^mf{Cd#j({0h<y7)3ErluiWYmV=wdBZ?%Z$P&^xA{zEd`W<$zzfbRA!1iE>xOszG
z#bIu`#(3Bvj{0Z{(y~BEsI{iarNhx6Vlc{3Zk1AnB)K6;3mb-)#FI~dELs7I60#H=
ztDmug5(%005T{g>!euNgbdASB=`vd?yiyWa6+gmgK6!h`{hFUy0BLA8n)seWl12z)
z$g%?8sW4NoFgvx%=DkCdC_$%0Q9`pehwr-FxN(zvTiX;`&}hsvJG;Vg)Z^;4_ju^y
zc~+L@7!5PlZ{6nL;4XRUF+H`)^i-4c=T7na|Mm|kvw~h{k54`KC>Jh0$vf|Un@Y{$
z<(FUL?YG|H?OPx4xu5<y?%Zrs@m=cx)IXwDX)!lDV>Nf4$8b1eJdAn%`3j3m%Y5VO
zuQ9){$U~Pdfl&+xL$2Mp&i=hSAO)kS&))tP%|?ag#W_OHWxCm9dTNS1O>Giwo>C++
zt|OVAo+6GT_7C>(Jdej7e}XT6`O7^1<fHuX2S4Q8nR8@mLVLGOnj{24fU7m*(TLG-
zh?;~VCTT*qcSxhrpfm-Bl7+=NItK?x*RjD~j-=2To*yz8+hp%d!*BgJzsc|XtAEXR
zzVkh_7BuQpy!y&(eDzOX;pcz;@AK?ak8$(P9lrHfuk*$`@6w!Y@r5t^439tgEL+>_
zlt$rtRjL)}4^uWa4!Lt@7teQj;)y3{P0jMqBWEd5eDMA?-oNq=tE+4He!%AD2A-;7
ziXn&lBNi5NrkXWM?J|r~gh~l23S%Uck}_9_z$YFLSX!PZiaxpauc6yuG#)eP#biZH
zwK5OdrQIHq#2qeOzR1FSlg?hkor67=R?ZWROGF@f`0@qn^(C|^DAOJ*4=vFdNs_Wj
z9QUaP8UOIJpXR53>P24PN%;PIZQO2`&;Qhmbh;gO?%kylTtqNrZ?8vx5b@C3S!SD4
z^rIS4k`v4<^Um8Hu3r0qJrfZo2IZw>aY(hggc2cHHfA&&B4xo*yGQ6vF&ad)_qHk0
z97h?#z`<x6Z0orSKk&d9nlrN)Po8x9UFqO@E}<7#VYB1lC`l<&N;2y-CM7~Blu#(;
z<2XJ_dRQ~b<L0*o6H3~EMRP11L}SP;>%uq`$4ROu=T7Xp(}+n!{lhwm2hX`m$Pa^r
z3Gw%Yar3}qAN)C<M%r_<LP~HPHPKNhROwI{z({hPQw?WWSX@GgBhoabEDMaW?y1p<
zmQ`5iOsyx0-vv^InA|$0e%zMS#|9Fv<DKxr%tTR+5mYNRT+gM`IilO^OvE9AEKQke
zwK#j`43{oF%%I!l*2Fq?I2@jE=WTb}oH$V3M`Q9tOnrRYG3XEolp_Jhdd3@r@A)Tj
z-<BpLPTqqDtnEI;6PHZh`vD%>gWXo^UX7!ywP{({Yz6H|gyS=aB0LlqAO95Z{Mk3H
z$9%;{I~l3;7)LqPAS4~8h$Lg&?=cvZxNenb6w#M3=nts2T)O}_#)@DHO-TW|q|6IK
zFQ8Vhv3P0~Ar<ev^B$woh{c5kvOEW^snr4~Qz}c#C?&{qjW#9A3-cJQL1;RiBgVrH
z-~IOMNaZp!v&7uo9Gy;&N*HqP+<6ujmQhmDnr|^XJIBt!KD~aA$=7K4{*$!TD6wI7
zI@d56_hqG~$n%Luydq9B%CaEvLX5Ul8w&;vAkezRaik3~D-2SAl%KpD37sdl^NgWc
z@yW{)lg22=Ayfic=HyvI|ENPL1a7@Wnigcap*6EWr8dPl&hdgOZ@=>%FMaVPW@o0k
zcl!p3E~z#eG^bnCYE=$8ha4StsW$6)eh6_w66X{}iNq$J^Wfs%Otx$8Z`c365<*X$
zCO*7xeDwN9CxSn&N(^NTNPDmx4kD_Ki<p@q&kNSqH@J4~E}g-M5}2Ew;nE|I6I5%Y
zSw<xcXf^9pLyuv<OLJp`ez!+9Sf{@|CKNq%+C~KpR8YqW>)=$0vVtfr!SPY9kI`ll
zx}~iby;ouEX2im!sMd({5ySD2G#fE58#sAMjzcW0IYF)^X`C=t5qJTymgLeU$}~9{
zrErjb1=kHIeH%O|rTq~?VoGaYZG^-~8`dHmmx)O{!howBf?9*jX|X>RID13VaLoCd
zgKI4I_yi8@PO4g|vESZ77b%9EnVBi}c6RaH03|%8YO^R4l8m89745wqMXFhOXc;91
zX<9Hddj{zm9CsSQ47ISuLuZ>5QOQU&dF3y@LA5f)V&fERr_Yk-1s5-0<ksz*oH<qH
z*3~Vhn)7UL98eSmu9)R;_lQ6KgV!02BI@-PvTX3!!_V^iH@`)rIz{*3h>i6f)=n>y
zWEn*vX*Op0$G`EP^TrR}pjv70zx;3iE3bX?HU9E1{*pJ}dXufqO-`LY&EoPr%PY$?
z8g=@^J=~pw{oPIOT)&R*d5~qe#-I#DgCTjE;z~)J#MT-)jX8JzEWh<nf0KtEdWb96
zK45NPhW=5PCmws8qjrb)-+$NAnzTk}CLwczEKLwb6NUkKk>Uk5#I4giL^uLh3X&qD
zRt-5k=<xKVC%LnEmr<%&J3q(2`;&jil`FRh{W>elr&(QIC5dBNQ&T*A;UZ5w@hIPX
zeTPxj=Y^kn0l!}1XgK7#7hmM=?{Co^W;jlTpi*IG+NWM`kmWYx;gzqx#o2SGxbRTK
zV^3eit0)#1R%ukHxqj_7m9T~s4$Uy*u(!kJ?S0OiUZvG+vbDa!IPEjH)FK|2)ck3b
z@)>jzhNCenOD-!*r~j@u_m5rc8(n5*=g6`l>syCRwZ_b}R@mRU#zDKs<Bx=_uAJuH
z%_FL6no&PzV8&d2@iH?@%d`(-e7}L3&~`#!Ao?k5E6X@uiBJ`KgP1{Yz-Z8=R^(i}
zeVb@Frc!ONxbi3pKY@h+03ZNKL_t*d*019F*0O!7wZvR&fxO81+G}5<o20~L6H$)v
z1BLHsASKBol5RoZEMRoP-oXJoyBU&@zz<kozr~$9eS8&Asd!YYKE5v}3DUN~;yNy_
z=Mh$|hQM`>kE52(1ok*+Feujr#~>AxtTKs`E*J+XJtQ`yaMCxv&s>qm4W8qkKj>0m
zl))5}Nxre#LJ$+6A`rqJ%RdSrj<0`++9afXj^V^k*-j%A#{%aEfy9GBkV;LmQ6|#}
zCZG41H6yiTG#<0RcSI=nsD)6k*O5wC?VjV{c{Y(=NJ$V%f*{263P`|lttk>^`5%_r
zRIAqj>i{DrB23TstT(O_Xj34?M2}zu6|cg=>;jKmdITv1-A<2gw~z0IsHQ`;T4gjE
z5yuH>n&P?+TH6q{<4&s98pm<Svg|~FEu|zc4OVA-AK@V<l$yLi2)j{fqaRr0Oc0;4
znF(2*!z7;qIC(z{U?yO~ln8CeO@S5yBNaJ@vM>}yiY!Zzis{*T8qGQfhiw{D4O~i0
z7L&yzJg<UVt<sN2%*h3&S`E6rh-Ryf5j_fW!fF-eW)QlF$O>o6!hn$|<&%^!*gs-(
z?|^$Z?lC_-i<FW$PU-gsG#YiDdiptB$6+`au)Vdx(dJ#6%_eJS&r_B;Nt#lvw+O;I
zeh_f#)M-wiKFi&^clrJg{(wfK!HrwD2!oI?4Do!AmE{#Y-)DJgh1FB1*xA{pUTfh8
zKAocu2L}f@u1iuB<Yh^{K4TZNLXc%STBnnpz`C*&r4{gnVMr83CtO}N83h{SP?jZG
z_Q}hUAkR@!;3-Ab59s!~#7T_jdA1{9P46(J?fO;1Ducl;b8|C{#xZ+`J*H+B_<KL|
zMZWsguQI!^#G{ulGe0*==)$eL_t@UsV-(o{E5~!GRI5aJfsq0?2$5xB>1ZE4E<B)q
zHXi}bKdJsY5b<C=NTK@cN(gKMsj&yke3URA$CRaEI2v>J?m8R$2l$RleQJi)(`T5S
zU!XS{6IN>^aYPiw)axPjdY#pk1w=Wfz29csxx;3%$M$;2sDMKH;8rPQU{44^4JW7}
zJRgjp%r!zOTtC1F$f7Z3(4+1egrg8BTCG{0eeP*4Up#~B7?Nm6nv5uloc?%BDFg+I
zR7>JgFv_4e&KRZzTDT|`FdC(x)nqJhN9Z~?l%=6SV3dP!97<tnB^ZMO0;zBvpFwQ6
zz1e2Fi0L*n&U|W)0trTcvVla^imSEBh~goFjKQEs;MEW&WK2wVY?I7&X)xL_Gc!XN
z`1JZ+^1L9d*9mJLjrtU5yU<QzNs)oc4G*7xhVIdbWNZliCWHPC-+JwJo_hKb9)Ii-
zN(Us7U}<R{O^WM#R4O62Z{NcALLPtgDZ;Qyo*R~zm+AL=Y&)BDdp(X0yR5C9<6ytT
z>hfuBUcX6}Wh^c(@`r!)N4)mUZ}8rG@6u|uc;>mMX-+i|7{2@6Z`lr^vQ4mi_wI1*
z$`y({=eg&e<FlW6ksG&eGaU4I{`u$m*0;XJ6Hh+PXf)#Cix+w6r7yCwyg++@hoggi
z>SxwCy|&6XUww_|o_!i!T3tesXLzndUgTtH0#aa%Z7KoB-psavXEae7<2ZsS8gk*n
z89d)%b#0pW-ajN7k7>7WGBdlt{@xLea*0O~zw{4&kuQJwm-yhyJN)UN{V~l}h0lHQ
zXC{tNB}tZX=G=MejVX5b4w-JvP_0@^%{zD2`FnrwbKJRe8!18t!;IbbKBdf=pIPMA
z-CKO|r+=2m9)FBpXF#)I5W;ZOX_LhzgHD9wg~SnTZbxiwM;skN;OsFo<8k@&1?sga
zJU2jo{N>Kyd0oG8z^A6qFt>1?TX#ByL5tbxB|LWnW9(wN%u5{C#Z>{03{WQH(xrzG
z;SBxZF0Lymoq$YKXoZs6QIC3~O1CiF+D*86>s9XdN3^?|TG-%se((PwjZ@~PmzZzN
z(3~668MsukI$H+`MG>>HeV4uVJv14m0gS?=ih)ikOoC7b$r!g;MY)<`bc8#h78wjP
z^EI0FIyw_LjzCC*p|IIr(#05s<9IlZB6JOov`&sfS<Q@8*1FWTcm+ZQcI~H1q|^v$
z84q?tSJ=tArTp5({R7ZJ+;<lQfl)46Xi9AXiPq*vD8csik0%o9gkCSCu(TyHu}_xr
zzD~l}<nd!LB9)i`ipgVyIJvZIS_?qb<aHcJ+3&@;2n0ou<EfBJ5Hc7HdG<4pFf-*d
z9*+pakl|p2RG@W05HMLcyST1HSro)^hF@)9CZALOd#TPpS|5AQiqqKISRM1@wWc&B
zMPd^$l~f2oDnXW|xQ@g6-Fw`)dYv>&Nt1;6**Pv;xIh?&j7CFxy*^u8Tg=YRva)iX
zbLY<CID$KO?{MSBO)8ZNQ52m3i({d-BRz_u#FXXa4+*6%t@UhKpp=7jems4{PAQl?
z&eE5F$!N(;CLs48FHkT!f#+pOA*>gF;J7Hq#psesEo6GC!Kin{xO+rct5B;=S;|S4
z;rKo#i)kP1v9xjlAr1XupM@EZK@>3>dk_t9rHc^(UJ&AxR_t>uFs}j_gU$_`o7-q(
zt-<E!<`F{h<{R&vd{??G2&z>UmX?`cS|*BO@`D4?T=VdwPx9Dfk8|<TMc#VzZN_oR
z3om{aV>DTo5+xBwhlfxYuHU*!k!jv}`)xeW#q)gT=H_TN8!Rj=^5~-vQ<j>YgF}L_
zLcLa{*B_83F`lc)^Ng}IBuPe`jLFkt(izLh3+v2ejHW;6p`@Z#uOWoN^*(tM3C{~G
zu=X5EZSzR9F2MyUtb>@N6lGojIYq8H=nOdj&?8jp)AWW3D4)xZT%_Kd;o`%O;Q1bF
zXU_1cXP@A=|A&8$)|z^wffx8x1M8DM>i5BQ@q8a07e5Ljj_bY$!QZH?=|FLE{jaOz
z5${hbC7{%R5Gdu43&=}NoFpXUh@HJQQV7=8&hoi0ehC%UdHcN&*gHI8Wo3mozxQ2q
zp78n4{WL%K^5>bGuJHpiq<ge)1^-!w@_Xb4@G3}Z2waTtU~ot=azHpxXvnR#aT)m5
z6%7Mf!myt(DsxPk6ZkVMElqLp;u=$p3VAjrj>ZUK5Xz-H=+hmJiF44>CoKe>QA|I|
zNDD)u4Ts$Ud74vZC1sYQ3r$%RHk?mLr1TIdhEYUO7S;_5K`Ir6hF+Rc#yREih-4|?
zAAI^tl*V@C%D*8H{Ex8)BTEwt1BYsDnlSXyLPMcYN?<4%MKO7qGmc}TB%)erP>Pa4
zw+D`9b#{TZGpn3lTcK9>ZN5m7lcpsYmrp<QQ~Y=T?SD_TQbP)#cvNy`^&;Jah{d^6
ztp4ny^g1J^XX<Qh-ehHUmQ!oX?CfmP>-EU9gw3s6Xf1F(iRU{wjzd{Mk`$aiy~f7+
zE(`MuoIbTm_vnxh-hZDr-*|(2>l=1@m0QQWcKZ;|_lS~|)zvx9ojZr;U7Ji{Lfa(M
z;D;41U%t$EJmxol^EX*oSU~F%AtVo7xWMOM`T`5{v-G-02%(`YIo#jp^y&(??%d|`
zBNyrR4!CjS26<tpZjPfS+m&6g*u?kJI?6bXZTN_kO3f!t3!ZxBNzyzaD|4=2?~)V+
z^=gg1-5us<mdLV*M?U=wufF<cbUPdTqhI-DTGOB9%JmPBvcVHiJi%Zv;P9}+HiFN*
z_*uU5o$v7U)6X&-4tV|b*YP}$dcDTWFTc#Uzx8eQ4z{^=^*X!zRi1cEa{2OQZr!@Y
zupdvRmp1se*_>i?^A?r5<kPLkc<918+#qFRtIc>UC=~R28F74#=RS3bTet4vxt~1K
zj*}80)v!+H6bNCrJ!7n;y)P?BEhvj2j?zd+krW114e50H+}zwI^ryKqzDJxE;8t)Y
z%r*js(E-B*UVVR^L3;~)7pZEDD>L|h%4igExZmTgw+0k?j5H2`UuR=|kIjvBBm-&<
ziK`@zG^CkeJW45Djc}_Np)jU_5H7inn4X)$bqr-}E!}I45HHLKYZc3E5gH*Tj*-ei
zpm1Fu*K?@2lkWR56GqsSA}J>mT&XBaNr^y6Wr2jSU;-x7a&5mqDJ=6vO#BCrGkK1G
z43<KKz&cl1!H^AVRSM;L*49;)h)LdqQ3fLf(%5yR6ih5tEl80QHJcQ|0tsO!4VJWH
zCgvGpGM%s!jQh=Ti6abw>mg-{DKyf677~F$7Y0A5a?su5#*LU4KJ_?7QP>b@?E0f9
zOR~b|uSw<E??OVgTA?r&j7e;x;cr_X-~M%AQzDN?I=~6_NJ@#(#mVhTDY7g(5mQ^W
zcu1b-yz}<kXk$@b5C$wQE#bN@&1QqCsU|_-v%9y;($W(Bo()$6+d;|m92*br*r~yZ
z?C@AmG2yzI3HMD(q_}SldklhLGJ!B9MUj8#z7IRlSdRcDluZ=G>IMuNQ{+gkZSt>>
zIKEGPs=;7jEm?(<=%S=3GAkGj1N!|w%PWS(r3H3(cgQlq?skt$%S!~lwg#I<;wd}g
z`e;5zQ4~0?gQL{RcPpi|0=c53R;x`$U?o~-?CkEdxxGV{=J>vckS>Rv9@nnl<otz)
zIeq3Vd;4vQQWFIJgkz_fpIfl*R<27t8Z#UXDa(@KaLD?`I)lN0dZUg&Fx8wwI*N;z
zE)tJx_`c7>m(ByQx4TPGYU|&uCHwma7ST)ad<R`>vOGQ!SZ7%}*`_{uK|*N(T51YY
z+JlGm34DjJTEzfKKF0T4lC)&p@8RnTo&K1s_x5NloMUCS$(^m6eD&+!<Ujk3-yo>g
z_{M9mvU%?&GqeAUFTC^;=gyqsTi<@2oqzE!*w}7UZB)@lTNjAQ_975JcH#eF1B0LZ
zS&k`(p68tW{^RPwjF+ESV)Bo%E>BW`@3}-#OfpVLGea2uf7HEcjAqw)=l473-0fX!
z?^?R5_hxgKNJ=6p$x>`BBX2Sy$F{~voM4QZWDq+O!w3*$@#lO<f{Zf*#FJz)hzA42
z@gmuZY>ljqq$G+WDQ?|t_QqbSyY_nP-R^ppd^q>5Zffkzm<EQ{0SevKRd3f@_nv$2
z^M9WIlJMZe4-+?AT)uvjix)2wBnd~4u3;Xp*jT^La5UuB#%(UX@iNCwAEz`a{qMek
z6VPZwph1&iiX5B!A00Gfgp^q0u*TqwW@3I6hLTA6EN>${?Wins@<Gnl&GTGMa;Cct
zihRUq*oT@DwY%42x7TM>R2TwsEhr3>R#F;AVGAl(k`*J0QAU+%Olfer#%Sv~-7@q6
zky1e|x<)Dgp)F+I#uJw@9<N|2sDytE{wQlC2E!iO<iswa-E5E~0o`tkGP6DeO$zV0
zMZsv~1=)fzgW-_URNP*_&edCQ^3>B$P?;fN2xU>AwPiFc84W7-w?>Rd89(`{pW`DR
z`7!?dtN#+E9KZhu|2K<^OFa1Cqm0u5&p!86{^MW$JdZqjhMVhG=u9cH!Z92kaOciV
zTCJIy4rob|ghr!<(a>l#SvoS$pML2JoIbI};GoBy^;;bDd(6#E@xVhLK5XjTymb>}
zEXPlr;^@jzW@hF&e&QtE?hLJFi?YbLa`_6s_j|v`v17+Lefl(~PoL)O*)!a_b(0gv
zj`8TDkI)DtZ(n_j-rg3r%(!y-0$4{JC1m-C;pl)5fA}ekDR}*jH%J;ylnOl6Y0`)j
z8m%W3RfiP@CpAG75hYEIuB~t|7_hOuM-Y1f{5VfpSz2L#?|_rXkMX5H`F(!uBOhX8
z^9rxL@@;<VXMUEsBePt-;%UoD`RBB?hF|%WU*Z1yAK=oZD?W|hIpR3xx#yna=+UF>
z?eDR$ut2+%OwDu{k1`&7@L_IUyTk7G1&*IM#`e}Wd66<RGtJfOf;)Hm<ax!3vnS}z
zG&!<(i^atavZ3Y9odd32l|21)0zwmpKY9(R$ud=lvn9egq>Zpf(`-5-rLb0^twEYG
zq0Gs3MxKqBnx3YpB-zN31PPfQQ08MAjR1mx=6r|oPLGbu36Cj?#TCLRLb!;F=daP<
z-b2a&bO$M#G{cz6^eFX+cGN*NQj{uuv9Ds9jW!LXS!g%8@9a6&R*!T3<}Q0_lkGbx
z?J(!FKmQ>*?SRV{*LnG+S4cXND9Q<iI@C3&8Z5k1bKvtGgcmr}U4CC+Pij4ZLnI}E
z@Si*93vwaucG!gi;R2)!@rlviM8_T$&;GgOr1ZK}A&BD$Qw9he&KQy;raK)VRE3Zl
zgu_WeB_?zy<>~f7P-iYVQ|lcLb&2Be_w^<}cpxEE9pN&eMfr#YZ(0Mh-5IuTUqIU&
zWg-mP*NHM<ySK-OK6a9JTjMH2yVa)MY%?`8#c(trjuX7crX!LeQ6z~YMIu8=8)5`V
z>v%WGMDH3%%*@RED}oSXOsyoBSTwqJ`$^)MMzeXy?ef4uP!$D@MuTydvATMc<)tM~
zoH)tu?k>aOkgt9H>sV_TjmL)v-{{)$saDzpXyenXC){sufvvn2fQi?=KZ%p=Vy!)#
zXx!z=-93Q!2Hw3xq>3Xga*WfS$5$EzhByd(WO-R(bchfN8Adc(Z4M6hiJC3qq)Q+L
z)@p(v#2Uk$ja!^N{Q&K5htYV*Lc5F638g8)6&PC*1b1)#_X^3Sl-P;qZ#|+btI7*%
zLJvNQs;oC*SWjy-NfI3j+l$;V9A;d)bd^r0#Uqcrk06L}&ak<)$@caZQ&U}nT3;ds
zw5K{4V_0@D9*qbi-^uOudW=V7db>OP%eOBvGc!vRMNCa~NRotuexJu5e~iV&6|@mN
z_~1FhC}ewUn_h39vb1!&UB>B{G%YY@qHlS(yY#(VT7>8dgtmlH0AT~wXh0B=Wn)IU
zrZqiJ+?uA6C8&hm{XWa9$7!^>%*`+IP}t<P3zym5-D7Tkj-{1ll+awieuEEv;4udK
z{yGW65bGRyS<>is(3PPWr35O3n$8E@z2Vl!^Iu0n`r&misQ$}d`)@*%at=>_v=&_%
zk|d(lYLgcgqw$z13^=-Sl+$O=A>%d+i_4rjcaCp=^P4>T+_(A6-})ry?mNY$H_!9N
z8yDy_+dTUIC$P5Sg_qu7JO(p@$^z0~vmwxK2c&s{$$gr3ARI#CwF)K3(h#YNAQF^T
zpaOvk3__O_<82OhLqa!&)dl6Kk2Quo%Sh84sVxm5Nb@oIAf>1*21Q{E!(xPtyhU^|
zt`L<YcA%U<*IwQTg&?E?bZx;Yl&TvL8fyv?6_N<SR99gzK7k(ju5SE)Q<hY|o8BMp
zQ<@N*_H<Ys(1-)Z#Sj^G(biBIO|#u%G|JfT@6&8FFt(sG6VjOq2?EV<IN;!*ht@Fe
zS8Q+g`Nmhi%||}`<1`vAc6WN*clJT9UcJhh(+_d&+GW1J@eQoioIJgT))_Z$UgG;N
zKFjX@Hr;NA!Dvj>Xd+cb5GcZE;v*k38jV@Maf@I5JO2^SfA<;w{HtH4EHy`u9;MR^
z8Kh$d{XK#(qSfj!zpy}_=XAQ$<YmR3%`Kkz;FCP`;6q>?`}=$R;H8&&=GkX3*6>q5
z^;1kwcbM*WFiS^RSw2F$)!^Wu$Hw|CPX|?kgJGXWv&s6M>&#BK==b}Cq2Oa5{}@@3
zbM@*~;<(|9nmTk!i2$c$O&POTVbQK6(=b0jkChO`4Q{S)fO8b3r4hE+-rDBVpZpY8
zE?r<}cZY+6O-`Ra$JhS+k9hOaYy6$R`|GT%tn$)JKVV^DflvIzCs|xvL`un-GpFhG
z4*1^po<|79&714Y&CT)LbI<X>xrZpqiX>^Wv$MyAtxN3f4*2mO`y|8Rki8vmYwIw?
zal+E#EMa084l;Ik`jn<*er|<@g%gYqN*=hs;s-x?k@2YH-2JB*r^EMpyZ<$o55=8i
zcj>yb9K|69pJbjy9VCjh98qY?^wC*HgOp)!$lQ#gzdxWXJ=Lu{)g??~n(YQc2(q#w
zO*6oejWpLTSWM#cqEs9a$u`E0iQ7$NphyQAVH`q)C=nt>6KsQKBj%9@ALXG3AK~oj
z`_SKior63kk()@F@zDJb62}m@HaD)_WV$24^=QP=p>9Cd`T$u22w&^?X+k|rJN!US
zn#U7UkPw^#1Y!at>LetbsKJ8)nR7USs2!gC=M&S5yTHO%jT)&coJg@YB?v;QGN&1Y
zD4}pl)zb(?AQgdw&<O$r6#}h%(}(&!A%mLE<imZ95@>1twOLc5?u|fjN@0{`eqoO0
z^@!BwjPnX70<g|A5KKy|(?p38rLHJ+iQI={CytY4DW%p#afmkh(0;$HN)AR9aWab%
z9xQo^*I#Y@wMc_ySstqB!FTbEF`xuWgp_4Pk|bDQFdEh(UvX$lSCu9A-FFUWeF15$
z<;_cPvAerVnvEHc$KZV6U7!?U7-I0b71mnfIQAI`cyOVl!g<vVR#$h$E{7n;a>$6g
zM*}hG@H^i5byM5a!d?A^QUO+g)&?OZT9+ss6;N59?wnWFyBh@|K@{VxW!N7ulXNgf
zV~QM*#BsuYZ<o&Q2FoiaIdB2n+XFVXh8#PRP-ZE{`lM=APaP&AbFU>(K9RZxbhiGT
z9I^&a4g?fs;Wu{>AcXfO*V++AF{U!??H%x?|M$yuyB%7sCP$7ekQWt2Q4xj-_uu~z
zQ&U|I`aRyhc9kd!X|-D9x#!$Ys4Oe37S0*Ubd0H^*sr~PjdUzX$0IiGY_NXw20;+e
zY)^Cg%sKKRqmeXt-}~N2I!=*FG1YBT6a`U~kmn_XLI1C_P2ZDMs^qZKUs@mtfRLhu
z(niR}6j~&Nt$B35&+cv?A!CB5ffL>*{M4DVeEyeznQpgB949oJO_r9ISUt8%5Gwwk
z-~T<%pMQg?sVQKcsw|OVjC0=qU2EgJ756MLnFiGBUUBrjA3wY%+))32+y&N?&nMT~
z#9H<*a)~<pUL_B0P=)Zu4c0nJqsjA<MytisAN@E{(qL=vfXZ0TKJXyzsTsci;)_Ia
z!XuA8%G~TU*RQ<AV^2Jawh?LBpw(Swl=YA*##9*+K{JWGqlYdCv?j2YKso~9X;yW3
zH^PB(-r`w1hq3<O0$~^)Y%%JFv|>vrL70Ln&&ft3j5Y`-KwDf<LNUe^725cQgsTe1
zBjf3o8l)Bk)}fGu6E`e;_DVyA42{1(NULgxyNF6joHca2U6$vUsk8-SJ#Y6%7)XrA
zL!@#TTM|c&!&LGr_xIxAU_huOrOpw7V0w0nveXoLL8FnNB0;+y5JVN)jL6Fav`vYV
zHgV8KijckS5pf(d91Z!kU;8ya^7KbpTsp$>W2d;izE09;@QF`+j5Fs}_}&ZO;0s^+
zDs%G<+MR^ac!!y}S+dkH9PCjQ0b$U_8beuVioD|d8*ftPLw@7G_<MZ)>)&E~^A^X~
zj?n4EI8pN2>n{;U4d#y=AqXSFAf`LjVrOTU?VUZQW~Mo^w8-^q*Rj@dXLEzitu2-o
z=ecwH7T@^VS82o%4?cK5frQbp=e_8K!Pt^8h?$?ArZk!(3)7@o&Z*PK*xK4=e&Gn8
z{?t$K$63nF_1m->Eh=N`4y^C!q6E$woC6gJtf)wuF_kr-{Ny+aW2`nb;wCzGj0Z!G
zEX;EH<UCuOS2_R2fa51txpL`EzVJt1;1_@CZ}a)jf1cf)U3PYMIe-2<k3RY+r%#_|
zJkEIj`R{S##;rq9>DjYqX|-GI_jmdD6HoH(=bs@8V}`>q-+TUfl#DPMrlzJS%8YWD
z(r7dpW_#@I9?<N@6gnjsfr?^^vE}sXvvfLLzWd$hxc~n98T7M%-FEyNy95TU4PhV=
z!qxRm?cjr{DJ-$qJO(>dT9XgP+`fJrMVqQ9h@*rkj7gG&R<ntf4jBlXGswtWyH~oP
zNHq`K_Xy|iKMq2&x1+gy`3^>m`SDLZNweMIt6zDB?K`icq$Ug^lB7ixHt4peNLpP`
zF~hV#sgTjZfKXbblDz)%1v;IW+v{7j;ucelCPIZsRUy@+UXzE0I8rL4l3s7?eB(!X
z(d%D)oNQ1}BDm)<cZfPbNSvs!l=U}Ex@rm`?wQUDe4@LP2!gs%Tah%OKir}<Y;vU8
zBor||6=K4L5d`@6sPNhcCk-~JnJJSzr%>Re#RYgul&q<@(!Zx#pN$l?;f!!dVGu&o
z>LxgsGZ+^r1;$#6GDlN!?dny+r52^Gn46m;jw8ydVtQr<V=Y1C^-|Uev@sNwCJLHZ
z?Z}H1WewurrbfbxV9Ub-7ogE-V2mLhr6jEclq9PI=q6os1mvX;K8vG>D_1UKfo7w@
zkt0Wl<Cr6hN7&fdU_4Gaaq<KU3kw86h|v|hdwX2EbO{7BnoYtmARiCe+uI`yeZE7b
zJ<tf0x6Jb5(g`xXo0L6y?}vqt<nX=T>*IU35E2xXLk0mV3<v^65PC<d(g?5;ClsX>
zSOlduXlsaDO|%AGRmh<Bez%S!ZqVooEEU&pUgv?6kI)Vjy@NfDOe=5o<sv_NtB>(y
ziejzx<6%7KZZcu8HCWSCRnw6oCTxkaGIw>h&fyBr#TF>q004mhf2}UM((LZ;v$efL
zH2M94h}T~~kJc4sS<>w^Il8h&6h-WmTL>g;YsXn$UZ%(kZr@(##^4IGvkQRW;Z~O{
z%gC~fxjC=jc=OGRI0vu4@fy8ek2sF`!7D!?3<9Dk;^@&;f-t~Yc=+K*SzA5&Znx=s
zwnjF*Ta;S}LP=@BS%*?B8ts_W3PdtPPRi|_+lZh+?_hwozKBh;oOY|lcs%CZxs%Lv
zWA=Bqx$o>5h6lU!di(SadN?5o6a-O1RT)qLDvFS0^_NZ#CV=9Hi+p(Jp1=3&cVBx~
zNA#E31CRYm001BWNkl<ZzTRuC{KFu`Qy+bUNQK^>FVAwMa}<@PJ(cjt`yXR{V~2y`
zi0$5xW@n10KlX7JmY0c=gfuTWcKkT=b6t+Etnj5j`3l#r?lV1inysBTkzo^;<1LKC
zCOAVn)`UV32#d56kmZohA@TQc!CfEiq7GDd&al0+LlQ`eJS9?+GA~He3|$py<0vXa
zR#fDLAukPCrKz;>G7JY<X$ZoIhyY<6x~i~9VnP&wce1Jkv237h9WrPA{VIwR-=MH5
zQ>{5xmye^h!x?*MAn~KR$|9%PObEh|=}w0{SEwMQU#65*g$hE(<CL<jd|?qN8m%V7
z;TY{Sjb=bm^(l&dDjOn$f_78TX~#seODnNlxp1BS!4A{iHqIJee(?oPoHzj(cDA<p
z+yDMA5yg^=7tizDx4%Juv_;bFGD=I9mKSNZCF69=?K|r@)8zEYhx~IaFKHwlc6N68
zpa0>1&#(Xb-{oT;dmI&%Z13LW#HmxP96L#8rb(WcARtb>eQZ&T$%`?2`y0IQ!nbKP
z6Pk?<LF5}fXHK8y$tOR+>gp=5z4|gg_R*(FM+anSPC7aul**fC<T>T=fTY<(3quep
zIx3>y-(z86j{fj~<>e(l_OXxh&2K%6wSw^|Bh7M*^ET{Zt;4axyX9zCQRo68J%B69
zk|2tSjDL14EG)3Ky+smPP9HzcnNuGi4ogm-InJj(^FFRz@9|In>Ho>GwPUo~ZKkKE
zan3O{HN)oSHbqhKxzGJPc~)`h(p$WB@iI?6^%VX7z&|69G#eeN!m+Th$P3TE#N5mR
zYpch+*2FsExPcUk{k<Vun|n;pPch1e^auOog=Tn=va{W1c6N#^)m*uJlQ@pv<K6!5
zm!+gKmLOIjJwc_c9NKB(Kw_L_JT_DsR9G?JnL${?xS!JQ&Qs+Xd6p9eF<}^xG$Kk{
z5=F{Sc&wt)3Mi`pWg^6=$pdE|CTt|Ud0~_OK%&K%wG(HNVaSn{H3t2Q1i}$T5lJJY
z)oc)jiZ?I6#`(8i=b+ceM&8A4x;uvo4B!3U%Y=cX5hu*f&C+g_pcJLiwK!Rzl=Kcl
zP9SBC8HA^m-z!?4I2YaRqd2V8e(+F#j&QiT%oQ%E>p)-b+X+ahwPtr`8#Tqq3J?lw
zV~o}$aRVXtYl^P~5u;T|&6>wahf;p3pap2*U6!l>TZ0+jNE0}p6pNDzl-Fzs0v}W-
zyb+7QA!~>t@qxa(dv}<fZPSbegW*1@_94I8R;(<oaO~JTCyushG@F!KGq*5LUgl`)
zwacUNh^o?*MTpiV!daA(jB`(&t!;?@%KP)(i>)({?k7UBBuNfKI*PKu8jHi-Gda+Q
z-SkP3QI@6WUI&UaO}TRA3Po8Gh2bGDd*jYF+grP&Sw@<sIBS`opJ#P-l_N(MSY2I3
z2*GQwzQWb3*BB0mNGZ_TA*8}O;REpMO*tvZ;cl1pt_7@j(3o`oopXm%7x0MKIOln8
z7@VuXIgFE7BAkjbBA}pResPJsN-6po7J+e^vMOnGBtaCBj}6vXgmuWkg0)<_a+%}v
zODxYu6sE$GA0{B)E%Lk|xhRUmLe(fqS?dUt@=3}TpCGNR2Nx2FsvTjBF<>o$2<lD-
zm^xU+Ay6vBSc@*adxEt-^eTuV(yZdOH!k=zapA$x&6{_)b7vdtAWcUI8L_%{iW4VK
zkfk|0JKNm8ecPWu;HeKUV6<j$f1lC(kVevAoQ~Pt+@#10-Wpt_EK01iT)c1rr4&E@
z6F>8Ax9WScHV<;&QIL{GBO!3L8-oL31%>op?HLg?rU+YO4u-cOPEaZ&2t%%3xy(QM
zhriAA!aTqGyZ@M<{>h)=%3Igi-`yk*1;6!Mzr}C=_W#1~{Ih?~bf-agZh>K5F&K=%
zIXc}gwJ-BM^d`7hVg19wauZ-Z(L3GiQgQG4;eflzwW8Ey@^yEzF|l1f{5e1v$3(K`
z6$vofQW;HU!8k`+l!S4Um9-Px-hGuX|Jhf#boDy_<e&Vny!7JpeCbPHV78m^AN=w!
zaq;{GUU}tpq--!XbA+OLgQ7nM0s<E?Of`8vCJ7o8rlhp`u!p2D_=FSZGh#%|f)Bm0
z&KMY%4$~_b=eKFBZ-O<Hg`p~-X7!<sr&3kc|6RL@HqU2$$O#S8;l+3aNCZA5-cdPA
zg`+4&7%aB#jtMNotiVvw5D_a!j<B-2e3&rq>U+|U>YAIGMM+72xXb?j0lmFll178k
zu*A89ql;(B$KyjySgO5+vU8r^(V1!>f-#MjqSf{;E=8)*HYFS9j7E;1{_Lk{#`C=L
z>Wlm*|LL!C{pt<!JSB<(-oAc`Z+`0=OiedAfAIyJ7@%Fj{z0Gjz3((>I%Z>IorU>h
zjMF~CS*E9Fh@%)?Y361Z84WXT-h7+qp8X0x|BJswyA$#||J(o0^h|?Nk2rp88Bh#I
zDPi0oX|#F$_45ozDM9Ec%aq%<Z*l$Ybq4(bqv4Rbxf!aeq|r(^ed-itmJ){n?Zy;&
zIwBj7h*U_}j4AV+G9Qtf3adnY-FhMCk%c+7x9+gAyu_zJ^+{fM;U(XcGnS&9G|YUd
z;_WRp)>iBv^svq{8fI7vy0U2Fm})gR*z0lj1Mg?L8}Q6CFYx~NuhDL$^aq<<xO|5T
zZ|zW&jz=DTgtfJ`S`X=)R1ZJ=2&Yb+Vr^}Ww=Q1hD_{LO=gyvDW@ZKuXs3De&C4t=
z9c6F#fET{^eO8u^G9He}vmBhG(gic~GtAB|u)cAVot-}F@=Xp#d!*@@C<!Su_|`XG
zr`ZZvUY_EMUwE0vpICWsH~U{>g|VY3E38Xtbs8usdE@+B<XOh4GsjSY;@M|kq%ai^
zJ$RaCXO6Up>8B0GqamZrPxQ*%QwIYT&}ubMN>Y>=l~qJ>NU0SjE7;S0E?jyUZ5?~N
znqitEql#y~{S``M8I22?9f=f{Ffb$ygA6m`Rz!2EL95YbMb9F_(7WPA0ZIYZ`QS4Q
zy39dj2qC=5f^!(HQGo*E{2f~Q`o|iuHb%%0tqq49C+9HM;%prh=SqTL;?QZZ6AHQ(
zC;?eoB7`IqG1`FB3S%YC`g$~uJ=3EoHI<eGVMvjBlNj72+^`8QWNRxUYzeFqgn_7k
zmUos5f(VBOCy7NsC_=Aa3<AP1V(2VU=%4dZSc4G(fiuJb1WMqv_Li?IL@LENb&Rq;
ziwiN%WJqZ+rUGG6Qc~HH{euJ6<$&4Qb7a|={&+|fML2vtZL#RGM4OW7*%qB{!rtB(
z8Fr8&Ai%p7{#Dnz1`_uMy-ggH%CaPiBDB_MJpBgYk<=lNyVgZ$<849nszMs=#Wf-z
zRvv6v=Mc^^7!3|TFN=aW_LB}L1+7kp!Dz(J<~ExfI}8V7(ySnkBBWI4%F~aeP#9-0
zrmQ*lcRR6R7#>oxth4?he-9-J?iNkPIt0=uJ6k_hkU@YUptOQfu1U*^i<d8RXVXtq
z#@U!SifT^)M_%N(!Vt<9QIOzN#a?fR)s=G`Y-={Qx9KEZj7YFmMk11T&_=wwlscTI
zXswYV@P)<Ul*Ky)NvWtNYP!P{2WkTIYoei=03}21R^T5j#`xdS)4cpefN(V8CTW@x
z1tED}*7Ps`8-_uGQxUJ7e~YNm<>{xM<N+!9-t*7%>Z`B$ZbE%r7Z;XTTv#Fq6lGbl
zvb@S@G-NzZeb8Nzk!2(H_j~Vlo4#l3l}p!aziL4kNWwaW6TE$45=MkkL{$|G1_So{
zBWC93xxKZ+wQE<IUYKY3=u!Uj-~0_e{h3emo$ox$l`C)ash{{5qw$b`^nd&gKld}A
zp^*eccwg$<x7Kk%Oc*u5T6TAK5yI6%wTLK+h~xP1?~|hcUcc&him=@wxbV{{b$Fc@
zML|_nce7mTJv#Z?y|16F2{<v<AOq{2VsKQ}+bUaa>Rsd;0V)hRdF&V)djlG;Uu1S+
zfoH$-UB3VPGmO$P$5$7*dE*94OH2IbZ~g{@LB@B#`#ez5otmep%6c>&5GsiQbTtv@
zIfSS?{}XO3&I2!DQL4nM6058S2pY1n@wy7<ysp7OP)|B*Lk~YX4+7l8!(2%~lV@q2
zTwNl8D3mA}BSPhWy!JFD8T#YUXf+7q5M33d!vVUq$XF6}A#6fLMc@hV@1lS7H)kE}
zjtD~Eq!{&m@xQx!Kr`-e<j4wp+j}I@44sZ*>&}oM62wu1o;bj|icY&hURuV(J$995
zW@d&`RODF+uF3W5*Lm#+7YSsC_doO@Zr{4XkA3vR99>=EcmJ<{#*<IKpX)boarw$E
zpMqQpW;zY-yKj}n#RYDyXN*P}SvDriQf6n4V6E{DuQ*~nPDvUeXYXI**5*~d_Kh#`
z@gMs*zx4T^=1>0QPnpVRSzMV#5Hd5{#0kZ<YnQnG_M1%4&hgow{b@e@)JNIf88AOH
z%hJ*^U;fgUe6n_ta`o~>PM%!D>5AdOkR%DcLr$yVUEmx9jhM<wI!PNV1mi5Hsx(Ow
zQdI@bMuL!nbN8R6w|~GN{^1`JMqV#rw58jfrk`cVP!dN8!z^cNYKC;20g|%RC=t<2
znj9PqIDYIn?RJarzwkY>@d4?$!$S|A<@D(jy!z$_8ylPSdMQ`0yv@<0NBPWWKEo4F
zJi&OJvA=)7%JLfDe(t->&CQ|lkEgGH{TuwkFZ=>33V7+|?=nieC>aq15qIuv&`g>b
zqsep6UpLxdjYEo%(J<%Q)eTBp(dj7i%u$Rhl!78Jxp{LBiRJtox8LjS{;t;}kK9LD
zR9t%VEgpXK98u8ZE8qGiXO17^p@+_rjw^0&?6Y)qj`_KmgW)clw+%%#i&h<oW18J*
zqzvjnv(Sf?0#VdNy1M?60b;g+JL?!_yBKXqreaPnOhZtT>s=BRva&ME#?4vA14EQF
zXf#?l3(ZbQ7{<r|q*Fvmle|cY8ji9wgsO=U3QLIy0UKalfE1zEn3|HJbO;gE8oH7&
zQb0hdL(CYI3Tv&cMQeX8I&1yJz&06<##mdTO@THQjiiCI0a-evDjiZf;y7S=ag8fi
zZXiYM>pG*6a?J9|BAc5%oNM^tHX~@ZVv5`$YvJ~wS1=gon5M-Dh+~NqhN>!XLJ)>c
z2IHJ&vqMyA5}+swg1~1G4MzhO=8j;UXTzWZ3ImaH1hO{ru@+Q_6(N-fkW>_9<~0>I
zCyWImw`i*oPO`DFNp)(CFzHem%go$7+8U<YEp(9|Y8<U~4Ep=TF*KV2b0(%Y(!PP_
z9Jcza+wH%5AW=^jf-pqX2T3VKp66(5iDdW=apok<DvF}R4!^1Gsq&)o6r6iP=fW_o
zQJ_TyA#oV6yu8Bc)2BIi?mot&F)zOS5;v~jV6Z>%mZ+_kcUq|oLEvq;qyvK`@HN~a
zjcHPhA0CJxpwi``KwJn>_icsmzRTJM%n4*IZqZs(IYDJ5{nYS-^OqUrmW|DIdb_uA
zreu0{3W=rE720S5B?-d>r5XqnN?BBt;DlpoX^BLH^!m54cAg|s*vk3e!T4^GFGlX+
zv)AHlYPu6uS%;1&Z|_$F2jfg_LFj|U4%5D!B~p>EpJad(l1dvdK$3n0C!FWdS{%*@
z(s4x)#Qp)JVx*9V86O}px+Dl2y!`U3WVz<Vi4!azJ<j${j~h2{5d@MbjL~I|t_-r(
zL<&W#*`|@SSYGr_29A=lDj1D^1VwVqP7PRLm}i6zqyn6`o6C(RtTi=8#Wbb@PAn`j
z%yNn%XK!zhh2<rleEKQA_{A@>x4T8Yw#*M+dXaV{8IK0M{L+iux_N^*gz+fDSj+6}
zOwA!5Gdnlu&s#k)aL$oUCVTgcgx_J;Dr!(5CW)H9W2uxcij6Uc)WFGg6a>McV_2ut
zVS0M{aGLSMdWi{;C`(VPQ%Vp@g~AumLFR?1QUx?yEvyrK=*g#f=&=u=0>#gK=0mib
z@aoI2urS}{*oot;EG{5iz?I8ygUf+}MpIGr3i7NVh+{<3pwyb66(NN3fW_5gZ0p_K
z{GHT-sC@8{_4fydpb`@8<l#MKGBz)bs3m*;I62|R;aJ~I^M3}&PRoNj3&J=sP&wg+
z)z(p2?K$a1>CcT86tcq94n#o!N0#PUURk2qZeqt{@7vBh`vgB~Yp%OU5DKDLU~NGX
z_)M83ZnH46$ogO(XTVmLBXbK_6QGS_W_lW3r6f^I(ww2!>tT#$eSMv|*;%ZS9A8`I
z`N7MiV>os4D8?3Cy?Twgxhb+@pSN$kMWd0BL;;J73uMI}S>aeawnn?v;{5rG#Bt2>
z(kge>dkCR8wt5Vy6odYdvMdRMgnqwAmK#3#nSY1PJ9qfb3(xT34}XOH-Y(zx*0Wr?
z6mj;<{RnA&xYyz|SDFz~2yqAp2RlSjgPEy$UVrUXzVs(w#5u#!r3K17BOUp)`Xo|N
z>-I{kN#Y2t1wvVLUXtf2D)I#)IIQ&@OIOoGHgDhI>Xj=LWzNFF5rhmF4#zm>wMtPK
zk?Ryez_35&;>AlCEvYJtilm={%aDV?0XJ?qrl-5C9&K`DX@RP;3<hIXSJyauX3W)V
z>j)vZefu`w{N^`USvksMk3CMm-{;T%>?{1&|Lt$_-~BiL6+icrpXSPyt9<g4pQP8@
z=lZRilvPEm)nRX^N2fi-pz0IWmexjlqmnQTptenx0M=o3Nm=+{*(hof9!^-bw}1Z;
zwl_O*e1(e_?vQ2~aTFktG(?kFDFS8uIV8kc%k*4?lLbMrM5z~f<E<NDW15{dScg&(
zQU=(fL<9js1}NbOltjrUu`(>aZysY8DXI#qyA-)(nD60ag0&7^h8%3o;9`jkLV}=y
z))u21NEM?ifi~8&GgUxVjVUsNDJ6jn31drDWR!V@5*<pN`T*WMCr*5AH6D#=Hk%k*
z((TN!-y8V}uF<sHZF;@lp+$cbg~V~dTxW^xI~wN%LWUG&%FN6Rrjq{NQAvatlV?Nj
zJF|*4`&j2|SRoyoo9iTvHV{)4Aw}kBw>#h@?RJNDCt*Au((4UyF2am8RaKybWo~W?
zQ<mg~CTS_kv0=Q^CuBe(bAm7=jv~gH&&<lkk~AA*tfMot#P!?zbXy6Lf~xR<K@*Tx
zP^ku;2DFM1)<#r1CyE4>$qB-UgosE878e((%#giakEjs?meF{GbdEqOw9yO)1Gcu-
zF*ajnwn;KKM|$ZtmD5OjFIDW{e7$QRQPmR#SC5t~;EYcqG{#U>lCY*IS?hBer1V9!
zkb*`OlBHt;0;KayFlQWL5aP7M8ArR>qR4ZiC}Q!*5#IOy_hXFV2QR+Fm8)01?{%IN
zClN_~lM%uZ$KK{m3W2e;m%h8(ah-sfiO%3qFfPKHJnlSa)YSqssc^<2tR+yENIINK
zs6?A_rPxm^Hnw^MjRkDl!&%4Lv12G<7>@QxM+2fj;xIU?Das5d71OiJC|RMalJuZN
zb}Ec3>F@7xdo$+Pkp_V^*gAAk$^a(=Kf<%V<11<rh%+87TO%lHfHnaOC{RJ|2H^ak
z{=7Jx6X<G^)@ZPJz#*il150c@x$q(;QKx@bwN0+p+FP+HHIb?NDUCHC0$zXp4c>h7
zBF$zKDJA1^#`5wak394MQ5euaIACLQvo0QDw9%AhMV4n^H8@LmYWm%7)AwwR3UlZz
z5k^f2r7tX<=eBF<i8X-=37R3&8I%+(E-la-j@aJX;Jyd$<H*81ue|yaf9q49V0f^{
zzxWsbod5D4{AYaX6F<SLFMprQZ(YF{@2(LhEljD=WrZ=8;c#^5+H^0N@awLs%p2$Z
z@V|5Tb#N#p{llBP(}xLVNoyZ02pmrMCLm(+{gc;Beug!+o}ziGULgHgTN{hkmc9K0
zS~CGMvFz+_^TvfYsYXLS_j8{hX|}O=derR9EPH#~eC1F7l-~Y6>39dw6y+YqWH?v)
z8@;TE8WGlMpJ8z*w3}4p_k36bVT>U3T_NEu{S<ZM!MJ*YX%O;mGr}S2+f4ocPP`ke
zKv;jAaROn%Xh&sj4FV)ig%EnMCZxb%DANLRha_fkZjJ}eJj}_pv$T>f<Ixx=YTDYn
z+oFFXRzr4?IFz+Gp=bt<Ac>GFK^JiP#C<@EkX<&)1GYBzDJx5}(L^>9OqEk)C9O`t
z+R90^sgOc&>*gJHw|D9H`h4`MPm-sOnVBw~b_*34<`<^<sh|9D{^$!|;N+<X7>q|e
z_QZ#I;)B1+)J(wZZ@h4r*;5pjs)R6TGB>-#&bHSk1%bD!?GF^~Zi`-jpRMgpw)b{9
zcJc&|J@FW$Y|Nki>GPC@<>ZOu?C<Z<>-D+s><J!!>;p6#370RP=iJ#xh!k8r|2mg1
zUgx0)k8}T-lg!Odd88O9gm6?<P9S3jg8}jU9C@B2ar6%kAQZHwr|K}*2?dwKXPxgB
zIflbNH*UO595)C8|LhC`-}I0oBnjILdMW1*-b9EHXDoq|6t<+5v}m>4KGP_Qy^cjS
z*xMg-_3iJ|9|?B$E$wy}a0~_mvaH~lXP)EYo0n-c8hrfYALloJ;~(&u&-^4)Q`7v9
z|HJ>p?#@1~R*S{OC6XlK<mnS^-r2z_hpzU)`Ff&}#6)rEt!(R%R#7_=N-VncO|#Ng
zcWV=8c^B6Bf1{R=eu9e-1c5}C4kcoLo~5@`M=J6%N64Hg)*S4O+1a^6p7v3q$<Fp2
zTA}dP*A^heT1l1`2<3A`jFA{47>zB)Kv6pKG)K{<KeU8NfOC#<-(vC^(vc&IVgk`-
zFc>1|W*CkQX*#Ce?Xa^eNi)sNY!g!k>~1<F0W)(Ed1lCl0ddr%-BI)h1Egp%cF^h0
zVu}%i%#r6gk?c?vd956<Y;BaZT1Ob9eUwz_GGK6!Au9u>MP3-<IHW2n20cxy)nz=W
zpf<NCZN<wky}|7CB7=Tf*NKj1vjsrA-J*~&tt3II2yOZ#4M$$~X;c++^V3AC$xKsl
z<Lz4vhX*|U)F;UEg16sZXK7^_Av?VE>IEtW%pIK}iF`iB@$Nj$W{chJZJLFpsx+?J
zqnY2~gO5DUxW7-8LuY21&4VG=?(8r#zs8Zp8RB9AZMK=3YO=n*MHB`suN<Wu<e1S8
z*RNlv6ORB*yW3`VX4>1!;)ucsDsOVs?zC`QJCs#UArhvhTMT*wKW(>vv99v}Z@p_E
zA(eL&DQk_yq)<qr$osV8>W8Et2*Sf+#eomuvJlFEQkR}SV;m|_=u-QlSV^j)^p<#g
zyA1k$vMgh1X^Aihc;MW9jK^bER#s>=efqMqzQDb3;Z6Ge1CA^lp(snQn{a+45k=7<
zfKas)R8>`!S`#NtZ>MMs)>ina@O$zbl%y&(Q5Z1F4Sg%QwUbh~5F2z!+L{^bsPsI&
zgH7`B0cF-BRN$<k(`~UZJI(s-Ey7lV{lSo<3v;yMDOyu=46~B{ut$<4R7Md5ZFD{W
z;||5)Kg?GbbvWK34NG{gE6yT?s*kv&EUH7#VyroIpaR}eXv#@^JYE=V9f$N7=Y%gz
zg*&9}+*_EIx*({1!;LXDAJ8A)EXxk_L5i~Cl~-S<C^C#T%+Jqr_T2q6k_KB_TU1rW
z!omX174-Xi+_--I-EPzOYz?!*i>0KX-3qYAKiIJzNPtCZTZcD-a~i7)j;=0a?`$v{
z_gP=R#p>!RkG=m9KK8MX@WyLD;Obki(P=k1dUTnuetDZ)x9;GqpxbRyTE%|9$IQ$k
z$JUOKWkY;tvbJ}u3wK}U`t#=Lai#_tcl8mI4}X3w4*QNAlY28GCi)0~G)><DAnv6$
z-D_tT1W|3#to<ZH`hYBJ{XJ!`cYtiP>8gMW7vJK`fA|MHaPAy$UEKm1arVA596!3?
zwLk)%efI104|Z8vTq01Qi#}mcTSi-rEr-NOo1!fI@fQ*&rI*)<yPo3+;oa{<h(Lk#
z7Oatq2vt-!JS@62Xr-BWluvpUPSkkBO<dpr2eR@-5BLe6KOh$8EJ6hYQH+d3DrX1+
zg|2d>%?Ohw-DZRP)=u-_i3eHi9KjV94Bnyc@UHr!xlXN~Lr9BI24sb`CB~Fk7ob!V
zU4`VCVsUPTD;MuD9;VFCFS2@cm9=9ltZ%%<>lbcNRgUX#Z*lhQ8T!3_OcikP%`42$
zFETYXjih9HszaU^eCIpgVsC$wr=NVBr=I=*!=a`#-R0z|(-`9@3rifgQOYOID`9bV
zz|8a#N+sO9dAXjh2b5Jo+=zJa;fFXFY;p4JeT+vLU;JZFar)Vx{VZjnc<uF9Df65U
zJn<nOx&IMv-dx8NC8`0<Fk*Y-4(r!%W6G2V&n@x6C*H^E$`ZS~yOd>4ASA73QeT6X
zEXyd%k}S&z0>wB@36h8oe!5<k8e^;v<-!-Ax7N3~dE**bO&o?qQQ$3%^RagnLlUVb
zflL_Y0|ui3AP=dJ?RJZ!OGlaROry(!o$cH7_O@uXBEq2H%GKLsrDSFG7>!24&d#<6
zCsJ|q=1pFC`Bi3SXXtb~96Pqg=l;E4L^#8-wG%X(O*-v1!z^WPZUHGnrl)7w-QC4n
z=bL%X62}eNofdgnkYyRVa_Cx=iu0D+7C|UQ%^mmm-5=#^1i%<?*BMAj7zD&YgGLfz
zYz24*L4ftf5yCeu*4J+_%I46<P~`=-a@fFd>GCZO2AVW4NYk8gnjvIBQC5tGV*(K)
zXfhb>vAVj(#+`jy$qc>T4xK515{mIaGdH_{5)pxj2}K*}64GHz(nvtZq<salL7A5v
z?3Z+!QwZl6kNlp+HL1z~OhlHBiQ*P%mLsJiOH*cMX1&ouVcEFdr`c)ylrs#C001BW
zNkl<Zpko20vj_qfW|t_6f-s74R#8<st7}X2hY?X^=?^QiG-YY=B+aHqppY_VePfr+
z?OSxaT~w$+YmCXrvmP(L_&Udrog@qwz{E(YNV6T%+qWsI0aC^s^tK3Gzyl9YbM!vT
zxYwgK{2H@yi{?T>7*^O|nNV+$+mQYJk~kLhdOcRx0^&$>?QKuB3&W6x?(^X@g0oXM
z*&p6SCXQCLK_e=l34@`dU*2MQ0d{xxNWvCro)QExrpht8;Pl!t=4P90-QGo4x2d$_
z*xCvfOPQt2&&*=2Vg1eqGD#SwIfKD~nUyuN+%VWLYo^Y>MId2~zfn!PoD;>psi{fS
zN_D9ud6wZEL{UT#`a&~LGg^t~|0hXuNR2VZpr!9_PAp9)C~<3RiyJp?5XUh>2+}lT
zetwQ93`x_JX0yq;bLaTL2S4BoCu`Z>-l5+=V7l9-+v%{ixy9zz#$o3)&-25gD9grB
z`!xHGtA{^Y8v>;O=SNLCq!JOmK}u;sMIrrupJ8tgOi367G@=-jDH`o5vQeLQ(%_>X
zdXlN`48>psjf6rajD`c6jRrE$7!Aj?S}jg4Ei=;<evGS>$KW+B1l}ohg}c1=i2!>d
z&YsxUN;xT%VA6q|oVSSp{;t)nJnSg@RBurWy#4DW)Y0(bUnv+x4Z0>-7nAopd2OEO
zgkeZo6y&<9Cq|ZyjZHQ;w+=(~n$0G?gC4rdSzBA-gCF|HyWOVm*@~M@e_otpR1}^L
zGw~U<9!U6cszgce)DSAeVrQN+r%rMG_8ne)@ddJc#Ako*v&3P*lOKGXr=EC-n>XI(
z4}SmmdF9pD$x1^U`VQS_I077}PoC!Kr=KK>#i6@eRaF#4;ay(J@-QGWO;d(LPaX4A
zh<A#t{nQJJB4;=pQWV+Y|2HuuNRothyNyy_Ls3=LA>9c$q(j{sRHp*vbxhV`Oo<W!
zN_ya#B;I*V2!&E1OUp}q>T{pt@BRJ1&)e7E=JEGG%(;K}6O4L2F1-2*Pd@$x|KTtH
z3Sax`pK;~N6#}3UG$8Qwj#68S(vbH?1QGuqb#D@6*_Gb+{myX5H|Cs`H5X8ryBlbt
z(FPjLZj!-fSX$VUErmj2IAl4zu@>fnUdndZJ4blq2urpUUfE%XErl)1bcke=Y>VtB
z05%$E%s`>$%&MI8&F_xq952p&uL@0Vx*ZaYQ&EvsnJ@FbeD~gSzwi4`zG-36OnJdG
zo@M5p+nl7HOgyDg2dFSa1=6RB$^fY}#2SbiH=*Vl6apt3N~G|O#KP?@Oj9o)v<`(>
z24i}=Y>A2jtQ5?LBV?ipm7ufQW2@I?v(w>;bLY9x@1cu1lfekBd<yKp%vI~lw4Qz9
zMXyzn1&A6aD!>cKt<jXFrj@KwmYRFF4w;QgA{8(?8(>VuXgXnM`)TrW#Dm=l*RQpC
z`RiZ7Ie6oTZ_(|pQDu@>zxfJPY1!M`V|#0h$!Ng+`*(T%g=g8_J!76%oShE%{PPD~
zxVTQI*Jo$@D%J|_pYD^-;mW0_(JE#*7}4o;nNFsho*nVT^$iRm$P^WH2x3i~^f*2q
z@$Nexb8>P@EAH~@H(%%FmtOYaZ>4w9yLa<0omQ8iA5qLQUVZr`p1OLGbLX~M?X}t8
zyGNQPXelWRFEm$SKoCV(2TBJ7VMx2vr8K3VHdhu?))?1>VIk3hx6q8E5UnM7K0#?o
zlD252v3D4AhPo2|XA%)BPX`R7q9`&pHg<UOiEA7j9AgkD9TP?!?%q8@2Q^y9T-w@Z
zWqq6RbcS;RDK&TR?s5J4RiY^3;NXDY`JLb4(xuDX`urwaTbr~RXS#<E_xZ|;UnS29
zKKt|ropy)4-3LTbM3N?yMM)I|M9~^~S(0TX##k!r8wrc{ltd{}nx?(*zqk1L^`rm4
zT7i=2pupM!B|-wNNE1V#BnpAnQ<7jnJM19p4n?UMX2*>4IVxVk3O_WR%qG15=^2-@
z9>-@x!YE-nH-uVKSAsIv#8QyR8mboKGk}D%@r=?an1U_lgj(}(|A;^bOs8XxPlsq7
zFg`pb3<5gsHnlB5<#dvSEUP#g9I(A{iCJVA430Usxk)UcsxpoThg{ygLKOR2Za$w=
z8ATX7R9SF;?-nboE2L>m5Qdzb9C3CgSXo_Rp3MogXSm!Sju@R?BFhV8kW&;V%w}`O
zXGd59%5p}{l*-PSjK^ff9z~WRr6W)pDJ@A*aW=Tk+3*tr84`sNK_IBA8AUN?FMmju
z<)ne)r{#zI=YRJ_zPeLj@*`9zae9T*BH)c%HSa!rf=Hcbmd_yySzozI=3rEn^e=xE
z>nufCkXF0=mA|~f)y?~Ki#Dy=QggtREq?cnRsNg*^;1S-hMB}%d-4LayufKo973L*
z(T`)SDR{UqIXVrfY(RHh6Q7*YN)&>c2ZuAd?G<VS$0s?nvc=%^kT^Z%;^sQ@!7){B
zS>0IqxzEpExRF@gy8<0xFdkZS3kr_(e0=G^Hi05aQWgbOSt5Wqj;ZTM>DP-J;-ZKJ
z-+1JCzASj1bF^A5q?F`&&f3~4MNu%DPCch?He)dG!raA8I*wzux3|f%3}b43{WpFc
z)rdmpS;m`hyvg2!2gpXi?Q3$MaxJVc24q7wu*OmoQIhiTbi&*Qgki!sn_+E@5Ef%{
zCgUN)(*e@eRJLTb-QkyCf0d`NKSfnlJac)6w?4VYg=a3(>$FiqGn^J&fBGq^VosJ1
zQN7epQkp_;u^yiWKOP3Spqeb`BMSk%e_wqQwBV>OzUOgws>OS@DCQrDZ1oqW)4GAl
zmyN|^6qf~rzDO^Be6qcukS$!WMDscq86=BIwY82sFPKhegrVZ2k3L6=o4ow;>%Zu!
z`WLclXMHXKf=;*dh%!TyZ26dNrxe~j$l08?-~KV1+uKM1Wu9?(c*qZa@JBrV>{G1u
zQV#a+^20y;KEL;SKOmA7{X{d#Dh9(Lt+2yWm!4pKb&bQrL#!)V^qY^<i;^TEO;en6
zY;A23$MN#|`|}8bL<mb5d3&ORgMIGbzt4jQ4>&tJBhPcPEc2Nn&GQ67KoIz>5wCSJ
zf3Eq+i;_Ig{XoJRlodE<amF$n4!CjS1}Ec;q`$>?zx%6H*743e@A6;&XMd0X^uPRj
z%%?B${!iXuc)ZV>fBY}_8-Mk$Q;Z!y_`NrAMkA|~y2vQ%0;vRj6)~#|Y(eAFWR^^(
zMN7V9HUW!EE^v;}N<=xM&Sq2&-|(maB?HQt*P96G(^iqf7x+z{jl&{=+K#Bp!b9i?
zPwAANE>clrACpYiR*|+_Tv)%rb5Cxw8K?9EM_*6SwIk0*xH$HxFMO#RiCA=f*p$q%
z<T&B|<gN2TPGwz@MjcF1vAMR%LF>4oiAl<Ni76y!ql{L&%Y2ga;rn-a=K70-Q9!S=
zO)Keg;fZTpf8rS?(>YfzUt?=yjp68s)6*krXSsIm3h(^%Lk{)_T)4Eu_3KZvvC(Hf
zpYzT;?{n|odjz`6*5(DyPA3co6OY<TSX=AyZ~o=K#9#WiUSm8t_DSW|((kX5&kNr9
z@jJBB6<+(scUWKBpe!B23KSu>$XM&FV=BYF&u{zlw3X0FBTf$Y8K0f7`|ttJJpBxl
zSx%PC>GgVKxk3k;S(Xt+AzEpYRvTqXpL1mW9;2lnC|P5%b<NeQSNM(J_;unq=JuVt
zWZ8tg%qhykJG(eVT?<qwkS?GVw^3DrwJ;b?X}4NPCCKxPZo5yBbSUzi@$i^#*kXNS
z1%xEay!Opn&j1(<2FzwN9D;VcLzd;-xpRl>Pd-Ue6r7x#(CKtgN^|Yn6J+y@@r@~I
z+F>@EH#Y7~2w-CrVT_?FE3}GyA~&*e#Vf%%io9$Ff*_>w^~slbg<7CwMWjJGLo1Ew
z^+K%4*?+jp=2oAte&sU5@r-Pm@$kVh-IY}m)+nk3WJr_-?9R@p%Q=IyW2UnV@{Aye
zm^1;KwyLOY&9s=If{=UrpA)ybWMxIa+hsPKWAYjOUYpa?0V^x3Or}%vEMskLowA%U
z8qFC^Lh9O3xr!u>F_pp8HD`lee|+XS<KaE(+F_|E>w?qaZEqmZ4B+nVRv2dqb%4dO
z_wXULt+37z>HwuAN2iW)HsbQm6^eWgYRbGQ*nK#lc5|WzHO{6PGdn|ysUIL4Z>c&Q
z<&;(K2jSL|BoUX-U*`7xJ5-gUMv#@wFh~bPVMG{*RCP&dGxm>9P(e+rQ=;0MT560i
ztn~ucW^H6rVXdOw?;!*zDSXf)k$07{mY^Ndo~^LGdX@E7#!529o<1OqE$u+j78xxv
zDpxR{%-C3ehHQU|)?OT*h9T!SRyf){Ae4Qw!crOuLXqbMI`EpuI7qQrR1ku+%!`UF
zs~HcDxpZlZBzBzcAJbn?f9~`17j7g<Q-K2&Xq3>)DYSJKsTJBeqA0>O0veivQF;$n
zZ}ZhuIg5tk@q%-a<*@ktqOe_TBHeDc5o#AiK|mbG6h+}_K~=?kK3^gi_wV1Q+wJh|
zv(J#US|};F|L_6ty!$Sb@dOnH4XQ#@RWvj#C$UB#gr+bSB}1%eb3CY+<d9p#tQ?T#
z8C8`t8XZ&RGnA=mCovdk1u@@!{S~fXxlC2$w1a@JJ^LiLb`Lo_IbeLINYf5F?GZ&G
zgVRIm$uUo^@1RxCJpaN^`BBmTv+g>NXJ0Jdw`Fz*G<t|H`uRWJOgx^c@pzN)vjJuG
zB5oR%P2i$oS^U4QYr-&G{`>_rz7*RU(?HQQQTMWWZJsahDQBS<hAR)hf7w=97Cs<T
zIE<}u#(^_FTt-SHZi%?z>=KdCQZX4#&{2$*k~e<%BR>D^6MpnBQi^QK;P`;~Xvi$f
zu-b2iQV67u$;yn=(=!IcsZT~%HG)Oh+~QdBGyiVRgGCeJmUDWR>6#M4FhDB7bTVc-
zo%$xgT7ob@$w$M0vMiPj|MvDa{eGVy43^jLBJ%{H@UAg6MLs7EVv3?<GMiD=-q@hX
zrbudptN7&o_xVSE|G(wMS6-siY4P4q-sZE9KjQk8OZ>s_{&Utk>wNIRr{uMvlk_R_
zk|>BVIO@6}juXE6m9Mh4vVv05TN+!tbU3rdJF!{oZCJC~G+y6=swf!_#|%$LOlNcI
zq5@Upf(l{EhGNt}8qT|NAr{>1Mb-l-Yl)Pi-|ew;?wqG(cH2m;yiGHPq@6IIO|ezU
zh3yTVx_AkuGbV?Jh;r<+D5RyR3ygR)H2Bgk6QCN@(<9kllOmA_1O0Y~GOIW}KI8Jm
zE9^fw=GLuSbbCEyn$l^lB4rDN!z7x$y955@U%bQm`Wk7x#`Pzk<^1*~X49N=8yD#I
z+6)GVwA)?Q*H;*hha8_wxpe6gx9{9!Fc?u522(5U-reWU?FS@LkF?jPD&fXww;7Md
z1feEPLM~sqz;n+(%V0R?!NX&e3^+MD;^^?tkO;KUJooHNBvA`jYl^9%$V;RNm=6cE
zTWwZ*D`c}dSw80M<bc{3&ISV{lA^9?r7_2c`;4bkv{np<L&7j*GMTcov%_>cCMz;}
z{VvWyRh1|ueXw6`mo92m<;9qP<*)qPoDD{N_Sp^Ie)}ivAMDfXuh8#p;A%xA6P&bI
zp+E@YBw;qo=(JPDlQBXm(pH;1D><%?NzxTo*Va&4Fr7{4^itARo8fRkk|aFy^fMGi
zNw44Ii6^d+WjPlvT;PNEKjQZ7+Z-L8kfv>}UcJi3#wNX9pD0bZd;2zF6w*l&;y7k=
zbCWdj^sdo(Oi`31NlGMr@~^|2z35P(q*>lGrPK)Imzv&G=X3h)fX($5c|KyLo3gdu
z;rMh$HXjh_6)s=iCcAM5rD{%3_nFKSN^2=h3!x(Vy>p~djj)I8-o3}c@fkwJNF7jD
z6>F<2#6ie>HYA%5$n%oYI_!x;%aFrEfx;3g$=<^ZCms98kMb8rv%ADm%y2rwT0^Kq
zq9o?<bc{sOZnbc^V>%rZ5h9hKopu<_$KH0h8Ky`?a}V-=s>*rWQoN15M39v=7EkjN
z2#g(a{pm}5{Lzn)S`(-oh4!*U<FKxz8wsMsG0ih%9eeW}TX{QL(FD5{IXCazz}RY8
zZyC`bdsd;Pr52J(R+ze^9fwrG6-Mg3cjk*WP%@z~nt2JfK18}1(it2M)1cI@L9A)&
zts>94yPwcXUZfJo$hbpYA2G=Sj;a%EYfMLlY+dNkZk1fV)ZuiLAf@K=_7*XcVxoEC
z>N>XUlB5BWoFcC{Iyz=!txM94n9NEaK1qdCC6_Ms(2*t#9Xsb&$f^lt{`0$J{=$t!
zD{WC%wYPP({)P!GDK3%Lh}st#BJ?W!P-$=urG3bnF^`&s#ovW}EIbm4Ei@QqSuUsX
z3+vV>3{g!wb+6ZBI-TO2qucHJO+{;-dg?mg`R;e<c01g?dzU|b<4tbgzO|g-FTzbs
zZ3wgiA*qc+Xzzhs;Ww($JmYvYV3>LL`AL>BnvBWwoID>P>H_I%^7)8RSXR0%zWvRY
zxwySana%xVvX~PH$5)<vnjhajA&wJNpy~Dd9G{+GOvRN;=jpZ+l=KCtYh0ujXaYQH
z79K|+7Df7^@LyPbx+cZcxkt&v@CXg4sz(>i<ETRYGoo!J<<h$KXV>C+7k}#}6!7u&
zIC`Ok#92peJe|hdWU{1MEgBQS7n`Op%aV<iuyd9=FFZ}g*~bcdzfnTdwkn5{k|=6X
z)iuTzC?wsa1*K(hJY+VVkk2Y42`jypHw7||zzLjC*s@@j71VV`S>+gN#4`8TEkAxy
zP%R0hUIv?e@v)0(y+8KekGoo0)=8;Y3Tjwv{F1sdj7Jl!v7DWHQL2>9ZJ}u#wGPlq
zH}=B<8+x5Zp6A{rMh7Hm$R|I23s=oa6>Ron{?6a}ce(M|M|}42hg{g%<kI;azWI%p
z`NJRlK0kfuT?{1^0WL7)I0{>%f`InM23uFIv9Y#>)_U1go7#9==LSiMq6i&oX7f2J
z^v+RADF$alKK|$<-hb}{j!ut#n3s-_k*5wywP?7#E0tO3l<=rjBsFDTAdF$P+v004
zJjYW{J%!e)xyA%R6nJaVETb-S+EGXwO(g<s+QB$URXd~#kj^5okKmLq>5>G5L5LO7
zYgrsfCy`p=q@~+k;m>~j9@A;fGtYjF(Qv|NpM6T1XLLIqf*_^8a*>Zd`hZS%jjLC$
zbMNjRQlzZ(`dq&BG`-FWb$yJK5of0(hT}2oYdw!liGbCW4O*Q|qBvnT8*t;ZyL{F(
z46|v?N^g@^+UMZll$$s2AeGnrNv#=A#=QCF+nkOMIXHaC=H?bfmVpsGef=pm*49~D
z-NMv{vi1&u&T3knHOzxkgbXQbFSzXY`_#1|iX&P{i?Xbcwcj7_+`CV=+oh@vhes!@
zt*&x-bjs@b7Dp#%495e)C`M^Tk>><KNDxTss%AFJP*Tz92BfVvVHmN#vBmid7r1ie
zGB-cJ#blN-otB&&<#gLUWagNc6T(2Sv9->4JfoeabUJO0j?OqcJEhm}GdOMg_fbW}
zk@v+fOK;h^bM72l+uN-6SGjZdF4wL;No^|5PETpIT3k54!wWCGz?*Nr#rpah>uYQD
zyIl})_3BkVc<(*7Hn+KS{v6Iau3WjwXf)((aK_omfZ2Rbe|3#8Nl`jP>VPcE31baZ
z{<;)C%~&|G%wG92t|Zn#%-6p1Byki|RU<B5*kE-vBuW(Bc0`st&TX&JYDEZXSYPi_
z*bblHJ|Rteto2j6;dxRu#bi@laYBuvLXyTQow!F7l)Utn=QtVd@#&|ZF&Irj1lW3t
zwT?7R34;)43u<SmOzlI{q@<`Fm61r{aKaGBU7mjGBJX|p0nQoP9m!-gBork|8ImYw
zb2A|tSDc=m`J4r*DNRWfgh(l<>WZo^38j97;tL2IIAKuQYebJv?s4VvI;$%^_V@P@
zVx52xsU;N#=^`YO+AM-cy$O%Co&qTFE|rz72z7we!UwjA#vWfttTW_wK{+#&RgJTj
zQIYb${GT`ICndAIrn3pxuRX<2-}x~g-8tjahcQ+uoSQZpMB^I>2hRCn7S2IkaB%N4
zzV`GMPhVB^+hZ@14-<B)GhY1GWvV)$->s>uA!!`bjsq@TTxYf0LK(sFo@JUHb8dYb
z;S8(2E>U3Ubvs01%xE&f5fCLYZZfCS)m**y6eni`lq$G%aUCH`r2hGX8-L+OVm_TU
zeD|_3qjA)gM;6MuAPr-jvs6V%k|a#4X=6R+i^C|4FwP?x<MEg%ikQ#mbUK~oO&wT@
zbr;a)V)8D8pePDzW9WCg2q8Rt`dBf%v9ZA`ue`#u&pyL=I_8Hz`Vnuw`6gMO5$Isq
zL<k`;wLwdXuMni~eMN+k0eLOheQ>}mFR-#jX%uEbztS2JNTg9rrx~W05h+JI3i$S`
zFLQBw8<XcK;lo>uwWvUnq!G3%aE;KYK0aan+<DgeJG9gcg~3!M4wm{8cr-zN+~fao
zYSW^b_}SpSAb2Fyemr<=X~o-2{TI#2;%6*Sh6M-w@r;efpMQb={A{kkqTzY`xxMYI
zpE*2!47@N;df~BUX+bO0mk*X!);5hoql;L$`MAbBMR-e9DHMxXk3fM7!BJAx6@d!4
zcIgVnI_kQj?)xCWsx17bWDKUZjWw_#v4*;~4Z6_Am>N%MvrELm*+y93{P7fsMPbbs
zAKN_Mi-vs?wAMibNHtWs+G6WQ>@V<QHsP2~ri{j8_(IA-<6N|uH3=U88AmZu6k)BU
zEGrO#es78tHGB8&plreSzV|);_HX_*e(klFIk^29J8ONu`O=H5cD+l@ho8L1-oYMH
z!K|JT$FbLf*oq`du}Q?Js+gUgEd&3Q(%uEcde^Z~hO|hCL_nn+4hb?QX}8f~i}kY+
zt$VwO(U96XYUyxVA(cRC(cG9UuJ$f!{zPc(lN(g1)k-<Hy~EWjSJ^ptj`?)Pd^#gk
z0cn^p8&3#Tf{bG@mTXiaoFq<GvBpq1-*CDr2kDmk!IyQldo4~*kBAeEkO8JN#A%D^
zY(}@+=dHKi=HTF%D_5SRl`5Wl?i%;+KgS0jyw7OpxX@pvwiZ;35dp341{b3it#*gW
zEay*t^fs@*_8Ljr!6GPYM-=z4E+orKl<Lw=TLfWB8h3f{;6AtS-X_m8LcKy98k7t$
zR`KblpD~_HNLncphYkaT4Egwz+Z0vCyr?OPGn5c?+g(nF8I#!|yAMw3_xdQUh=Pz-
zlG1J|qP10Q7*c6PZ)=BEtg+V9aofEuOl`@Ff~*j1Y+mw1Ihmk!N}Tpdl8mx~x)#Jq
z4`)O6_72EqbFN&wMw0Y7Ioadp&AU`p&Dz=q-EM~<2<i5^tgf!{;@4i{`V&tv8cjGI
zj5#{W*n9AR!M$S~f+T7otmeYbMbbE7J{gflin^L3h}qceGM~*5!n>ih(ujFBWj2`;
zh9Ol^u)el}5RTioKBp)P+O0O@(Fm;+mo8o6Z~l$Hjt&Ao`}9*j`RF5dE?r`Of1i8z
zclr8DFVX9@>9spvWL(ya?(TASHYAEuqA;PAcF;k9!|RWbi#-ms)acM##8&l}57}O<
zU;fVPlx5}FvG`g?;LxGOHiGN4)n}5GOv?(9bTDF-TX!bhy1k1j9mj`v*jZKl((~6*
zwq`OMkyV1iSl0SICMU<-9~}{hjBmXD0_!U+KK$?#j*d>5*9DOd(b6GAV=IgyP#%S~
zu0r8M*_xdbYjfgIBJfRvtx8;75ol1-5k->O<cw~+O<APOvN_IKLM`dET1~id$!Ijh
zve1?(Z_?rXXWD5BIEpgo{@wdrx$p$Co-i31vTDjNfBO~Y^O7I^>3ax5s%e4>4M_;K
zE%Cv^KEPKuLoJ~MMOh&6!I#!}7d<I8RfYdOtbZ+qk^GZCc%!+SMznf!UiqbnpT7Aq
z2lF#5n*=&WxQyEP!Ja^%gnzHR2bH58EB23v^tv${JL?497IPC2nS}l-Fq$x*NK9Fg
z^isk|bN%wVzX#_ft+dTk*SFZ&+JV|Tm~~qLE8U1Fk`#4Kr`u<q)zl80u<V@MKn03;
zCXlkC({A(B6Bqn``g5*doZ8f&1JGEiMiI(3Q){J`2!*%LE0#j)#mC8HLeSW>E`rq-
zD1x_-t!TAcON3(4Of2&c7KMCcF}o;KqbQ=PDz06-#`DiV&&tXQr>AGU^X^Z0``xz@
zQlWx?+FGwcs7=GIbV%#18MRh~K}=>9vr;lH9HS~`QZ*-l%@M+<@=6St0+VG_^EnDb
zrxWn{H(%uZxlK%2Km%tLwGYXWO8FE-<p6`$F<Ifc=9-%A%^0mSLMyNh=XHU=Jnqf^
zxR#-=>o55EKT7MCOX}0&SS^mr&wk(IE<B6(bAd=KDNm0bbNkpae*85({`JQlp%!Zq
z{<oyg2mwf(TWs`VS=d_h#qa&HENjfNSe8mIqwax*^5m!U{xP70cQ*+`|1q%9G7L~!
zi;~I<Y(ooar<ran8bZ@(f-DQ?C5LMo{6&M%IF~pts$Lw*s;Vi9V)?aY{)2N(1_dCz
zAljJ1Q+Dj)=PpQ4)~gwv53Z9^dFy1`OkLc94d>MdLU<>s#dTg)rlDWRCRw+pEK0I$
zhLn<ryLZ{&yUTOWJjZN!#`k{hS6H}Aee}^M{DZ&$4;W7d#A)EuUoBLo2H_A&Qd!H%
zaEQEjk9l5zP{c`#I8M<)=us5w>3_od=~S!*rYdl@CJ6MhF_Ai;)9o>v&Bz<dh_nJ_
z1wt;o`~5KiffP{V$g_f8lydRn6)s-6h6)pg<2l(pqOrG^001BWNkl<Zqsl9a(omHa
zn*2yF6IBQlN;qo#TPy@vS5O)2X>wokMq*x05ZYnzVV^oona^u_y>)Khyv2>rZ}P;o
zCpmX+gR-2kwb|wMZ~YP{$Ghx3*e5vZK(x-KC$3VPf|Ii`Pd@PkTU#64yzx2z+duxN
z-1z(!Ph7jkvrj+GxpUjJqb_w_QdO3`DA~Vti^+J#{{8``uDN{m3Rzk3{(JACbwt|g
z@@GH(G57Z#_@rH_h?AK0tquD99<yvtD{YaqeZy~R!|5>R`0SQP@{}TuBa~KXC0Soz
z=fZ{a1VPBj!v_>aMoR@qW0#adr6fZ5`)Kj`eXR3#&R$=bFc{|usW^D=BdWrqgyTuY
z?(ThxyugTv+1zmF?ma%cahIyD=^UI9G&Iv73~8k)tE+2lZEdo?zR44-TeN#4j)%v{
zKoOA;h7sAkq?2~Rz<fNRlSX8DPLYpDQ;k+3Q5>U`WHK4iX}8$g+~Dx=kok1N;lTmM
z`awjym2&;bC+PK8+1uUa-n~1ludZ--u+Q<~A$4t-=Q%}H@$56tP!t7U|N5^Gg#qup
z^A3~Qoc*I?&W02ED}C?&CM2%*p|!0zMg<yUOR9#3E8K!9@#S5;l~wB6G*<1fy0Heh
z#<j^)n4>VIZy>8m!d8zr{_JyZeD+gXv7@dg%%=xD`^q=@<yT&2|K3B!n_HX=b99hW
zlqK10LMRnyM~5)K&U2Tqa&>cuyLWea=iQ$Yh8>OuBZLUhDy23BJLk^vwXb}Yd7d#D
zj(Gp04=Ah3?_W+c9?cL|VJbsbW&WP;AWc$UedXWatvCM^6Bv{Th-6G<4RI7x<~6ff
z;fG8*p{Qz%t&uV&kp8-`80w;VgG|8iWJY|gLtPHY@&Oy?68^ov^Xr&O^3J<ICZAhc
zVV_D)NYjwPXn?i8CUw?gFbJTi3Iq!0{Jp`G;w*s(sEt7hNojq68$nGh73bHtIV~io
zRl!?7eTTBhh!JEAfE3|GgZ&6JqHz+d2vvXz0-n9T&7E7H@T;%=65syzbzFHsBvvTr
zC8c>lS>{w_3*EM;KzT$z3_YFJdQG2}8fQT{i&hXQN1!ay`Jr@PTNIA1OI<dvUIXnl
ztCcYXI`Ae1((gMz@A`!siB6}p)H5VWvP2rJF%)@0q<uKbVzL?pdWkeB<<W(*E-=Q@
z?REh{mgU58h;yEkjdRTBKD=Y0x3I=8?d}$IsD(?6*1n)k)0Ex4U2fjI$@=;_FTL~<
zJLh+Jk*{;@+BJrQ0q?!{KE@i7IKo)RcrYX%j!EN`d|o1xgfQ)LfA5&XQI2k{kj>A~
zSR&;ivH5JuXmG-OGC<Y^X%vt~F~9L^ud%h3Qf70MPzVW1C>)mB)tIXE1&^t5*7M3$
zlKP^jEHD-5)SqlxX)288wYkL{*&{njsz=T*&RdN>Y9PcHbP<bMV^P#UPKy#k`0zmS
zh?i*WBZ}0|7V?kWoZRyNi^q9QM6jf?_%Hb4RfvYFB>j|DI3G=4I|r_A+;0|^w%!BW
ziAS&f%e0bK%L{fJn%80uFB_=z3&o%F?$}6)5+O=^eTXkeA06Mt8{wL1+vBK|Kdz5Z
z1!HP&$to<kMNWjnS%JfND^lS|glKGn4c7SV6l)B|xaH@ZGt{=Au6<LyXkh&DcaJp`
zo~~F`HPWf(aZM9y-Lj!@4MZ-bZ0uqkQZ-Gm(NtAQZ7h@Nj9#zLPu_W#AHV$*UVix-
zT)upXbLVzAIXUKo4?f_*gNKYpGjtFE2B#WREa$He8F`!6Y(D4V!-v$h!8!p#`;=1U
zOLif>zqr?&I5t;TsH>d$Y=(1|G)-u=S|oAI+S(dH5HOofDT<<Litz8n(k9n8%1(Oy
zge0WhTSuooj)rrF?|qD|4OoX(zQBxwi1pQVPlsx39<|nl!iWAz<<Tpp6Iz`WmJV!R
zV($0Z;Dnu>^NdC#TCEm?!GKn)&2%#3?H|9*=Ef$ME?q<j=R?_|fGd|T@y%CWX8!;D
z2}g$qtek6OogawUx@IsOqLrkoYx?~jpMLTwrza;o*xhAgV}pLb>(g#=ltqcD4ZHXE
zKu9iMzRYx%v43zt+Unq(<AV=A<o)+PpeQP$I3i3UdMkZ4HZ}=@kZG192+=|kgb7w#
zYF#x=vER3~j?qm++UcwyM99PaBR=``6Gp=!?Jy=*K_gQ3`5;2dX4(tRng$KDT)1$N
z!?PjV+dJ$&JV7eWY&PNH(U2^ggAjat;|{m)A26HGD6K{X5tWtXSw)`b%i%$qwCJz&
zSY25oNn02vn9gTJNwU0e2rp}-EGy3#kT9K1aZVCOns&EMzuzN{6ON7)&pz`sTbo<F
z_10SyWy$S3cPNUI7hZUQgZ(2;PtUw=K}rUvr~JVm{(#wRN}8rzyZ$ssCnuZ^2E6*(
ztMqz3o`2za-g)O;=6S*HgNF=8V_Kay?M{bouSXaL6h(<COMl-okY{Bxxdu~L2q}r8
z=r8(o|Am*1+E`Hl)pAIov?2);gz&mVDMC-L7Lp_m>GcxUR$I*H8R>ePS6_RP^_7SR
z_ipj|Cm%8?G@C0I7)^7Wbwoi(lB6Wsk{Vz(N983?Zk@wCk#TePAykkRHAX6|m0W-F
z8Gh@xej9)X4<7K_zx~@xrV~tE1De~n?-CNwPTFMo9I1q-u&wlX_Nk|sO-FqC=}iI^
zQMelAz?7aETGutX&FFXgkk1jBK?#kkz&MMN0Zw>*r4|ZfGio!X+mjrgoDqb5^6~-W
zagGXRL_r&=3lbfmg(gyAb6;wx-^gYswKyRWPSdF0JhjR~5G$e}prjy{Ax>1Rsa3xI
z!Z)~ee2h6hKsZZ(bAu>Q%!R|anpgy+VdU#%TO$P|Q9_bNY_4r^{!*LgU%be-e)VN8
z?zB**LtAe!oy@4|6D67(pX}jeMp>0uQ=?==7)M^CXdAN+Bw!G(#@dR)_<^}`lEOko
zqkX~$Hsb`YcAx-beOkQy`R^yca3e9BOz5=Q6h%osn=h#;L7)+}L4_J4d}f5xiZBkS
z%8J@lR8>hFMT8<i#fqw~iQ||k3dnQM=Tu7h=}A)r1X^OPqi&pU!a$S6v3G9Jo?lzn
zbz_+dwzk;1;=%4c24}}u>#g#n5hO`WCvCH_w!v%PdX>7a`S8P!nNEg${?VuW^sRSU
z-@His+(n8q=kq(a==L@_I~mgNCz!~P&!$X<XP7cWlyhWVaPi^}uYBW|SnVa`(+Qyt
zaMn;8gA78HR#;<EQnS6jPQP=?ysVKyLRICsat@RPPU32>*)XQ?MUE3oZn~`<fmGC$
zpYmXRbEV|sJ@Oe6LM)0?hqKie3Vu%!1Eutm%7noO$*E?7(_}?x=_zH-IM50u8(Nd`
zlpW_hDxsyqV8B69m}Ww)5kfZhxeZ6&dR+$2HqZYklYr$EUtvX4^nM9Di7d~cK^uZF
zL@kn{MWZuWAUl8$jWZ28B)!Kr3L(rAiF@4EcOh<vN6p0I-@dR1aHQ!MHw6D!8XH<q
zyIP=pc0prui{@p~m@Gb5VV#Gwmu_6nEt{IhkC20<{qmp7rDz^oF0w^J>uH5rBc=bH
zy<oJWt}R*i$gcLr=Qp{3e-~pd^VyuqWK3S<^m|>(vY@KGLz%VyXDTI-S|XhDA&1k9
zIBnyEpsI4}szz9UjR+m01Fzc<Qn2@651K;I7|UQVXplSExKI^7983qzHPHAyIe`><
zDQcHeqE$ev(?x_S2d8894$sK)4B;F}oDc;*p8{i1LW2M;{r(r|fKX{a&DPpCp;91~
zLu*AG`DyUq{#SDv|0`cn6az3CjaXk_XK!zh_4RfB@jw2*NRosrSFS8w#f&k&C`wbF
zdFC00qbcuwe4De;fGjKM_j|0Y^qGx^4374RlbDxY{A#0{^VthGZ{9=)igvqAnx+T`
z&p-bH&wuqrKY+S_pASF$5FsE=V%~oHZQgzNU8=gmSVJpn(_2{~ZMDeqoU$s>N|Wcc
zAD#%=?46QO#RQ2zXRchiOcZ%18vzW@CY&A(sB%L)?bA+MU>yYBR$T}mgesb3dFOmH
zE~R8z8sfOk*<_9gQ}VJzgemi~LPaf~yq#AJW(86TqE?qMiu^TM*Q9Za#QC9LRaYFI
zjoCdo#ac@%ZF$3m#hxO(o=Itiv4*tc9q6P|7~=yZm2NC!!+<BAyw20lJO>Wqq|Io2
zNL@RGR2(0la(H~qY@Ts+eCBHg{GO<SkRXgXJUS*wB0p$#mcR9zzsVo{(I0Vt_a5WP
zn7s#kRCPtC+a+zaNLwjE5crT);q{qXhpeylh{A}fu9!@wo-!6Ce{m=J|HpOr{vj66
zo(MwaX|Ylg+lCR~1e3{xIP!Y8Kx^7*L>M?;c;QKY{d>Q{@!>AGDN=ZG?R+p~I<L@i
z2Z3XCt;;K~yvWDz{u$M9z>QBnCQVyB*gs-*^E@pb5NSmm^%%})Xr*}T%{TbX-~5|C
zZ$)Wlvnf?sHsN+Py|xd}>~+0JT;O=^)t7ny{h#tDKl}r}`oar*@ZS6AP-9KG90qF%
zahgz-K368u8k8T7T4z1YNs8uqEOqlcpPoLT)9s>_<oNK6|M`FVrvyQpDmT<sfzlOK
z<<U=s&j-ruvZ47lL|oAn*ur65O@JWOnpP6=*Z!Tq%I4NO*=$M}1!%44sF({I+uXeW
z8J&w8v|4R8k`=<V%~;haRT4`_6vrNoFttykjw9csXpK`fB9PP>oZh>Eo6i`OIeC@i
z#FWcVUxLv2*Rs%PNr$TnDhJ?=K^y`VY8K9;RDOCVb%;zff%6ExwFc1)pS}Hju#9cs
zUuPg)uSu>HI6@uz>3-tl)02MWg(}7p#SzvR>bmqNfK&uwz-&HiHdfo97#Xcrs}W9n
zVRezuN#hg^1XB7gw8<gRLg0)c3Inv342MG>?9on9N>VyYx6?wZ4)ggOEd!i!y#Ma|
zIA@9Dm<M-vxpni_vamUS`5aa_rh@@z2WN!)2LwA8NE5|uctSB8vwJeesT^AtNL!&X
ztaTH<@ybg)b?q{NloYcGNyGV;LLii)t}CCT;e2z{>x5tp^Q@qq^ie{R&qgE>1fqi!
z0oFD4n{MG6;7^WLk}UHtl=k+V)>_KEMrsX6to4)s+B&rKn=AM<>P5l1aPP6!c{+-<
zUifG&3e`-|y<o4dYT_iu8Aoj%IXx}uJJJW?dCtE=Y0)4NUP!n^J@Comi}Y1vYO2~N
zC+om-^=o6j#iJ5_8uulPCC!R*NmCF?;~E-@l6XPHqQ>_J))(Y%Av#}B_&`cOE%B-F
z!P1iT7hR9g1Gl7~J)ZCII2FygX4>s6jvCkSUl(+$1@-E2+LT@-TQ?NBWy7(cLM@B~
ztfj6h-=N}}prJ>fUr_2!&(7#}6)XJ}X0sX7X~x;<DM^yBva-(c@d=Yjj=&<NZ;FL8
zRJNk7ePXg$gx$HCGA}`Rjgx5fRK8fVn5y(tMCUM7MHqU!Ni8*HRZ``ZZ%&jid=}ar
zxBUH@X^>cm$`^ukP3;uJSwUURmqr9Z5K!0(fuXKyY+VzDzS!~Cl|K)ZP>(1~!iP?(
zCT!0SUA}x8qQ&ZVyA(x1r_<rVg9q&F?C{5b{KpK3L%#RD@3FG7LRtEtq$Ej};g+kb
zYkd3LucPB0|NQ$u#MBjYW$CpOI-L$C^n31XI-%d|5k?VuX;bZ~xPkUJ&p2su>Do2+
z_x5=2z4ts4>MXzi{qOV1C!esgx{3}%?0iNTg|yq=)_61-6KGAh+ovispATW`rNwU)
z`Ovp844KVx24_R|_YXK5oDoGK?N&;s)%AlSDXDQdtr4m@FIA%*vz}%+&oUISzx$Bw
z?JW)u59#;&j7B5UH1*e=PzVRL5!A*ZE!4tLxT?9{!B%xcFKy^PIwlGeoU<Moh+<TO
zen=@i{ZBfIvLdyXAn?CaQTqF4Sye<)fOU=_h`D|D9#v6etzb4UNLy{9IOg<hM7P%`
zja!VT69T0Pq6AY_2&u3Z_74s?ci}w0{GIR6>2&zL-~T=b`}>qt&7HgVI6OKcj$+~@
zC5jV-R1{@NS=F@LT`rtI&(67vtgNh3l{E(k2i&@Ki_vK0i^nhNy7%C4sY{Sb5a@<c
zAV4ck7zC)=5o(D}GzEggqXWWF^32nh`QG=w!|(jgKjG~D9%3co>%a6ovo}9t_h5*|
z5`-Zyyzq6t``y==pY2g+8QnNyZM{o29dmxW&%L9ENMR^VhIIxd9C<!xmQAUt2?+c!
z(-{PcKm}}{+vL`*TS#RQl(f=_uYToe?%n;A`D~1}1$jOpCB)i-Kqa6+N1BW0FS57y
zfYad#tG%_xM!P~bcI1|dcB@6J)#K>sWJxQGbb@dx(^<jq|Ne(KG?83E$q=awT6iQ*
zO2uS0MGCWY)?<M|2;qlXrfP<MhF8DwGXKeM{f9ifdz**%?_f>IG@q~%YeuJ^&<;-c
z+OwBYIwTdEoA>VWuo%(p#>_BOWeLV0oTVKn93LETVP}Vxevh-0Dd%^d;o~>n=7<0H
zKci)9#wW+*^$gY3{O!N{@6(F|YEuveG0;RTIExNLkES&Dhst@~g^(JdrLUo+MC!;7
zmaT)r8-EC45e<bl3VpiyFJhJa3pWx)>Fpo8-L8k#oENBgw;#JK{#;|(n&-t*zp&6s
zEDG6HtL5_`X0zoDcEP(>(o<jZ{888%;!%#m+S)3!`4puUX)C2RwHGB>iwu2OmWPW4
zK@gH82}P09?e?h3lId*fU$d$B?9)%V`PpZjoE>3}Kx;?46{DRc?RHp8w>dtk8I8x(
zwj>mewN}EfeD{~xUSA~*BvqNyN)w;Z-BgQ<iSoirUu%t15wr0KQ%izC6NPQUKqCT2
z(%azDwQWR|ql8^f9~RWGRx9P`=(urJs*zeOQ5>ZMY6oReayA^YyZ3-jE2XjyV|>@W
zC=j*s4M$y7jZVZsbF+2M2OBA+m^UetSFT*5+vyU9AyMR=xQe1!LdMyA?kCPtdZAra
zH3E1~hdDhx^^m%A%kVrYMZ>F?R8`4hioXCM9FL}BU#cY<m{fR5zygVoOCF+F7S=Ql
zJi3`E2xL=4f|RZ)lD&=Lf;%l59k<``9(!7`pr+ZTar>97FPJvjhUWC>Yfk;_`|YsS
zL!}Ns88wSWqG=!&AD0@PCgot+Y&1_QcvK883*!aVtI=o}yAb|sI_*BKc8gxG$NhWv
z>2_=S-BscwCXQk{tv<8)oVqNU!d+slS!%5o?}>9B&8#Ya(@;Wq_oGJBW39#58dIAl
z@555p0x4}nG4a=pbu`J>0wEgumUBxTlXFd=rSn+`&Vq4{vYcaUpDLl0&z})mQ&{Ii
z0BeCHM2HX?bQdSUz%tchc^w!QWHlBj)0cErRYj}QA&z5qcX!#{-Q~uO8+_|q-(q`v
zdx=CWf)9(LSW;@YHn({FwKhSJ^2S>~=KkJ&s$$0W_6}i_uMmcc`Fu)USIEYR4*Wf*
z*Xt3d33XlZlQ-UAI-Ak%wE6I(k9hm-w|V&Rp&xE3pKiX<-tgh64b3pny0MJ(dzlsz
zE8KFhQ<oJv8Mdz3ySGacM@XgpMA70AUV)#w3aFcN#_xX?QF#=4(Rj96E$X@^Zg<FQ
zOWNsE3q{)L6U7lY8rp*;2twjG@#tAyQxug)g@vanIpmVc>T{Aja^2J3&e`D_N{~PX
z%IlU)&2&Da)o!7Jh)_t%vLMSdMw2O42=b!l;o(seq$-Hh1Y<1oyucv{<CNiKN?w+9
z(f|t-l_Amr?QWkSj<|gJDsj>xFDicb_rA}C3m3TY`7LhWxrYv8Hn(@^c00}B0m|AZ
z)rV0`(rOb$5#!N>s;C$b#>^&js@#WOep%P{h0C7uSyx{B1yprKSytqxCa(>$D8L%>
zs-Q5IC$C-S=y*b!Mtpwra~v9@0`8w2vUOpH>(?`O58lR>ekl3ulh=9n`m_8qr+8Ra
zy!Prh+1}{#`d|7kSyrG{68_|^kGZ*b=Cxmqg@2?Y0;8ANP<~%DWO>ew+jp@J4h|kt
zml<&<V0*32S}&n2rwpfKk0O_z+aGI7x0|rCw#wIE{t9=t*Z89!{3(tAVRHfim$ALx
zrl@P4d-gJG8#}!J(M>-5=mz=3p*IquIKY%pngAsdN))ja%!>?%VK^)NfJ}<z{RTm!
zhya{dGbjN<R+ROOOWR$3^uPa){2%}Qf5(b3tfw(k;M#M~Fg7`pw&E+Ve+7bsXr<5p
z@L&8_tZi=dAN|Mw0cq;lB552EYDE|Z{G)&P4_RI7^PO+}D*2?QckWrT2S?o0EzX58
zlgwg*9<HZJt)`ZOLZ%Jn8&nX(V-#{p(*`*jMvAA^`&z=+(^y9=6-H|+XEDxEyBg&b
zKEgx%>!mhTRY?$pO$LOZt}S60G`w!NYzP(wf6&;%Nhz25imLLQ%SChHy|E|DAh|S6
zsfzN?S)MKg*bA4JMR9JeU5az7sv-yivMlpZUl{TKQukgzwq^N!-)Ds#POMyY^SzzB
zC-uxoBxgj~6i1|jZHXXAL9!oAOD_gY!w)jx7yHqM{{aa$WLWZpArOX>BnHvq(4vMM
z4yQSq*wgWL-@Z9jIC+N^{P0`*RNdP{3DdMV>IK}c>Qm?JbI#stuk{Px;M$g=DAMB#
zPEIClZ*OyOu+R3+4%@q9e)HEA-}}RFklBoSb&NhPD2gG~tfE(p*%{}!Wn}N%Iez}%
z|4Y2|!ZU1)Ml5F&K6vk4=92}g>|wKfZNLQyDx{Pcfe~rj!1=u$uHSjgY;wZE<z0ru
z4NP!6I;oj7hH*Z?_*pvRr+kEylM{*}C(lJL5*;y0CQ8)^HdHBjZX_ur1(6B`37WJK
zsUYEAs3d^~%ajb1MVW#}(RCjV2Pmc2hJPJA$~ln$jxnyy1M{-0{((}Rzl0p4*DE<Z
zJi@saV@}<VyP#K;Z{%DVZBS@}`uKGuOqOn~6bO0c<%SMwO}3VWD?yABoP~HM<W?G^
zEkXHp;C(7bCzX><3`zp@n351hj9z#r@iar|DlTWCP&y@je^f9k?-_Bvp>-m)7gUh8
z>KO=xN*|<ivF>st3BVIWBz<S1qHa<(#ahzsecI`WNhBb64h}9b7!GKgmhpIte!tIP
zFkrb{vREuQfBq8I7!D5)X{rjXpbcjX@Vs9$2?CMXY>xBdo*YBO$B-a|o)`^e^0{Sw
z5hXfl;)K)*Qn)s(6|t<%Q!bc-{}iCbD0#Ug(TExx8muK6OF+}sEp6)rDw5@7S;1sg
z%lpJs71MeRlLF~X#29I-S~d~g!3IB`W3^hbwYSIg=!n5!z(4$l|Bzq&#b4yorAw?<
zE9v4|yWS(ZJ*BQ|TIbo?+~8;b{GX#&<oxbezsijp@ALTnJw_WFT)cFVEZ<`~Suq$5
z>G#EbJt6`3<0FCdJh*qC$B!N{U#@7Hns?v5&f(!BS!0Ww);Ekto9rL#)3%PPT8SV>
zVVTSqEFV9npAWGeB-bQ4WdcNpZ#`B+ZpBDWQ$j*y2k*%<gUWL1phSu|MlnZ?-~wbA
zToA1Pa<yb<YnzkVl=J%s+<)|tjo}Cv16FA~1`{-SA+owYc;SJB)1=yF$@@ih@Fqvo
zR1gBgUWs#Ux(@@H&geuiiewO*WjRU-k5Q>e(^NRuQms~0tA?WJvGNtpIfkPRR?7<K
zJ?Ag(Gnq_SRShVGwmBOco18o7GaQcC*xVp5a+Eb39zN#q@QAW3`0|(k8F%mALn$~o
z*k@~NgQ}{SPG?wa+1uM=dwYu*;qIL~yz}N;ET&6}yhI`UV81M|*~j-jx%=S$I)=zH
zn~JSD{b8Rh6IiHmPU=ERQ#UQ6&21h%x8T<8`@HeyuP|R!wDlB1!!wtkqgFjUIW8!)
z7g_0z{R8eD9+7YFaPc#rXLAtnt7Gy4o_X;qZ+>u}_wP-`)gc+(`Zn?RJnL$<N`<sl
zBgds#QJ|@oOJ>svMOJX};uRhr&%xw`D3$P?jS<g0cb+>B?(sXn^P7C(&-^T9e}J|H
zS~;|8(Ax9Dvj+rfX0r!uZEy3XFZ~qXfAc!andhyy-eO}TXZGljs54q0fQ(iv>UN3M
zRtm6)1pQiuJ$64qHYzJHZslpbBe<Gz&+@6u=ef{0MoRI>1#H{0u{EOH*&z6my3y=j
zeTEl5^;w>|aE+_yp2r(0fb_}|Ycz}Hg1`Ll{Wb32z0JuiuzTSm4Kw<eH|bs5CC_p$
zUE4zUG#ghA*nH)AuHU|n4ViSKJ7{$3T8H4*dsYXd2G;O&V+=MgB=&3?f{Ic=P-&mm
z8e<Ken&b~VK5`-<RdQ&W3Nest(b}vl)t$R_mSxOlGd4Ch7!GA2-`m?;SFs04<_pBv
zU^<=3VwX0L;M^K+(>dfeO~Z1z<niOjr$I|RRSoKrjH;^0b8+OAs%{`gN87IOK9FUa
ztJf~Exv|B3G2_nd3B%Ed!Df%yWI`DgZuW>v2fN&TH09C#hdg)fGGF-1f1a)J7^6Jb
z-+qg>s>lp9b%jx|TrRL#plzD9S3^ev?__d|vd1Ss`7)1Z-{kJmA(b;+y80}m{*ZTX
zJ>vLe&MQ|o$*Q~3IY<Fp*W&L8(;YUulfG?TK-&x-BzfB2+G4d_q0mVmI40$(K%M+K
zOxm2S&Dh#H5ORAd#y>Hg$9oSSap(R63M-gdpYXMk`Koo|5<(y<F&wnk3S21&l*;?C
z?nZU~ApL%y@pvqph=ij@Nk^;o0>gRQkK*Gn8kZ6yAh+52@pZhex@1DFga3d863z!=
zQa3^i(=n>lqU>Zv3G1VEhI2yjUP48L001BWNkl<Zm4hp7=nuy7o-zKwf8A@(y34OW
z=ULu`5_p_gtbh0z-Ep3N-P6xG`@GJhq~m>@!l_QXc*Yp++<icdk=@;02Ez^7wv`RB
z^%z^AP0nmFXJcarv#Ic{JCnSN$y^&8G5U4aBd9<O9`8I=Q&ZQKtTj<OpvGhvn^U(f
zRow^|Nq0~%N82_uP5Xq@@>!)bt>rt0AhNtt!7e~0*rAV9)e4+&g3uyE+XhKCVoc{+
z3sGF@jz3}uNFq7xZKicEek|{gZj8rc9^bo1UKIR;fAA0Z;upWjxpU_j3<k+lq+QR2
z4&t=-&hehbe2UUJKlM|8hUcHZ%2&Sf6~6uL?=qV&xq0I~-hJn7o_p>E+O}pspQE%U
z%L=k0hg1x?bL%!A-1va^Z`{Cn$A$A3ICuVl>2yln)bs}f#^V9jXjUt6Cy&w7)Ge;5
zD2p7cJ(_@uolbm2D<!VXMsfAZd8ytnm+b9raQ^%`T-$Q{_HAafxx7YcVk*QbE%#+<
zHOg9|vUum{6^7s{2BpO{OM1D6(2ysgj@)RJQTTSns#zxPnuZ`nC5^&05*S5<)Niwl
z!LTR$cvTUCNQZTMSJN~Yt;zEY*EUjM@(!B`kH=;r)=*U|LeOZF;hbkxt;owBgYk%+
z?OiTjxWw(-x43$(D`Hp%!y%*LkdXGpx~`ebCwMQ(%s>0B-x8@)rMPzWDuclQ?^~3H
zUN2`f9&_Qs0oyw}sSDXqEumK!j0tl7ttj9**Zk-v`X6(|;BakA;~X8)EQY{oV_K01
zOD`|U^FB5&nam#Y!ZV-Z>woY%U;FwWiu^Hw3kR3kKfgn(JzEDaQq?Qws|jEG?sxd}
z)4#w;wW7LthhP1*|A&k@&1!-M>PGRM?_ForD6}nT+f#Ge7}tQ=H4iQ#VCvYqWW)wx
zQS*oY@^uc6m-I#(yno{ki@HJ_mKuf|BewT;d35xc2ak@Zn-xWAna?I7IG`hg@rai{
z@iKSsf511s{Z;NgIN?A3o1bT6V??uPnXP7MoAJqO7r1%*9!-QM1hgtJS}H}lOCFwJ
z_dPi@3Gzh5qiC{{;{0Xom1iX;Z5_EaFf7@-xX%ZNk66_Xv}Z6J^WXmW{~gnlIod=N
zIjA1mS{mo@3NF3yD!b>NLu0so=RUPvu=mP2e&KKbC*(HAXt24)hl;~?PIZ{E*+wi~
zVeS+G(D5c?bnAowy4WBod?pT&(gtgC(z1Y78NJ>qf2dnuf0*&d==CX_^W@33c0Ar-
zHk;DPly+ald(VXn7Z{JnjK^b+j*ghm=d4yMPEJm!s%i~w*xcNtX&PcYb;WL06=f-e
zJduiQ*Bf_PmTOtlu2R)0Imv<}osH#kDVRR1Y1%4PBw;WtdH3D7Qk6w2FN@^@WkDHF
zu03vk%<VV6Lo7$^ZjAWikAH@OKvl1p9!><t)K=)IDT^E*428A~ha2qe?QwW`xHiVC
z>zbpZBT2SaOQLVNbnzU{Ot^bE<<@)e^U^0iMX$dhj+9Puu)WP-&|fE4o12@w{L;%*
zwUBv@QA{Q${QmEMl~q-vjiTQ#g>+*xR!xn`G)2~@EPI@soQV1hphH+EY+5ObGUvJH
zpJy~0$>*(Vd<dL7*cXzkZz*#jq_%C#JUOij3@x%+RRZfUP*v3v*Ts8Jzuy-v^e7J5
zZQFA9?p+=}e7MFPch41fYw2)(9LHcdlqIUe!w}bjpQ4lP)N8V{j^LXXN1!7dYpv32
z00f@5#@%z;<&tBEGrx=Jj+FXSC7eW_PO42I2!T_eQWi-}x_~|qqjWXor)&+zbR845
zhAs+eTjXC=asYi=L26C%ri1=OjLFd2LJauOIj?sW7DbGTrfJ#T-It`ZX^2rV9QIkv
zmuPJ%ik#VWk=)P0wT`B)fk;{Q$n%^KJleIm;87}aaBz<ChQJ^4Ji`aiVm@awoiLxx
zsA{R6E*6#4jH4m5lC(MJaIGf>Ly>2xNWq#1BAl3xx5T<**SbjSMVU%E8Xd8|peRdX
zRLqwZtEy(OF(#n#AxY$hNc6(lAhZy`p{P}z&i%)G#26V2hy2Q~{0hg%$Nc0^{v=J)
zFqur~^?IyUD+!YFTzrF4kxDuh8Ch1)wvMJ=a_!0`F8=jj<k@Gg@lSsB*LeN=Z_)<O
z!-w}#iL0WlBofMKs;Xi(nGu}h(xpqh@Z2*zeEcW{FBzj@pY39kve&~o$K*sv@>x+3
zaa7d;qaxc|V_fQn8Nv6F8%xp484ZVIWyZyG=h@iW<m#0xeCku5Vq-k!Ti^K>U;gqx
z<HiR!X@kNAjZXzLg(5F<%CcO0D$S-deDE9{9kH{q!O6)9+v72-)r!)V4Dy0rzlT<e
z*?dl2)z}R3%+NH_MKi`gp&^QtxJ%}jZB?O_X3!teT1jZo3RgE&^$M#rP!N4f+tx%c
z>Sv;P7E!@dw>8F=7_I1!2K4*lR<DRyqwt|+yfKt2uuAG|ZOh5YG1aP~X<JdX8uxhP
z?Kk+=x4%Wd*QaeNE?&AsuU`NHB?~dq>lJ7fxqbU4?_PhKwslxz81{PXpW9?MnNrsa
z3R5r~4jA+|f0R@Gk2SW&8#K=0nwE|f+}3sClsQ5&z?{$K)XfxQ3j&54@7<$Wd2(IQ
zhCn|XayV`Ir@#F*v^MnneS*^D{Q<xG+SmENe)U(WBdjV%P?p|c4`T{4qw&)fwSz^~
zpsmH&{E0AJ_>HH0yR<V9(FA32QTBy@@zvMZ+}P$@uU}`?Ml#b&Ns%Tib2hfN$%_(e
zEk#~X<Qa#}38gM*e1*ySJp26f93DSlcXxxjjW}14<%*+|ni5TE;Fo^!ukt&;^A&#g
z>)%3CuymqWl;jKkmFHVP#+^8gBB+elZ`|Q;f9}V*^x`L39Uc<ffFmc%45~ET_(%UY
z-+t{nwk)CkEh+~mvpJLLA+DVhTuZg8SS?q~CNrwVit%WJ%a<;5^VS=D{&QFP<V!Eo
zE>_sone-~s22ZO4yZHc1v)*UmG*Rf1{to@|^xxOU%YgThyvU@BWpccC3<kp#OUHG5
z@xzRdoJfSwl4Uua;gt7|JkJtQTEu;a!!bo6+<<%c?(yDx?-4>+%f)s-opY>KE9$yt
zV`GE5uF3P9t5>fQy#x`f)r#3{#$+-{P>i^iA>H5Kr!0$gWv;7qchyaSLs@Cxrc}93
z8t}%Xn<)g|yMBXNn3EMbqs<X}g8|b=C)~dEKA{}(7k}Zefv+(}vpMP$TtS{?xFVCl
z*;vU`y=;)H)e37Z8yg#JZf<h<@+Ag?A!V<ma-QG&`ZxIgJHN&&FFw!ZT66coG52oY
z=98~{f}PDVFTZ?&U;LR*;+#0&wyjk8kB%Orl*p}3rzbpq{D|}C&vSAzA!^NRJ|oNW
zM0yGg215xtRA4k7Fq_Rp8q=txxRKK~Ez9MSuYBcq*PGXJxkMYo!TvtGyE|OHdX0zo
z@3Fa6^7+rcO0Or<bHRtyE*DrwT`iOCyk2is0%6gqa}h8`QP&M`z4aD%@7`lJoAThn
z0|cAik{3CdwS;6<|8W~y3+Yj5MV{MJJUbmP;`F&nfeHzWueDg#MD+xBVNHTYWdF_@
z`GpQX<wH8YR6~7q>9y&-JJ?i=k{}?)X<{N25*e}kVB&->Ee?Uuh(C-c1_dO@kJiHf
z&;n8NJ`hN*%RxwLvYVWh*-PcC1as=VG`g0uoF$RtLmPp0g-D2+s&4U7{9fwDiI@OU
zDy%*dqQLrE7YWI1$OlC7mB?bT6j6aZqbxGAOrR*cTifhxZOQpk3QR^wq6Kow0!><n
z>bgpu2;u#Rf|JPJdgqdYoFs!n-1U@sf|H<#nYh#%TZpNdvh;g>8s|Zq)9zE0F4ZZQ
z1_|4uf}m5<)}7an=V+RS-~7$r<lT4Q<(Gcxmzd3FiJZJxn_PCqqNh7&-nV$~q#G9^
zi}@6jWqkhgpJjV@i{JjO|CitU{jU<WrEXiA%8BcE8^9@|59GNa>y^x>6SPwF3gOM@
z7|3jfA<|SUI?3(L@d%w6tg#ICcV%4*o~_ZCjp2a3-97dW_SoOuV`p!N{oP%L8$-s!
z5zc#7%O$Owa(q1F*=Npi^>6)$RI7@|hZBxZ=4dokU8N+zG8hbHkMWLMw{9_=PMJ(5
zv`tG<K0{_RLJU-^iv5Fqdc8g|1Xk6Gs;W}*>!_-VMUqm_tfk|rtyU}1#@8B~m1t8E
zqICA^wx+Qe{Xrpx4-G!IX>B&^*X{3ZQ&lVO-+#bzF~fV=<IA$dXoG8OZrr%eom;mA
zx|G7S%x3g@gY;OSTFrU*;2z)l&NqNSzt>~XE4Xm5FUnm`T!@W|WLl$w$JMf@7sk*p
z3bM>%HB_r9c^=u@+vCL-U*t2N`7~FrUHcKu@<0B#cI66nQ?p#IXsQYqJgyXe&swk|
z$eQb1WIA8ry<@dJW}}~T@nDbHa!IQc<RUh)TCHfShPth(>jh<Q_<Mi%@6m)v(HrsF
zYyT45indvT0_OtLS&dc&Rtp!RThmqI-gHG;knV(0ilAlPvZh4Gj2m|zvAuAt8fcxu
z=z_?K7+_g97-K2Q9)sanRLYi9vfSWZpv9rAVPkWXqU_P{52;R8G<7A2kOU9j91Xd2
zZkM0_;^(QR3%>sS_poF%DB&0UYZ3{NZjX+#Gb&T?&%gE>|M`FQ-*EY0pToQNXch~$
zx5vEr{ImFK$>i`M$4AHb(DJ*#{p%dgm(*=djE+}cc!pO#@e<>rU_3T#7X#|0VY!&|
z`1V`8a&D79ef}IwC-jX4qp2$C1ZGi*$*BqiYX!pm6at_VV_A!&oIxCPe?RpQQ-ml`
zS)(Et*}pR@d&-|EwCTkcU*vP2{T%&4e@(iaOeTEwt6yb0orv73u}?Tt_xpXC1ot_c
zJXmWPjYfb}@$x)h<Djh;pNR2z%#|xw1d>zNlx0cVwrp%{U^5}&b;fET5xhJ6ex7F(
zg~o+WLQkzfL)*5@XLF8EPSDCSKHOs2%=y|^zD$uB&Tnl{PZoUsr~e$E`OGJ{b?YXr
z(zK0|EY3Sx@9{xl0-{jk1B-;=?pjVqM@PK<_S-!B?6bW1(n~ZxaQEJQzW42K(thVn
z4z9d}&W6lRrd)sH4c@G4ZoO`J^;*F**RJyL;USxwn-oRHxpU`HN^|Y%HD>b}N5_v)
zN->`;I667zz4vc08gDV1&#^9JGMN&hVry%g7y{Y~!6>s9AB9*NR6twH=5QoF0LC!h
z*kZnzbN}HZ9v`0Yz3;!tc-SM)EVpjmVlWtR@#00cx3|gjoZ(=Q)P`D`IwZf4jJB=m
z^whg*H9(#hy!6sby!z^^Os7*GK77c%d-pgzJmm23komHv*Xy%b%s=Wh{n3qZCL~v<
zTn69_Y4)^3f$n5tRjL$piGl?8oz$vG<H|g@HcJb*bTJ%ls*HEtzy$GGH=X4}oF!UD
zSi7_<_2lBi8A7yD;*k)N^K}TRovl*)qaz0^lb}6GjxGuTb**gFW%6Bcth5-bp`V09
zMbOHM`j}GKT*#!Y^JpW1kVsEv5XGHZ%)%1SCPsW4h$)%q9J-H>Crl<1G-gJTWdg^{
zOR0R>ER$-RE-+a}VXR0L8wFABo37K~ooD~xoU9{_h&;%~?nN52b+q2$eG4h*^*-QQ
zfd$r$5MjNO?n0&|`HP8ckC9|tB}FTx4Rl2OXwP(iet2@+zb)gN-~1-8z4jWv{L8=0
zbUMWt!_m<ZTU%S}B1AWS@b^qGH6L(3l1I;AG~~0N`3x_=_yT|9Kl&T|)|Y>qli7ra
z4<2)Pe8h6GqN;1Ex}|9>CdpG9ZA4}_%P8`KyvQ-uQuInj<1s~1FdPjTZ)~u!xxsim
zrr+<=D{?;h@^k0}8*M{NXdNy%p~;7ahxc#MdXdF6nIX?Iz+zOSuyE<zHqTzZBzR}%
zX}yymB1uR482Gb4_E}bSg=<=(f-)~KnU!LjcVc#xXJ{0SYen8T-J4C*2rgWUhm%Ur
zY3l|bgYdI-&dIDHM1v2~{coEV9|GD43~DqQQq?uf<(wkV+1=ZP2!HsE*Z4>O_#bie
z)?K2nn4T<{A_6BxQBW2o%6ejG84iaub;WEs<>>K4+E%<R=Cc{|)rwwW#h+q0WH=mB
zmL*zgS|`sN4u=c|{WEi4AY^5)q*s=Vhkc%V<`OTy^a8KE@FKm@ki}%i<CCL5nMwU`
zV9ci{6upwYovn2Jp!Hs=+p`&q#SB7&iXP_zHp>Z7Gag^!xo0o%`PnP1>IN4Zf^{@a
zz_s9==KlRdCdX5%y5@tMw}@>;-5zmk@(`u`sc|Y`5MLV=mLfBcUh|F=k<y;Zi2E3b
z%E-PDJiWmPt2OiaoTHN&)=D?F^-d5Y8Xi76;_kgi%w`o=uRO!i;W4wx40IudDk4YI
z8BG$<8IQLq`*3nH5z&K~(|AW#lzjK~H_0@-@Zw9n{@!C2l_Sp!s=7+4>?yP<swf33
zWQ~smgaMMaDkXf)-}sH+L=-R#;Q7fv^$fr8*MFL=UQW+MGDO0?Y8n~>E=CNIQEz}X
zx%fXAgVh<XsmZfK3V^OgM@Q`)K}A{>ahY_PRPu;0D#`PoNrJkL!`a{064Z%L_k&D<
zg(D@fMxD6EU8m!t>?a>Nk@(V=zQk-k=kV}Q^t7u=7U!x;l75mYcRU5H^%~>anaFkO
z8(E%-iCt09)HTLh?%usCkf4-dYONU#hdlGlGomT~_S@|3?TH_Pj%;mhvc0{thQyrx
z>0HBd8BpfbDcNWvz6^*G((cX<zSZRAfTPKM@;qlXo1<ncF6{1d?qHAAa?b9~4q>@u
zI-9WoP@<HS7o{xX#!xR;^n0b~<Y(DBVNpu)!3Q63>((vEa-x#<_3rjQy~0wvhKoDf
zG_Ik@3=i(y;nw>%84U-VKYv~z9(9dM-wh3eL62VVA}5m*f{#2pIs_E=?%rW@dmED_
zpNJq5o=QiCqkbaEn?z!a^vZ(ZHRI6+v-xZd$IA0!jr-13jxma=srca5P3o%Rz4zba
z{P_#?`aQNbHyMqFJbU#L*6P%17852Rr*^Ovoix`)-@j=@^<;N<hwbex>bmBwx87nl
zUsBbMe!u*v)AUC-(!D4o^m?60h?j&~-}L(I5^YjYor0PU#uTGRN0rRY1Rm5aaNWWo
z$#M6XC`82Igw!Z+O!^2<4)tN2=vg_}ZiE<#?$oI~BzJ3hekV7q()}%gzTkM(8uHZ1
z4nwM>bB2epP9j)$Rb-x=CR6g<j1Ina`T;dM>a~OIdhv`Yn+wv7BX+zA`I~o<x@nj%
zR%bq2Bq&AgNgDbVn`LAPMw2CZTcs7&ST0<+fHpeufb{wt2w^&=&S}kRc0$|M($%Oc
z7Rwcj<%;F9qN*F(*5Lxukw7{qp=(4$m6A6n{okl?UYx+swz)r!<7;308bAN@KM%n6
z_V#+sp3moN|A>Fp#-<b)t1+3uw2`K*IXSA)*$iV0MUnB#|Ji@ad@<+bWV$ZyxQ@RP
z0-=?;(FNHy%hvyl(Q@tcT;`=##BTEz$4T&x58i*5%!1Wg^6Au#)Jmg`_$y^rf^lU6
zG1R!GUMJ1b>m(YI$!ZWIDu9m-t@AkVm>>F68R^VYHB0$CKHx(jIFGi{A?ykdI;ki5
zkc{q>CIm5uRo-KxM-#CMbf&m^=>jeabkRGPO!Wd<OGij)!R9-^CEfg9pAaLjy!1T&
zFa1S+|7&08t#_}})D^2`wKjsAYa?^qdGcI%lugr6*DmoKPb)8%E?vOn$rq`uSosEH
zG<lY@wJ{J_biH7EYnyZD&vEhMMJ`{t%;ig$IXHJfzbvSi6S7?6T*dvnN30f0{KvR+
zclb!;O+$=iHlrv@hQlFwo|7BP3YCm+lSqe&_yBn(-a4BbV>AX&MTiT$2j>*Q8D4$<
zA~9MHkEVS8dt2On_yBS(GS{{%Y>5(6Rn=6>TAZ+(mfZG|l3Bo|;z?6CRBc7;y+E)U
zP*%~@Gn}ymycmcok#lWBORg=gcbv?YJbpam<YYx%A2D0pAqIiw)Xt-nWip@h2d{k#
z9}LD6Jag$1@4t6b5VnY#-urj%@W1{a_wd1^W6rFNxFAyY`l%hS<IZW73T#>tgT}#n
zy){YcOxevOaj#LK;nsT(`JeuW|AptTUFQ7WCi~kX2K|Dpu;Lq$<(N>jIzE*9S}RnD
zw63MdGJ3rd*EXzLkInnC{u@QKNvtMDRMhETz&F(s^P*cHrLbt}{M@?l)g=Z^(>(Eg
zV{D|LNK9S#&ZM}53jA>6BPSBe#e&Sp&3^dk5sx1~7I=ko3<pD8>!gyG0-5Lq^J_FL
z=AwEr=;u<!t6N+n*sl-*nXy!LO=hiBT~bSXKA&^_`gNXv{&~)wJI8c71>o}K%Vb%}
z$?=5E%}v?tjhNJhRK<-!0v@An;!3oVA%;Mng6-#?-{tBv&yd-c*I)Y@H@^Qmg);QV
zBd$LCEDsm8d@iFY`U9K`G<AcqU<}kvOIh|%O0%jP>edO@!v}0$(zFfB#gbmx!}*3s
zlNtM$u5t8u#j2U}sZYJi)e8qay!96C{E(mncdlRO-~Hkju`Vf3MURh>YE@zK<SP&Y
zTbo;KZftSk;zfS!PyZPA?%w0>{d>Ii*4s>HbFN*xCR~Kkh~;WUY$cJ%i!vG6f%h<-
zo>1gDHpwE|JQqVftqDF**9|rkSu{JaWLeImM~?&sr47Aa$<fh^L@%AC{k?sL<1wS*
z5MvZZTU;XgxwfS&i?z~^wT2iKWjW>xU-${Cs^Q-K`_%Qvk0f_Wik9S6hC(X{A4(+B
zYm#%Z4&b%4ASFf=&cYhs;vL#6yzPil@l0TU8n~-;-<%CJpRQn>{kbL#pZUFeT#=ww
zQ9%^)aZJWFU2P`@;dPvHGe`+cawk7~JRMKJ_qq%5<YP~N-m{<WiKQ+I=31jplL-<x
z153gQ31v=2`L{lHsyIb)k0%JRF7I1BiZ;n-E~^^vW*=%9zxnoc;4}!$^MX7tP8anM
zFv_#HJ;oZytfjxT&AD@hKnU}aEWO4@czk$_3tnU$tD5C%#cEZvs8&=}jcYx1-Eeet
z@<eCr<2s&w_F4Yi&-@Hu|LRw{c=00h`JA1d9q!$`w^s6d`kZ$|DV5|+Yl^a$ItW6_
z_HBbpDl%`r@m)YV<VBV<91JDd_FlSLYK`=ld6DL@p!y`JZkr`OCDGn{d^|N~BzSf=
zH$Vl+Eex{p>y)JH2qB=2NL@!xyHescq?4*1MAv=@w&1;}v4|9{PQ-h)e*ZuU^n3X!
z5&fzA*J^>p3Gp)d{%D9+t<OzVu$Y~IGN8g*97BlFvOYD9z>bYkv{l97e1f%>^Lsm7
z`Aa{`XFvNHzW3%Ey!GareDAxjbNkL6>eURT1wv@FVm>)cYGazR(AcshD+@;bAw|Ey
zIgho1GU)Ys4ElXGHa6JV-DNZy@yaW&aOKJsvMi%0isW4&3RocoLQ_!|1&hUO4KLo>
z+FEm(K8{0BuSs|#c<R-XYB@(KF)+2(qLr2PMkf_OBb8?<{&-?^SlJi|27;9}T`5Of
zx18I{x$?6=h7XZ8k)wU$u7&7vuBEAKnj}s!TQt<GmZ}oCXPeaTy25GeTAbHBcy!Fx
z&K|RB$^A!1w4oN}UX~MWz(k8|T{(3fx$(h0hW!z@KDfhtxgxVYD(?h*t1USLe&=8O
zK0o&PSGoDYT|T(+fcc`KZW@frQA+c8R^h41O`m{4n*qUy!7tGx`g>39g<T^)O6Mc$
zv^PhE6{osWWhbq$6jUdc-~GKC{EOdvhrZ3&+8(gE(dXj%b6h%qk)6$LHb#y?>BYd#
zXfz(@YHX&lX`c_u5aJ4*RNu7LWG3w)1cBSexTXzsOQCb8s;DBPf67@sE5z}kVvLgF
zrPimhNZ0)RD21tyoJeS7Q{36!#%Rsa;USaRjQ!nRLX1qO6Ber_{oWvXH?(AVM$@#!
zAOWcg1uB`(^?Q9XYelxPY1WnOj%YWTOvti~#bUwRZ@<l}ufED?G~&D8{VtClJw|K8
z?(P;}_`(+n!Bf{Osm5y3#j~ecy4r|ZaMVe*QLMogjv_bw#Gm>x-um`8dGkBp#SZ)I
zJ@+ixV2E0@WG16cZl>0P*1`>_DhYOj%~Q2XQ}zbZd1)NVhzqFA3R)isN>dJo3`g4p
ztFXF9yIS(kfBk=FJDc;fU;H%He83-k`FE&}=lt|v_*rx&xYV5s`}D_Sd{d_hE!z2=
zT8xT{YgevN<Qdgs!CP;=!)iL`bDw^dx~`c{CWII{IX-4`G7)%~68SHups82V9rBKH
z&|g;wdu7gi-Xtt~OisHQO;eMZoK>}=Ue$d45B`vyogIe5A@5$lNm1nN@9*=8Pke&$
zXoS)kF|?>;b_XQPzbtyzniND>o_qG{$5P%hGj@Hq>r6cn^r>*lRaghtaK^<tU;qGs
z|9?!tdyP_^Y~$%6lnP1mEuIOqyTBpw5>QWYOFD(9?)THh;?#%YY+Lh51*d>?lQ`3n
zcv7io9sIzD7Ox+q2K97;(EWUR!F&3#AN;#;ar_ynTe$@_8d0&4PEf?PLdLd6TJqxQ
zk-8@_(mAIFV{j34>(Q!3s}`qxf?7c*1siFlVx?0TNg0TS;1k!w2inkb=gwVJXXuwc
zWrztjmJE<k25l|c8gV`?O3Jdw-rf$Eijtxz*Y4ZaW;D(Te{8wp<2rus=YEcFzV;fQ
z{NyLOefu`fIW{&n7>!0O7K^oqL^qyJevP##mEnSPegI-p-s<H-ggiVvBr}H0KxQI3
zig8s_OJQi(A15<R(g^_HA^-p&07*naR5go)Hq8UlrAZiLs};G`D3t_7j0h#*gQy*a
zK-)O*4i`Mp2V86^^MWk5$!Jp&4XZ86sHD(hQ?V<ozu(j9YF$vTQg@+KCtSPJ2MF%0
z>%AQBELYGNai~^7WRYVBYYf6lGGqy+qS8Gi#}WElU}tMYj3TeDtz}T;WJz#kRn6Ji
z9`Q3@`m_AZm;N0Tn!2euK0e{@-TU0TbC;9p3_`?a7Hcfsie+rZpf{i>N(TKt{Xw7c
zXv`p0-L19j#Np)ln8jj_?)C675Z3aSJ_XED5a{(v#=GNn=e?;ueg&!Z@LmY+L3p7t
z&HpSvE1`}g2Hmymu4D`%3rhqtA{Ju;Ciw-0=ot00<Ta869U3W4g(z%+;3Gjpu$I`%
ziNUfpEHPOw@z1If)vPox>sq?6O$`TI8$_Lf-KWS4KDcv_Rok*^YS0F&b6hl-C^E+n
zADwW>3Bg5-DQSJcszNw_O3{Rt_ujinp2>H)dGiig-WPXfyttgxgRD<J-XVk%-$Y8~
z(9M*#UZUbtkRYp5K|$ezbntvCEtn|rt_Dm@`G!yHwjQ7v0xb(XlgBmw;bXr2&Leu}
zEw)D+oIfZz*eN)7ZlBG~5k;;T4s!AWg0BT}kY$8WVPe3duwG0k1A(A~bRCr<GiTSr
zgmBO%b)nQ6jR36Ig;Q0>HP||Jo6I`yGFq<@0)MiJgfVM5)?Tm2=RWs2?%uu2WHRCU
z_3Mns<K$xyI5|0HV`GceN=S;M(OAsqVjws9nsHt?O;TD3>sHNbwW4Vnl#+y_<6OM{
z`s)k^13vxfPxH<@Z*zEf$Z*u-`g`wi>C$<uwG8?LNRn4ED1vXLpqogk-NM`%SLL~o
zhn#Qush|ESe(fLspWL}~m;Hl%@-idfFh=zLi=rgUa+<m!L`hcKwxvy~FM&wE-)Avj
z2)wEhjC8NpW3gCLuT~t-R;YGKsWpd>@A3W{4>0vHTbH+)t(I7mapCF}9vnX6@BjV(
z86Q1fDSrG5Kfy2j^}mMmB$&A-w|0FVrQ)l(c=0ml&RyU$pZP3BQLtLAc;k)lbN|6z
zHpXL?%Q>4HLwsoIU>QXz8s|zWdP%LMBfod>vMva$s*2@uv6c=SkH_ok$HRw@I6gjR
zYio<+<0Dq975DDl<CT|RCNB!ET)u#J;_K06)E)e-iw|Rn)Kx{R4cVywQK#yUWc149
zP@Hb`R3{V&%o+GimsEH}6{v%eb!LrS)w~;>0>jxvK+e~bT?INW0%x(4DnT2<nMD*%
zy(U;c)+Hwr(4<a@{-ZIMXI0wH8o_lxe~=99)0O6@gQus*S={H@*AW%2gKl)+TM5z6
zXpz^|N}gx(B0Vmx`|i4g<SrhfCj`x^Z4ybF)cQ48E8EF>VU7w#=a-@qKS*4(ofE9G
zcMk6>s>MW-j`Z2q*KQr8N>yAXb1<#VT0YrWsWypZpODD|N;n}(f2^IYos%_jxm?n=
zE&KcXoSdAHWtlispH+c5GmoWG2ih8e`J6Ez3~67Q%_b-fJDXd{L@=O&g8({u3aiLX
ziM0|Ws}8o5?xhgKSP>;+0|A-$t`%w0&M%3m=w)TPj{-(pY;NgkEs#18_-51uFG2y*
zfs<<;gThCV!|q7>T~SDs)iRlTO1c@Ld%ZH)%!pjE5v4PHE1myjTq(+Hr!tXGj=28J
zB0CIq)u44q=OCiI@QerotyJC;q9jV9Qe_FQrm1Td^EoEZfS$lwyd%WOXi)I#r(fpJ
z{P>?jS;JyFLuVG-DfzgFkC80x`LW|)!P@D*bv3Jc$#NzItgTHkq*I9GrB;xa8F|(x
zM8$l*Bu340S+6~101o~Q&EtR5qfLbQPKmNJLv)R!Z3IScbdJ`Rl-~++p<bp0Sk^mK
z2hBrbBPF81O(Q}C+US(5BrZ)_i$tzlAqsy&j_>)nzE1uAkQfK}5KvKyB`QX=Dw)q)
zTJLFt;<;z9@aDU3bMMh3j!sUb7-kDhHlV2*j*d@Q`j(y@u=EunisQRgmVkUui-IiY
zop*1cwZ)sBtkqaC0fppE0Vl^Zl&(cxOgUm~&`P)m5#c?=sMy-tONN&%Z3x8qjJBGs
zlQQ4I;ENvCh=i;U5v-<m4r@w$6csI_GORK<AGkA_a_8hBk&4pf>}`+P+Zl1?@&UVh
z8yxI!(d%WBs2EQS8t)@*k}LO7x^2EAU52zrhSQRi!k^hw5^t_UFT~S*S)L+mr%y!=
zwdP`iF<I)=|M2tkBPSBwrrvo#?Ck6?8jZMr|2{>L^WedK4h{~OPNw9;B9Raqlrq$H
zMOliJTSvamvWz-$EINgsu0@vTIeDJry<c-Mnx?@y$Bi2|*xlQq>}4DuKW2A#6Rn}w
zD+S6RB|nT&vZ=?23TmxdL=;SOh=JDCOlJ#9tJ&Y*=a>HG-{SB5oxjVcUwxHlo_iLP
zm)yQ}i}`H9bT*+^_6b2?Mzi^hBJZW{$sC*KEEjXEwUoUPN^2I&6(=Xh^m;wPE6!J}
zjvw;=tq)k$E4H>qDD8On-M4sr_XDn8zQTB8m+5@Qd_HF|9J0T^&-dT>K0kTy9tY>n
z33Mts`gTO~t|Ht8=oc<rASCVcOP4OvG&KhY2VA_g;_bKJ7N_d6$KmlD@50*1uOq;B
z8t&a<+~LH#fV9Kkoyw3IK(MUG$H!|`tm$;h_uqH}i1f;wwyD<Fc6WDoO}y`d)D&K(
zZ2IFhGIM%ssU+_TfQd<+DE%!0N&<<d!)X2h_|e%R0c*nZhc2iFQ0tZ^>slY{<4Cak
z;o$x3bIv~Z=>%YXSf2chPky#Px_cDQ#L#Ew>Di%BMD^5rp5;=kA3yUuQYj8GnJ>n~
zp-2JuS*gD~RnTN(5tvqthy!(q1TW@{-UacH>$*xhxm(jM<N`O7s%m%Mk=J`qNXbOo
zw)o({<RpN3;yuK4JX!2JNLEPxBOwZhq{F(0?mMNfiHlCSQr41vj3FEM?%m^apZgrI
zz4jUh2L}{I!SV6&TAV|IYxkifLZ^Tz0CnBs17x{CVYG@gRZY{Z&@oai#m!bH2l;ND
z%Cbz1QtK9<aM()g^)*+B1fyI7nT0xaB#g2GeNYO6L6PHI*2SslBhE#<mp!a3OH5Li
zlCE8XN#VuN%V@!q2Qfa(lA&iv@2ixit{Xa8<*qBHQ6dZ6Mlp!>a$Ji-n@I37k1}K6
z40*jve!GGJ1XK|Gy;d57!YdC-9JdXMsG(jiP*w_85$S;V=*g|+;`swsP0gZSinFzr
znt1S@YB{4?%!x|wL3~Xc6@e(h5d!&awH9@rR-D0I@K|lgOCfBFh)R-ykDTd5gf(x;
z*j%oUlf8W_5#>M5qvMk*rPea|T5FmpdvA;ptXb~|E?rw=g^LiPK<7|i66!PiOpGRV
z-ZESZ3gKUN^Df4SO5C^86+dE3vyKC`PS?<h;A_`$4_-0eDApac?TrC1UHbyl$&A^2
zCaO+0BjhEs*@AC<=lgtc=RS*NLt&ut4izm%2ZlDIZX!+XsM`jcm8f87gWRJULqmnf
zp}p`#G9vf|N~OftXl$OORYOQ_@|s5v?x0OUP@1CX6I?)6Rq^czc)T{0;~raETgjI}
z5o3mmTJCe#CLUa!f_YCtpXdWR!uHmP{k=_c8@c^x!n-%`va>bj#TTw}VQ);Pe7Y_M
zWAh}<>=T?<_Eo1dVn{H)1ZCDLb-z1+gYr^1L#^G$qY{)tceiU0&Si*r7l{h0w)w~g
zrz(C#$&Yugzq@WbcL7IT%L#n=@Bt4WKH&KHn6fN6K0cwTr8;4aCC|&$Wr*vfp|0z-
z(OTyv(N$5pB%+hIDvE;Xbc%D1e!s`|&IY|+&fea>U@3RDDf=aDQzs9KC=S6suGN}O
zv7dS!nE41kIO^pb9URli2}eiAZ13-*OvbWqX`6=mbi(7uk9q6Ox2UR`ve!c^O|@zm
z3<lIqOVc<|8lyGNw-iOma4=-KTu>Gz%SFxc(TqpO52)ONhmY?u-WZ}{WOuwpFYD1%
z4SBD`8q07zVtaFoovkf?{3m__V=ZM-aB%KCZ4^?S1o7R33hU~nIF+74h*ql=3dN(x
zk2pFyVltWV`s;6C^C7#tyEx~VPN!(CnM@{x5EzX{i8L*)vVyf0C{m~GJ{Sy=S>POF
z45QJA<#H)EKvK{Gsm^7Y<@pz$rz{FKx3<~Z6pil?0vj6}3<d)U@=|wd&>Mb~Y5F4@
zfA#173px^4M<nbx5gPSWU?exU3qcf9yTCV|HY3*$&`Ire)li8l&IbM=x!9WITq#4H
z=`@^nBcA;KuKS^$`u#MJfBJY&lrQ4hWBjXzTHk{|__^J3_u)UDE?1|7>!85coT!qh
zKng6nq(Y_dW;iw5(J}E=qDKWyTw~rNK6;uUT}9Hhk?WXXkU;`8lulBb9bP?s_81fA
zNbtfQPgW?vtugjze+ri)eU}av2J-&#4D>6(*OUfr^{IlE58V9jZ~yB~`oEQ9b@Q9N
z@x~imyLJtwM2uo*XNR&ZnayTMz+%sETF%UMrO;O3V2kAf--;QN5Dp@l)%41OI;pe>
zRl$krTXb?Ks^lDw0xe`>QnKhnz!Q@pq)O9LCGLZC8zjUwXkFl3Ah<|WoeGj7xOT0m
zM0am1Qb#N$FDQbFG{LXsS@W_$MRDL(N@FwO`uLdIWT_h!75GHP9`yS-?{Q5l=LJ#3
ziAkQjgGY5kYuTSjF4{3fwCBk^(YNb4*(G47>x)_M0U>xo^k5X|PWCt^%yz<hcW}Qo
zJhGeb`ibjWWJz2jc4S{mjGk&$vsx_yMV3o3Yi;=ILlRezs<}2fG3a%dQm10u&WoS^
z6PVTi|BwIizy4+5wBy{tFinDJ3M^P9VTnH)o}zR>snhGJQb+UY;!$USD_tM>@LC+v
z=5+Z#3sdcqh^}%@khvwrkdTg<-cL&rrgn}H!AH$(QE~h3eWvpjt&ieYVl9JWz;rU>
z-S^+;(a|w&<5@K=DjGWCu-6qv2g<ylR~Gb&jM2DHo*8;YMp0zgsG)V#b<3h|s9oUX
zWWlm-ST&B|1sq)TdMG4*>(oMHg#G<};Q>2GwMqq670EJ7S(Nn3LX_EZDO4yTgMN=e
zKc~zMo1;GcUcs<e(6lW^HSBKn=@oX}>5MTX)y0_pUsS48)Scsk-1}bC1JCjdZPsz9
z;#yG17)^*tBHjn#Ga|JuCI7*-ZR&&@{>#7fzx`12^P@wX^r^u`_j^ZX8V-jX9PIMW
zJMYjmj<PIy|NR?Sn-hHJFd4}6Vhv*oAxPDIFj!+6&zjA39SW^Ai^bwhMI0VJd_ddQ
z7-QMp-K8u`7V`x$3gK5N!T5EHWB0RL=&Y3t%*06R73J181kZSDi!0AON8Pr#sMxnT
zRzXZyy%%42f#3Lzf6C_O7PHw*+VuUB&8<x))7g45wDX##UeXqp@y3w4uIcwnhW#NI
zFK(lAN87%L$8mgk!uHky!5QkRq3DbL{BStr@}<kX{L)KYzI>TH%ejB&4mWOoKz}sm
z;M{?j)#%O@JYhu<BAwRVCZgEc*`aM)in3%d7_hmy$>!!ZtIFei<l(~y?C<ZRwPtg3
zlLrqToCZb7yJNLlQI_TU{MNNN$9jK?oj*A_S>szrqY+t_ad;@IQfS3@zWW`DRAt)P
z+2Qh~ON0;^jz@fO>n0jFx4*~7Q77NGPs&#66lAB`-xCWrAS-f`U0OrC;twWEX|2~m
zX!rkGt1~iv5!S(fIP*C^yuoykobK;Wk0*HyF)ch#;Y-gPQ>#v8>5o2Ew+V6P7(d|I
zA9|#NY@I^4y3ed6P%=hv>83kBv5VW*N!)6&IIVDZ33pWMR<L+C1lkw`cBD?te6-OC
zJ|HgBN+H#3FVGmRx<pT5qQ-_umV4UJGFeU}X<2Wg8f|To9Zhc7N|NlSJ1<WVXOTcv
zTb+^`|3q;3aT|w6Cv5NTvsekgVQXiXsKhVC=Edo~z?r0a{XY?cgSNqF$cpSk@SVDK
z1hiBjqmb{F1x1e1r({D}D^H<yF;)BxfDvDl#F&ut9;KTt*TqT4QALyyy>}m-@a|MZ
znRLvq3#O#&7C40=Dy1pA?;9aF>0BBu2A;u1OzJ?0qEblyFA}IJr3tO@<T{^-7{a>y
z>Do5=y(H)12r-1D=GQG3il8*wdr{s%9z&V+X-64Mc6yGx*UQ4t$x4e1Zg+nNm+q~O
zu&P91O~oLAQIed{N~5Bos@qhwFsL@7kU%X)$jjcEYz~puotj^E#RY{!tvj{yybu+^
ze+10Nzcr&f=kd(H&Nx)ytv;#h{ZZXwNay^_mIECORk&iO>wWhE)`hAMeIk9fICZwe
zak^i`5YqfSU9;P^#aN3?kWAOMm>30mg<^X&;_CSg>ekUZDXwW{Xd8`lo<I8&pXSly
zV{UwKlf%Pf7WE1rB1Y$wg=a9dY;A0?xjAOgFQt1Hyg>4zN4tOx0_h4-6VSMznJrhm
z`|f+xwd3(*4#j|8e?aS6rY94QPHLR<6sD!Hj@Yg+et`-OV->kA=w*>X4rRY&G!)0^
zjq!l(tug(wq{uTi#{>FhPFYxbWl66Tb4_iPC^j0CWZ;GG;GCmzEsYB_buAt*iAyZX
zXEi>g?zaz;SRnDNAxeVgy-3)aDB=$>Nb()zXAD7#Fj~`o1f$cBoJe$=*IARGZX#uw
zp)7aU-rnZ;_?Yi~@B17a>~rJBP4X-!FNRo~ue%vXM@MV?eYX*GEj()l{~BXtI2^9u
zJH|+n7h=%T3RLRm&D-3&f1l@{e~yju7;QCq(PP*jpb$fqey>mKL}t%BFS@+3bNQ9(
zqR|>36ZzOVvOLE^f-5-k%n)Ma^5x6?mH*(c@QpwG2Gf(NKzMveWM(I_fi`2%-^Lir
z@$oU$YC$A08f+7MONcGG(nO^wvjJ>cs;Xgo`yAtKOI0oK-cdI#-+TRg+`e<0ix)2P
z%F8bcUNFn?&hz?rUthyHUViCiVuUuqB#N@2savMADZ}9a5ONJs@$lgx@4fdvhlfWj
zmNhQH$F{e(5#qC5CwpB2F&qx*^?K_$P?qKTx=9vo3Bj!swh)52i>E48+qU%j{~vqj
z9$rOt@BQzZnSD!kZX`&Q=s^MsEmpKav4!(OD+XHi$g4btR$4e<F<we3wzMjxtq0qv
zyvXY%Sm4DT=}A1$;wdOl=mDElV@VZ+9;qcjD?*Tjgk<06vfe+|thHzF?42745Lh3c
zJS2PXnOS>g&8*-3mw}87)*U?<456*99S8sV5fnwiiIXRB?X}mSzV1)B?6Seg$jCtH
zty6kCRnH5mrrOqUV#ngM1&xQNaLXLG+<+)>Yb*|%TJdhl3KUSgsT&1s_bjWbLQG~!
z&{T!pPpYj(Pzux1?UK96;Yl>%f2T*0zaAG{X~KfSL%w-OZl_`p7woA}@cBF3Q{mhn
z_h_*XDIki|13|%>@iD6<<uRX>$DBLe1WW)obRCx6^<IRRP}l-W{8;|1Z14rnG+326
z%Wmdp@!)JI$n<46EIt;?!HDVhb>ngLb`m0Wc!&s~5@xC+T<C-azuymwU0sKzjwve?
zgjGi&6q@Q{Mn!IQw8Lvm;kRbxX$?~c><;AVgoc3tMPiOeLSi)lz=C7?cG#Lpr`+q5
z;uDlxwC(dpsY5uj8$fdN9MIuDaH4?NeOh=I_xQcT`jyxoEQiv^|5sFnDG~N7EGNev
zGbMnjK-W#7xT<z&km@kl>Gu4Nht|c59l)N0V&0_q993XjZXLHz{7i!1$DOIADq-Fj
z>U=Obt_PvwY9Ri+<Ifj<ZS7ttiUorB>x6qI?DGr0AKPon^G3Lpmcy0$_%&xjw)jSb
z843pWeG>nlDQ?8>p<}_|B^N0XA50e-%lc@=o5*p+m|sWkq2`_*rYKO>q%mP%M0k|>
zF}OjC&nr7S4MejN)(lqBpTe~4W|Ckbb#9l!aw&``RF?*qW`R;&TssPi44)5*N|2j1
z7}t&{grS>=#8_u<MbSX4Ff4;5eX}Zj1`IvMtnpNbWwNjzRkJ<Dc1Ws6al@PAf$!R3
zh#3YxZEnNiPfp=X(+QZS0l&|O{3{FL_4%OLy~#3sgOQV&0l&`+e^w^EUXLh|tf)kk
zQ}wzDbUh5yib5qiT2Gxu8wf1ZWTAwh&?!LdCceA`tIOqr%k6^K<AKZLg=+UW^0?i|
z^=GlhkS-TAm&TNEl{GUpBk>+Eu~-x_(?Bd{7v>0u5D7<MnJjF|&{-K~-7rAxXBRKP
z&=Y#CNVr@s$AV2A+2IcBq^ck%CkI}y8;X*R!oneFZa!^Sg0K({vpff{*DHk8n5|{;
zFqmkR^_NiX<nH$Nc6hyBR#hk#gUjWH-=7WLh_Mi<h>nIsN8$HpqM#rjL$4@;X|g!5
z3|}UqQ3IOhvcH1{)nU1a#&o#c-ney_0NxCZJ-`iC(aAJoAjD*igxo4F8+;iiPMnBO
zKW)OPPn+<;2m4`A9l5#LA_U9r_QA3Y3>uV&U@(X?XIc^UgyHpN!lU@0P>PtL!{zoN
zJJXMl8U<BU=(b0Og+hhk%g8`f*YTHwAL7VA{tl1Zjn7?oJyg|$Sd4Wkz5Mda@zF;g
z;l20XLrzYPBd0{i@#DuaD1Q)gva^w!n+HNzNnOh%Xm1O_o0)+eJG{&^O|-PMASWjW
z1qB5dd;Rsoi(#3%h{dg~t%YeaZJ0F=(hv-u5iZkMEGFu~^PC#XVx3pL89sP?888eT
zp-`B`$i`y$>)#HcJrKY(*Ipy~T?{ldH!nHNgbdRb9x3G^H{60_TZ0sem>y%HP1Lcl
z+wNbY+C2jlmfr)*wscw+Ojw|%&a8ZP(mWyY4wVTO?IhudU%RvmkC6Of_k<u!iLtF$
zY%L-}oFIxK`eblK9Ja$v&YIK3o9D5lb7Cu2+|p*+$%6_2OL#hn5^wNF?Ajzel!99}
znE-EFUMv<%-J#EfW!cB2wxUEpi2X38ER2Ljr4fLzP!tx3!4^rDP-uv2sVc;-J8m&y
zjM_>7Ea>4FsQ71}4oX>PaC=dw#DcCHtm=@x@N$be2w{o`wUfVfCKxgXUJenbE8#9)
z_Bibh66ROpwoYL)(Q4WuOp0;?7B`Baqf$VbAT7LCTv@i~kS#hp)ZzHOqiU?5Lp+qt
zvco-i(E=`9Co1+%kD>E>C`4gi4M*Vw9&*Hfw>r%AuFrSZVToNvLeuzlNc~ZVd|-!v
zaYciFZzf13DhJN%$K(zR$<G+4{NZe5*zK`jz*zj8B7QgUXD<&Y(!h#0@b#OAhXaYv
zaZt+BwLlcWvKO8BIgU3o75NX;5@T?TDy~Qn*gcS7uV1z*K@Gr;Vu)WK9<Ia63PaHl
zqjm_B%LN4%pt8I-)$L|w{0$2(F9oOp!-&~A9qhU6bE~Z9ofUy<5m<1;&~>&>Xc|nS
z!lk)knmVXy!k{K}%Y;S&jVoV-HE8o?X2G;5hFnpE;UjhEc2h@}Ei>{pn^%}5W(1mM
zKfg`Zotvm^?Kcg8Dhi^81%+6)H<7@rQ2;7bJJ(cIG*}?eN&NW$$_(FnEP_xlY_CHU
zQEK-<vW;JgqQK*E!|igx?e^Gxc-&A_4Q?&o569=vf<IeDq1y$QolYR~Y5~Nk1v91t
zcBoWO>9r!^@vx43EcTux2zxC4(SXP6MrLLPCQqJ(=H^!H+O?Yrt`<vv=E-jSClX=J
zHu#s+G)?4HM59a~&d<+BFc3s67840nrfI>Y*$Ic#f*vywjl>X(8Bhr8b>Q{55RJqT
z4zo%_ZEbDB6QZgrB9RDG&BbD*Eeop41xkV3++65-43=RaGsA~SxE;}O5DH<{Sx$cX
zDfAeNQ8f(<LoY8vd*}=l7tq$$CUOnjZZ|SAyda>UmI;Gc2t)($s%~VuGmx2)hYYVD
z&8?^5a{KH>g~FGS355_u!XYRc>%tq+V<4J}wr~)859~*%Jp$bp*bg5*!g@Lo1%W`2
zbqoyzp(rXm9v`Ts;K-4G0QlIxG1z^Sm7N2k5QHNU7`l#dC<Kq~X$S-Y`0(ICoIZUT
zmSx&`Evl&T9*f10las@8FGvh7mj~_bZK6YYyi6fMC=_A|_FfMx3Iyy1Q67&66oAi{
zfxJA{l&;~(5m<IVih%~}_{<*rs@+tPC*+c(MV-g0!WNLZ0>Tq+ofbA0+i!uW%yY)$
z^QpzH_eR`vk<vn&WMx$ny$h)<vRptHB9c8Wu`meXfrW6f)gdkj#n&Gy77`va%Pn3`
zn;R7ZKbTdC@N>##6w9H6C61R+J6hJU@WKv#u$-1!ZUAu#l-&Aj_ZXnmF0-hx&fA2A
zle4jabs9AY;>q*&HDi4%ET{Pp6bg979Z~<^vOrC0Cv~%h!ZcVXS*obw+Sq4BcxU3m
zr-YMEKu&j_oO4@I61R8W3tYG*OlwWO-%j*6r$WI0w=CWlhUeArDur(G8GhZJ)zNr9
z0`o3VAt*W(3103s`KPmU<fLoGuH*T1Zo}?3$Nfwb&ozhVEN~A*g0iF7s(OlRlB{H<
z`ak(Q3$M)p#^g!N;(W5w_S`T-Y?rZWe_uXVc!3o0ytAvq*~xfdmFM^bw$~xbWGX^f
z9vN4Wtt5q>dlvXJ(Ig$8OA3h_ivXr{Lp*cAo|%MzsxIh+8`w0K?Cf?S!=DYJ5?Hzp
z&9r-2=mu-RC_>s;sGtHBs-;5nu<ApW?Qtev_6-f&`^<c9Cd(7Brz*?eP}plKJEJ*S
ztU8lrG5HRTkRM7-fKWSO*#d}tZo$@S0wTiqOw+KNA+iVpLgStr%b-vcYKJ-sbDVwd
zlxEe+qW}OP07*naRCp6wLO~S*pDh#f^+O@-dYYz%U@#0yL-rcu=&Qm#43vs~6pEt3
z<#xg2_JF9&!{~N<;BjkkX&y}M;r#5iB4OyZUB=Q_!jBy{>~gbsv`91z(*WAr0sy6O
zd)yd3`ZG9vy44O@@<G=lcK2%nuh(mb(Xg_kgaFZK1QY}rJ}<o9Y-pN`Ritofps;Mk
zgTn96hGnrf->eyw3d<r0hoboCuZNJ6n**21%B2N^A^hpxKS4KiC<+U$0a&?Cq7Z~b
zA%wzVsG0`dFyQlLFlC9Cj5Tz)?1#6is=|8ga=GDlxj{7oug`~=9)_x_tVe_9f}&^$
z1cJ<s=JmpeL|_>@0^umaGz=GU!9BzaUuFh^kq|URMWC%6@VMd9H00*wqAkz{RaKCe
zlY`bXXW;g@(bj$jilrbUla++i^(eA){C3Ga9X_82x*mhu?L{~oMJ&c1EN+(zfk4n!
z#wbF806ZCP=n>Z32|gd(E*JDz6q%WsIN8_;MImTwZ%0;E7VG>S4%rKWhF~xNx7%Z1
zTLl>znTSRsFwJ-_44caY85t@9!5|c>ATz^<umu>A7^}r^0nLr4n8(VkAsh_BrS*E6
zo;R2khljk_8oq7iR667kQ1KvQ!mGUya*u}N*~}LQE^P35NEIr&*Rq}pw#yqx_-wi#
z=l)ZNImPMVy$}LE7ig@6&!!gAAQnZQ{1;a=SkDT8<wco>X}@lEIJOX?V3!<pjx&BS
z#P7}$$<F^1uLfm`JOGQ>u3j2XeiokrQ$AG0uaiRAdZW^K9+nEg?alz}s?BnZ_>XB<
z-=M-m7gy?%E3n0dO17}D*yDjMAe}7)PS0M)d7M0dlRv{=a~36tld8E}@_XIIna{+9
zTc={csz`Y{jM@2nvS+rV0Btv4rKH35-4&+0`d-QV>TI9!F#z$qk&1gI`E!nMmiSlF
zF`VJg&TUg&?~6s@wrp>t(}+W<njqR!)3BSZ^ROBv!6OmBZu|!TC2<eA0&szb+S{<s
z>D)`?gnPp%Ov;r4y9BZ0GprMP(tJsBt5}r6RG7htShiY30JqD7f<c2ZXz*ZU_<SHn
z3^83tdnklxIEYXrj8Hg?U?{{2{ZI;Br_fXim&QEVCI$4EZnpx^K@}4U>@v^_%Ojwa
zb)<)#Yr@86ft5~X%04fQpoo49Ot~@)jd`dEiyVOPIkPgj6ciTKxLFOby%HuA7*t`A
zx_1AVjv+-(<C=XgHJYGE0Cp8e?pX)ykZ4x^oR#o(thp9%eE=9S3x*znX)9+ee~O&j
z(5Bz~=C`bIoXf>xj45S#35s1#)nu0Hn9f3O6a~o5%|XfM#~~xbhe#xXGi@!1M5BmC
zqG)Yx#p%<h;q!T6#&oEvif|+Zx7&l(GcDqVU=@Gd38hX0fp)t*8bLJ5LZDPt#i>)L
z(9m$02@i?|g%IevA!7S^m<^>A;VAPIXbM4gmKUaF!sB*<(kK86Zl8x~(;k*=Y3Qt!
ztlPuBf6UOK8?0)G%cX%pVIfqMSy)t6v%3-!sH%o6U#4)EGb?=<pSGM}c_1_j#Zr*z
zbAtjfEEB{caH$%C?d{0R%R_c%2EvgDsG%b(ClA@#IU*eC%$XJ#h6$g~2cM56@L8q_
zpN}Q=m?n!&^kujajYgrW3Vaz}5CVAIZcx*JN&uIpu<)~33|<#2GpTASf}tRCb6IsP
z!!TJKUQ9<$PBvUFH-f>i2u)+vwpi5;O>+qWih#n<b+}zFSkyu|7=mJ7<6tNRkH?L+
zGwpDbxTk6$k)55*lB8lWw6?Y;2#JYdfK)up^$4rb!mLek*Q0Y$Fbo6j?d@Xw<d8!C
zInyqk%s;~y5fOiF|IVsxg%ZZbkLUDO@bY~?$A#Vbcd`<Z&Kk-TtPasA9lldK0Vr8O
z;C&=gDM!w~(^)T_As`fBr8_}WdNG{aI}11P{W(9+S50bBP>02idt5a;F_z=ppL0yk
z>u6afqIxu890QfE1ikJEg5o|(v#oPpB)`W!62i7C=0|78O8%WXLP7ZcQ-78#+#TOn
z66SjH{HK&Agc5fg6AwXA9Aijr2uMeF=2AMPjDI(79N^c3ThF;QonhJGH1_vQ+P5=i
zpTC|;nMh~wNOhkMbgzWM6X<C?bk1^K3;RcuzqTkqAfg7+Db|4f%%(`;Ik5Mg^1QJI
zhU_her#WfgtST6{)ThelV#NtyF`0*rfrUi}PdDS>$&>JUe8|kohUWFc<MSdjCkJ`?
zg}BV?0oB+%h=#*B({={I_IB3aEE+>B5``HdP+ba46)-7*4%U+*Lt*Cyc3vAR!A-!!
zvMgf3f+3#2yvi7x*NXUG)iRmUi73n%s4!2FWtuD`%VI_;0?kh6WA}2*FhMQmji#2x
zA_<bh@rc5eaQnJ}h+-UkOw4O!uNln!2i2uI3OTTmCU_+%1yMb$Zv+J_usjV-Vd0nP
zMI?Ez6^W*%lOVQW&SQB`ecH(C^r|j!f3K<%(RDc-4&l_PPwlvO1)57mC=^0Q25UBE
z7zP4?AaZka?VJf#s#UW)UdLiF+nu8(SaianFcg)!ccM{NSJ~_Jh?e0BQD9O-B&%`Z
zEEbE2up<xxSSB>h1>G><cKZNO7V@O1cI<gPc2H3jz_MW3N(+C`D^w8z9DxSYVpak}
zH$b4l=kvkiaih4n7?)i(1mSQ9e!m}@rio@=gs`wL3ReCv7K<Sm3?`Prwc~3ekr=!l
zKl_fRiD)c}NH~gpAM67tK`;<QMn(n*F%b@j;Pd%l*%|(nvI<(3#jc;*?S|j)$C)!{
z?C~(chvzwXJRXE1Vb+D*<$`Hixaz8_keQhYP1E4<cwiU?!r?Fg1-c$XdwalM2rZF3
z@9}sLYHvf>cD=dXZus(jws$Im+-%m-G#CgW6bjoVd<Pa+U3HbHSjBThc;zcTmm`sg
z=!X)C>S$_i0n3}SU>G{9#$eA0o<!_&xsaQiD_-MaV_eX5R#5Z%ytd1hitYIr_=Cvn
z^`fw_Fd^I~U3_(Sa#hj^E*%%Ic*0~V4~DZMoOAnRL5Ba$&qpeS!6`&K%RVP76CzO?
zu&a4Mgb^hw2XUMpjs#`IArw(+D`6yY?5e}FnM$!qz7`yoB$!&M8)&5JCDL;`#`Zhs
zOXnUq*jCg;p`UUqE4Y%9%HKsC!n5UgJ=Om-;cuQ$=^U>pjp-Pl(}TgE*{OtiK8_A&
zhNKeS($ibTE^g_zU5y>CNBnnwp9%%f872u98R%3DyYhZ?Hs*n@KyZ>h3w%A{Pzt!*
zE*5fa#68ojG%2xDBT}Cy%MQb&CbQ7<$wa`53jowIJDf+w?uo($UbdO@7=+0wJgbbr
zE>G)F{3$>c3j1jb*v&(!ML{gUrKq5Wfk103!qm<IvH!U}9%TA6;qiEoot=%$>`V+T
z8VaA+4OMj^tm`mhF&LpJJ~@5@6a=OoLo^ft0f8RVVH&y!5dsAZZ6Yj3&E(-nmT6Zw
ziwo;SR43E`n%F$nw8M+3eGN2K15xbcbpRl&AdzLUj^n090hLt+r2JwcG0zG7+!9Av
zu|ik@Am@4m%g#HZFu3esuX)5a@~esp!_+}xvRn_7!mv!l3?rd1Nl!S7s!cl6N$o|F
zwXfIgd;=XW%?)Z%crty6M0hh5>R3493uh=477t>#%PmS;@dRtjvP20{fWYH+BOD1M
z91g?ncEjs)<MPX|5WNoa^74cg9AFnp*Q3z&m=L0z-FLa*9tnqV{FCE2apE|5iA`R$
zh$$T`jE9xwvJ!+He)0(+qV_hoAhXY~ETnidKH!s2j=|&cAP@+!hDEkQ!aI4p-ELT5
z4~#${0GG>!P$-19wl;*rVML=bG@UvPmzII->>QRDL<sWoa^dx`+ytUnXm1O`>(iiV
zD%#rGkei!}tgLJ_H#fuOa=|ck1cR&tcUxPV5On$Xip6508DPv-#y<Jv6R4_+qeqX5
z9w6NMZkiAZQ!vQFr!q1!ar$&KEX!iohBA+YP{0(0bxSu4WY~&{+hr$ahr_*{rss{l
zd-sX@-kQb~SC`8Tuh#>Q$73f(dEoP9+Ve`qh>_R8vWO7&6T)Atc*QGrj?IM6B@3J}
zJ%(^FCInUf<953fyd0Kg36D?mLgVxdB*a=Kk!(@#N;u>XT&KG{l@*@vFV%69f9GwG
zx)K_A%&;^6K<tAnQk25w_JTdV(;qkfT}Z;%`T3&uf<q~6!vKXdhTR#qlxkmz;Y{L)
zAcTmXI|H4rzC(9}z^*=$&U?q6;mPCRLMsJN^k&xs;2{l(V~QtVCLhl!<nx;F01^93
zE^D1^J$KHhbON#SyRjUJvpb(%l@jh&NLP||I_{N-|L&aE1o3`O{Q2ShzRvrClk9Ow
zR+yYd1?M>&xWvO;VCR%68nHuKAS})NIcQfWw!2lcDsmLu1E)BHW>{r7!g~8qsP-D|
zV(;302nafAs{HCHBDcb>0A*YF0SZgC6&0}og=!muVULGc1cZ2m5mi&;-WP=s*e%(h
z5eii$Ahs+;4Flnp(+FA=&Bu-b1W;5K?&Ws5ke!o*+?*Wb<mBMWtFD4KGZUGrig3(8
zAgUu84j~u_AjA!NI;(7C7zSWjP{1N<SSXSON=$n_wL5+TOo<TTT>M$V@=i1!s>oVR
z!qx*oK>)*IC6ZMY#HE5l1+}yUW1dRl=YdywgRK<6;3bqzaPNp>C(RgCheb_TiVBvO
z!E*jU0YkT7QImyF+v^*s!or;_Kvh&>9P0_aRwTyW@HqewO~@jV2tN7b6GS2rWU5{O
z8Z^}fkH?L?yg@j9`ZNduyk55u%n1|}4!Ht`X&@8~iHCu1=<v8%B`4ivLXzK~jgpcQ
zTzk#6h(@Cbg+d60g0L(=*JEN_s;a{4^$H6KA%Kez_<XF~EDyOc3|4I=7-Gr3;Yh^Z
zmjOalSQcOyCN$0NLt&YA&jcmmA?6hP<5m{c&eNc*cZMw}xLj@!0yH<b;KYe{aPs6y
zxZNHM9y}Oh$6gP=KNDA9eKmBu9=O}%#<5R6!J$Kk(ca!JIzNZQ5wx_NMrLM)NJLgt
zR<$7-jUpIohi*hch#e}TDTqYF7&IskL?JlUbP|IH4~EC*1_41dsvr~!iZZ*gSPZ$j
zx#D|8A`$TNygsiFF`X$E`T6-cbLNcbNUkUf^7Hc%jmB{5R1>^*p9+tM<!SI9A<<|Q
zZnukhf9!rCUXO=`$=MIFmX;O}h4t%jxm~@Trss{OrsjmuAU^kaCvWbp;0+mxqQK?$
z!5L!V3~h2YXY~1e;xinsSnz5NmTAB;^aO#_>5bskn)qwZ1v&Y+T%qUlfs^bda9SCi
zq*}l=yVM<!XnE-@jEL{c`JVWj5Mj0H@LrNN-|3M^<q6=fU<*Vng6S;5$qG=%AGWl!
z#XDZDB$bzgD}8*wiJpz5^PzMt6b=MZ&8KuiUq=C+^=WVlt;wHHWz9~WSBjn7%h!we
zXSv6L+R3LtvR8t~g!8#fDZf?#5gsTOt`Q#>KR(1Z$wdQ_zjIeYHCtmk7qpW}o~!J&
z)aOeGc8>cdIq!<am2+=|!{SWi--S{j7K<f(7lp))4@_uEef(5^J3Wg|?+w4tFBTNL
zfCc+X4#S1wm^T2c?B>{xBK4ec;<9s3eLkOv0O6$a;&BXHPGOyx`TQr2X-Mo4sU!u2
zIOiKzGWoqkU{bIUAjEqvvAwaL2gI^O9)$wdY>j9t+lT$FEz?9xb2FMhJ;lo4TP%Xb
z=gUAwULG=Y@{pC4g&~EPGa1U|f(nXAB!)mRfN&syXfS|qIE-*43PX=27@-L4b<3i5
zl|)vl$)c8BWl^<n0|KJhiP;wH2L!uUSVScg{w>NXbMgBs8DclWR8`jTno=Elj2XSy
znn8rI+M;&(aeICcizyT0o}qR=CMZmkLe~vptOsEg5PM3m6^T)!M#1HBA;afm$ug#i
zf`S6P{r20iECQd$2UT++8jT_vjUW;UBR4lkOlThC7!HRK3WdZ)X4V^97_xZDM-y#l
z+OX$Od$9k5{kCw+JPh1Y#9PR7OS);AA_qd(4S2ko5XOMGK;euBH*_5Y#L@klS;JW(
zoD0MbA96lW4LcT{6IWE271`tQfO#pnHmgEWO!)o&c(XjqLVbNbyk0N<`qz)(a=CHY
zWrH!icsPoO7h~-8W6>UH$LZ6j(Ri{EAOGWH3>)@OIDY)ND1)nN7AzVAQA~s*EGau9
zGZW3tP4IX;P!!fFmQt3TPYA2}!zPdlzds9xZo)EIs1bjlcsw3NqfzAM=CVeCriqvy
zgWK&!Bocw9v2ZO`l`4bfwuGZ#u0N*Ow6?Ya0PC}1D+;XhH!HbDLC_WqA;af`uCp*I
zm)irs-;Y3`9pPxSx6|~z;rILPN-UZX4!J-d4u=s828H0y1(m2C4^iUVa^-_79A2*%
z1qB5{F=6H2R7d<gYciz(aI5V4>h>JfbzOLyxF<tZRl5RPVhC08!c7QCSYXmw>76nD
z&c!SF^Q=i?q6;-y>ET{Kr_i3PXz=|SmfdT@v9Gv*m3VxowKo~QAV;Gy@I9sy?$QZb
zi9g)x%pTHCk3>gLLq}5OOR(|LgocL$8RvQI%z~Uspk{);v*BXLYs8<gsor<)C(+Z8
zs4OIpGycAF>`I60>HL#-4^9m$b?hwP>Qn?eQy3E!O_u!X6x{j$&gVlaML+HZ&;TT!
z|Kxklxxd8w(^j^4^orx$@bk-+F<#b~31vxzAkrv>$@f7zFGafhdLW~5D?EP|B^XWY
zC!a~tn{Ua(s$I4rk4HuTof|8NV+>rr>2MD?HA%5uq7jB)cfJooi1;4-efE1&Gd%)Z
zq2QiE3f=x5E|+GnaTH!}2DmXe6pf($cq6P6pV}4j08Leq<<ElG=R;Ob4)XE~Fto4`
zUY8p&!i>%|8bNz|0Byk_!l5AaNE8;e5YtUomC3YNLN?K0*oq4)#cR)bh1%ACR<+5c
zQm_OG3Ybg<B5LaARr2~r2)ky?p|9BIjztC;rUk{#O2G319x3m4yD=4ynqcMnRW=;s
z94Zq3`Pv3hu;g4277y=sxr8ey5{-aFV*s&)U=)oqD><{QdSDo)ZDn_ZQj7HxuuM_f
zl@JAn5wlMe#p%;6@Or&448yi^8!+tZOO#R}c<~#8pTvv|AGpzpKL9mN69RK25@Ee8
zOcoCqvsiNuuh)w}AOJvt$D@f5t!OkNl!sU>W(((Taa<lhXPT^%lx0ynK{f!tKNFdm
z82|`W)#d25;DcpZIChMM4E_D@f5)CZ^|<n?t5{hsj~ka=b{R$#kHCoGBLT1;5TQ^z
zvT`!;>8GEf;m~22rh%BQBNmN8)hIGEJ&45&Tc9O&Wh)m9BZkaOKf>WKGBY#m@Ffdb
z8CeKN!iYp7$jQkO=O_>eFvY^>MRs;JbX`X%6av7!QUFBEzuWB*c@6wJn5K!gwl-vD
zX29d|A|o?XxUn_Og=|+mM<g6(p*HP-c2>D-0ImVa9tWq8%nJo1E{Y0Nmp85q*uuPJ
zS;FH(2ti9r3mO_4greb`^YP=UP*noA{Tc4X;Ee=X*qKKtApk@kP9P9KdwaV*w^%g{
zUDt)e(V2A+NPOry|4)7`l~og9^M!jzc+mvDu%+`{0Dx(S$tB}V%1j<#vN9sZ305)A
zq#YOL1c4{%p`Y%DC6}@ifyrY@RZS~lEHoYq?Yx&Fu}G&@#(_xkckk@`QHK@Z=_zo|
ztz^Z-`Frwf&cB`i_w@Yo+=t|SrBht(ZzDdNtmLLsB%I$NF7TTP-=m|)Ahn0WnTO=e
zUq~2X(*5jIGUEHP#|(!h9M0ntI~OnBft(P6#29nlLA>+tp6YMsc}o=%IgsxaMYR(V
zC~Sj-<N3mFhHiznrGg9a+~e#F+Xm7r6HYmc%R}6d%HfJm$JaV~kCSs}oN!^8-|JkC
z<Plf=bzV%zFnI2o30<f5TIYg76c{E2Q8XxS6_#Z}H*^Hs0%&h*!>7j^LC9aBDhkUv
z(Ntvl{TMW85d68h7+iQc{5~%{ih`I$(H0DXSQaADDB9ZF5eNnmi$-9XCL+24-C%jW
z6n2SOyAi3^<%U8iEW<7xO8_|T34UL5nIW!(Q&77iAOW#G-0Xd}R%)OcwW}D$W#D8(
zf+hMa@#g_o9+@|#rw}@j?=Fc%B9TZW5{X1|UKqG7Q6&<IL?V$$BofJaLn;yyi9{li
zNF)-8q{m1_LL!k!Boc{4B9ZhMsYpm95{X12kw_$x9wQYAi9{liNF)-8MABoVA|a7T
zBoc{4B9TaXj8r5f5{X12kw_#GNsp0=ghV2dNF)-8L?Y=iQjw5IBoc{4B9TZWJw_@L
z5{X12kw_#GiKNF!MWPGJ%E~|p!OJhde7=X$E1H{|@$}PA57_ZbBoc{4B9TZgOfE=8
z;>|bT1R<ou&!9nrP*zrk>gwuqHkQ`bRsg`6GiT1(G5eCWYu94&;>CF2fd{Z}-@fxb
z9LXg{b#*nSPMzA}9<HseJ>Nr<NF?WwmtTGvgb<XKm7VXQNF=>t-@bif9h1blAQg!N
z2Mz!L^78UfT3RZ80N}OPUc=0pGx6Yq51!8<_B(wwVaJRa1Av{&qN1X{7@9=VCHwa6
z!-x?hFmvWiY~Q|Jyx!8%g4bSq4HG9$yy)*?$+>6TxN$;hojP@Dx3@cd_%KF{7$LSj
zm&U3~1#XPv#yQEQ2UjM0@^c{>K-=5f0kCyU66b<cBse$SbQ891+a`WapFWLMt5yL3
zDl04T^wUqD=MnZFeKldf@|CZEQi{{3Pa{7+zb}R+k#x%8!-p|>@?<nLG$1c84^>rF
zXliN#r4&s~O{l7>LUD01Dl03cXF}4a)YsRG-?wky-fe~8*=L_cLqmi3`yc=KN1u&p
zpohmwBoawyT+oU{D(26hkMi<z0KhMP@r(038i_=b%!3a;h?bTX<mKgI*REYCD=QO9
zY<_+|%F4>{?z`^_FQY`#*YLUZ$}6vQ`Pt^?W}$Et7Z>;WSO$7{tVGgR%%49Wl+uKs
znwlE%e)4;iQe1!i_2+TKlI}3z6bS$rHf$IGBv_C*hYugdgAYE4L4yVf*H~Fu8Qy&J
z&9wXD3CY~GJ!sG%JpTCOXl`!qaxB%=)d}wO5hF%)y6wJw`-Fvxf8Oa?sjaOAAp{dA
zP86>>-F!}~7T?dlefvZx3E$`8!-vK3(uGJJK71IDKmK^i81_`|M7}Q`<C^^4%gV~c
zaV3`~`}XY<p-eBm^itYIAU{7J+qP}Pgb5SGYdxKh05E9KAThVAtE<I*-;=Nw$;HR)
z*|PyKuS8eRq>URlqNSw;<>loVF=E6y7@b5Skz7R33y_M63JQRhmX>z<e)915?%hlC
z^71GET3lRAOG`^>adENuY(+&yhkZ3QHPMoi67d=5HYFt`;=NScmY0_&Y*$)ZD*i4m
zE~X6)4IReke804`RE&4ks#W4MrKP1E#>9W#c;gMRKYqMbt5%86@}HWT8cHdpH8nLU
z&s9T1L&E3z{`q+F^7823y?Yb3;rl8rEfwFLe-FN&yu7>)-&=C&@YrLIiFwcydNUs>
zrQ-9c?g7cAhx7S&@4fd@0Q9lP9_w@){=BcLsS(ezRL^@#**q;TFHcxkii?YBd3kw<
z=brPqnEaFK{^-fRDUGiu_uhLir8Iu;r5Zm!AN+pe_gGa`m3W_ztEs6e<#*@DOCEcw
zahH^o(29zRgnf0juJipk$9V6(_a>})l8cXYG76`=^PJ!BT$W0vtM{v_syfIr_uhN2
zkfpjBt5YVr)VLs5+pZos{9^NoMJZDVl7(`P^Wr-v1*P$epDd`n@x~ho547Y5Gaq9~
zNlC&(zNx86OxWb{^Vd`DE7gO)D}g9^(mRz0{s2$6pS^qc(&FM`v5+{&pX&T3?<@H{
zH#Iehg`~W^Jnfhz7dPqVPFM71K2k~(<|Drso0^(B+~<-@1Lt$Ts;a6>rS^?C-bh&d
zJ5wZ_hN`^0ybi{r<Td26#~w>ihPlzDw6wItT<+<<DNQu&@U_LMByjk7aE`%gsN(ku
zKYsE(==?s(_hDD#cAm%1*7e>P0VNj)UCBD#o#$N{0Xlo%X%sFgDd{l(x*Ds~xSj6)
zxtJMHibPXWQ^Eyz3JYB+AN(Qc6mpxInmWDs&Pn5(d`_h$mB8ZMuT#nBY@5!Goet*%
zJC(JzyZcFoFRsZ8uybFj&KI`|mz0!r`&g2Ti~d;n)6GZc@rsL!(^^s`mkvD@j+3pF
z>4XjEGrzpNJYlXiG&BgoJe4)FD*>ms`%X6O@NF9!8pL|w^z<bg*tiFPuTgw$P51of
zf|c`JI*mupaW^$J(Ta+S1aCrT>w0gDfRc-Y?kW<U&2vh7uShrz4#{(@rluxAW=u6!
zr=or-DiM@k;EIIP!jbGIPQGCLVVmwka$&^z5bKGs?wowdR;*O;@i-?Y-&gWOHx)e@
zTW7BO-Y633w&}?YFS#`74@IK0dBtCs;SUl@J1P>~fRxI>#D#2UI8QoZgRe>Hp7~CJ
zJ$Vi4O2FyuzMc0)Iu9UM4$>LeoH+NFE-cr1uABl`ca->aibQXWfRc-cp2!uQdAfV6
zNN{DiJ8M?*Si3T=UMgs~fN5!INvJ_zTwILXZo3VSKKdwz4<DZJSzh*U`SRr{D|PVX
zXXpOje*0|z=yCNJ-sj@<>C<VGI(Z`a+i$-u5=x(V;t6cuz8#g7mH6H7eur;;>sz?z
zo_jicm!6W7lhf;M4<9~^9Xobl*REZnx=44D%q5ckpttieJ3G6-heT5EH~;`307*na
zR3;gK%$++IPd)XNNV;}DYuBz_3jhgK#nQ21!v+Ar_rCYNl<yB8J{+Z`rP#iGJO1#8
zKlG^ST3_t@#TQ>px$W<M_d5W<^y$;P9LIzS6Hr`SjE05=?AWmb^XJbO@BQb0{wILM
zbM=Qm`~d)P+ika<RcUel{dt0XGGF}S7Xd&P@{pvR=e_0d;ln~!>!}>LZ{I%LdFPz~
zfU2shOS;kG1+7SwmX>1MwrxGy##u)^-9Gz@WJM<xU--fo#P1U(Oh8Rd4gT%l{ter=
zZ^z=ri?Mj|Vw9Jc<H;wVJm-BL9)J9CJoVI5=k%D8i<^>?64ck%<LJ?&J>FK%M@e7f
z6vEf8U5jPQmH}YOX=P<403-;^>EP?iXFvPdw4eFXm%h}kDpCEh?{sSi7m_;Lx08GC
zy%$eC^%T~uS(9*HUVH5|0Ko0H-!5L`W4ZCh8@sjdbo9muD7iH0YZ>YI@#Et6o|c)N
zJbALH_I4>N5x@W~|JoTfH8m+~5%Zs(Dkhy#T3Xuau_&bp<t+iGOl;e>4SV<Q75y+O
zD=YE!uYbMI#?>9FtE+|3R#8!bhK7ceb)6-Wp1|wyb4zG<k@Hc~UvNuzWo4xhN_Xto
zftHpQl$4anI`t0b&YcT@3HQzt;=H-!SHAL<emi!3eLc2s-`?SeD;l!zjO0Rs%Wu`y
z)fZIv?eoD!qeyT8<}ZKwOSiWfGiD5co?AMuy6P$bz@Pr~rygzR<ofHc$4f80B!r~x
z+qa+7$;d4~k3IGnzW@F2pLKYZL;?VJ-E|iLW(n;{*J?Q*CH+NNSsC*3^3c-Kf*m_{
z0ASW{09dqW(fJ(O1;_B=!%<RF0s!J%Im4RzlXGbVlt|8&Wy_YKq@)BbEiITgZ{8&x
z5`NJr61UxU8vtO_rcK@6X4I%r;`dYy>#D1(Qz{uZ-E<QG7TVMkVJQ_(k41ZX`&sR)
zH>Aq1XlrXb=i`uE988%q1$lXS0GK5>-NUuHxfu^W_+UbVML^C+N&mow;N{Dgqqepd
z_4W10%ggJwaNHe3)qnr@e**wM|M}1NXl(ttZ+<TxJ9ezw+svCc4*;-c%^Cplu%@ql
z?Q032%gxONfL?_$I_ZrOP$KCIva+(o@4d;vdF{2=ke8Q-`uch-S+b-rhc=+NXcUP@
zAAJ-6v+O_k;Da3m7~VD4DfsjFSpZnNbZNpi)z#IQIdf*pV+|iZT)4IFyz|bK%0zW_
zH6DNbaq&0rJe~a6>gs9$?1Ar8Dn^eUEq?E;D|c_<7T*mUHY9xSH{W~{_uY42pC3<h
zX^@|vkM--<17Kc>kt0W<y1H7-vF7GxR99Ey=9_OuWo4yM9OQhI^d~&tzrMa63l}Z~
z5D!i04%|@1h3jMvA3iLMPSd7M>(SWG#lBPJ9ssGsGVZzO9sulIz4_*wXlQ6aadB~n
zFx|<MCyRZgG8pXJw@<8Z-5Fy~jDQkJGMy>5wY9Y=jl$Pof4xw)H*VaRa=%VFE}7xO
zhl};Dva+&U^ZlaaT$P9F30;+gONX<bFW)}7u}E@>u2c<moSm(C>A6&O#hp!koXv)u
zuW_6u{8BXqN>w_{xi3C0=Qz45cSdRFovqV-?^KOgI@?!w-<MoER8>_aG;~b$<1FXc
zoB2p-$8w*NOPkK-gY$Wd6eUh6P5(^g<xi96Ev1RQ9#XAYd<{w0pP{$=?#}bp`I+P%
z4SbzVb*_>df2Arh-dX<(-q5u>4e6X~W2(~V4Gj(SvBw^h_xMFhU&$3t`L8$4g_HY8
zIGYQ1H5Pu4r)nH|DR4nbe7vz)PrKt%${xz)<>d*&M{#j6EiW%m`yk?td7Pa!`DEi`
zN!M0=)v8q;dR&y2meN(LR&{tF^07H5b#e=KC&>-?ii?XACTUkK-}y251W)yzbHOMs
zE~bw?_Lx{8lDFw>U)_0Ma%sT@0H*+#mzS6JUhL_7q%_`e>{5JqOFGh-BH<J?(iy2b
zGtM}-Pu0b_q@*NeKLw}o!Hr1Cf=F-n-CY5T3pvi?JB?+j#++=FOLu?qo=VPf^ZPwn
zsOro>*c&6D<l>+&4V2Ec#yJ-|GYThf$2(g)mE`V>#d)kttvTuisYpm95{X38Q#w;D
zofh<T#v884rt|XF)YQ;>@4Yv{7*tYH(y1|rQYLUah2m5e{+{l;Cx)9h-gu*fV$zu>
z+j*`!YrM+G;T$(N+$9TBT^R^_V+528eEQNr$&Ih6jKW-zO?N+4R8(|OM3Nhwb~YBL
zSN&2`dI_bJLL!k!Boc|lX56@OsIRX_MMVX^|NZZu@8L)!k_!~6NJu0Si9{k196o$l
zR8wkbXprTYB@#(mE}E)M5{X12kx0&-wQJV`V4dov5+RXDIzuWF5{X12kw^rUm6ZVE
zJtZU(i6k9Tk&s9v5{X0tfYsb@X=y=TULK}QnR32|BauihaAb~zL?V$$Boc{4BIz;G
zBO#GUBoc{4B9TaXj8r5f5{X12kw_#GNsp0=ghV2dNF)-8L?Y=iQjw5IBoc{4B9TZW
zJw_@L5{X12kw_#GiKNF!MM5HxNF)-8L?V&&7^z4|Boc{4B9TZWk{+X-?*T|8lGMZ+
z-bUoZoroQN8&>!Xtk4+%fRd2|#g_xuRX4(S-R*E+eG{O_Tlst;uaiU~kw`98WJ5ZM
z<U+zS5UgE;_U%u@Y&+SlO%#7V{9jrC|D=aNT;6^jpag)tP7;YkB9TBU5)#P;L-en^
z(E8c}7^fO~wY@gD7&&(>gZFcH^zq0fPULlxNF)-8gdr6PiR1zxu<He!dHr#~GQ?|&
zKOer&-2v})w?obUCn%mw0Du(@!fgIKBKx->{J~~ef#!sLWlehw*<X45oR0reL0%_`
zL?V$$;z&h8B00~rZdioiA6ALK)$Aeg-}+r-PMFta2n^LD2-dDaVCVly2(if+SBAWA
ztnIfkUy8`<B#}rY5=kObk&sBvBY|Bn;LL9pi@!bBPDcLy)gT^!kM={O0i1qiHX;YM
zir1vYyYG<KNg|O*B$AFuMM5GuPelK^3r#QGCBkHUpPzw2-&oW8%08BX)?Y79u$t%J
zUoB(t&k}i^Boc{4B1w(xBO#HT4=e+%uPqS5sps0sXD6HjfTAJy?urC~v~|NGP(5<C
zqrG&I*GVFgNF<W9NJT;-IS&MD*NCb=YW5K1-(TG~Jq8pFgTAo_+TdaUfZ6&9+IK8J
z`~6;`$m=ALNF)+TdZZ#Dk(>wGw?8d@_uu;69>>~u2J!fjRr-DLcX0QM(%Rii<aLrr
zBoc`vJyMa7NX{{_hPOrK9>t%J%n9@Q{1_SI%An>B1prv#Gl(62r_YZu(0S#RSFml{
zwzTid>m-p#BoayINJT;-Imbjk+$nzdeeRC_>2j=S@ZB(7{26|4W8WWRfHQ2^Ff3fS
z5Ywhj!=XcmI=nBhlSCqsNF<#j6$y#t91}bIw)ow9-R=E$9N+c-B7WD8|4+XiXP`1^
z(j@HPzaL-z@|Q7j;za!Lhd)Fh5D@Rn>m-p#BoayINJT;-ImcMxGvaqO|DXEpIBMQd
z@w>ALnk0^<X?XO}N3nnZezdl>;=1du!}|5>0VJL?o)q05$m=ALNF<VhN*|OTkw_!}
zaP;U=R99D{u&@xrh7ChuVIc|&3z3_foA5a+6jvk^PiDW3N68uzKW4iWP@Vkz=RZd<
z7{t(_Ls3*zgrcG%Jo)64m_L6$7A{<fmtTGvON)<TbQb%(l0BsJ9i9d9I!PoFiDaN6
z6$y!?j|c<;IC=6U_U+q;#>Pe*J$e+4jg0^xl#8saES&n_?|5z!MNt+xC*vCZi!j<_
zAz;P1Io`#>ZGQwlldoWVnHNM+`~7$~y%GjR6mv6|;EP}UBF2v&-$4nLNF)-8<U&F!
z5)w%tF=osdtXQ!^{B0Np_U_$_?c2Abs;UZaz4aD&BYBnh0034ri2f2$xpjMVKEa<(
zP<XvwOr1Iv3l=QEq)C(d>8Jybrluy;)zx9|-o4nmbt~%X>R?$GC<XrB#;%vyb`sj)
zzAOFegkPsImnqnB*hE!T72bRAJ<OUl3x$P+m@r`iZoc_uj2}N9qehMDmoZ2r5{X38
z8>Av3k@O)uckaaRfB$>b*4CoFz8-mbd1!5Ig=JYFga}3AazFD9n9YBO>+;X^%UH~o
zPXGW_cX=^(T?{&a<HwI<-n@Cp%F4o`MT<~YRt8PG^d18{ckaZ>l`BzKR|mr|P*hZe
zBS(%P7z~1txaTIv!~Qo;e$;Py68t*-VyXwX{K~|M6DJS~h4AXDuVUD+VW_LC!@KXk
zi{;Cgqp`73C>9eYOh8FV3B2BZs3tYQi8Z{9$cH--JIqS>nytqHu%?1)?iFxdbt8P&
z-46HFH}y?}L5V~nxkMq9OEwaT<g73ZLs*eN{`g~T+qMmqQe1oOwFm}-XlQ7F%jJSs
z0}jk)bq+GWFdMluU+kChocYaS1a`du0N73@;M@Q2kI2u@$H<W*F>l^HtX#Pg$BrGt
zf&~jOZ{EC1DvYMSz8(z?4LES%0A6_E1+=!d!t3?IvMgAZ1=BP^2vD3uu<PsIb9SBn
zcKKIv$IrIn^2;wrG#bU7cixF-o_R(n3$3lKsH>~PAOHAA)Ya9YzP=u#MvcPw@#FEu
zFMbgdCQLwKVPU_F^Mc1R5UgE;_U%u1J850<=fnS{1@KRLsDH})N+c4=MUJf6B$4zH
zM~@ywW@aWTD=YEln{Q&ulquM@Z5uK&GI0F(ad^F6XqtvAF27uC6aHXx|8z69420j`
zB>w!`yod4m&wn1lU=Wm2{NyJ;K~+^1Hf-2{ci(*%BS((J!i5WQ^ytyPAIk+sAP_)p
zZ7t@^nS*7^mccL#6ciL-*sx(jnR2;Y7&15?9@|)buCCMg+h^fl|Mg#CnkGh%9*vfk
z7Tj>d4cNPPF90AnHy2Z<PQ{Z?K8YPWcHq>hQ>d)0L~(I3e*NoT<Ca@)!PQq^jhQoN
z;)NGpz}~%kVHif=kNW~6`qy1J`ENI(b;F__Rlc$U&1n1WkMQZwZbIaP&HXq+i9{l~
zIFX8kL~@qY*4ASB^y!#5aU!y_v+>9ykKm(^K0;+>CBF5oZy^u}z%)(FpFbaC$BxAn
zR}F{a&j-K+nPBajJ|9zPPc_U|7BWLTet1St!HX}x2vt>a;J^WtmX_j{TW$dWY}l{?
z@4Ul0D&KI!4VXD|ChF_!`+Q92o1;gM;(Oow9!8EFiNE~iFPJf728ItGj%%*D24lvI
zf#2^(OG^ue4jl@Y%Y~Rh;q$lvoZIWPY}qnIqfs<AHX<u43rm+S#gr*i@a(hCc2Ej5
zO~cr+WAX6A52LE83P+9{!8`A~gS+p(8x0K&C@(L^;K742Wy%yRS+WFMwroLbYipl>
zkMl`j*9&NR=`I+j8pLagKOdQ2n2r4T8!_aG_i@FuCvnBICo$wlA0U7JMr3|rwzvlY
zz&O=_=GA3rdvn?O_zDt<L^5EJp-mD=FE9)PTefULMMVW#TU)Vc(IVV;-+dwk<>0}C
zm_B_vZoc_uY}l{?U;EnE(AwIHtgI|hO7VZcHU@3K{Sg2bw>{)XAAorJD4EwXaPr@7
z6oOS&>0)Hx&W=@HUXF%_2An!|3g7<rxAEQYeiy4(uf{$1+yj7x&a7Fp2FsT($A}Rl
zuxQaD+;!JoeKW4}L|t7SmM>q9y1F{dojVr~Jn#St3k%WI)PyZtwqWhrwHPvF2=?sR
z1H&*t2*EYiT!TOU@sGH9^p&WZcmlw=y-u&c{yKj6!ykfDirKSg<G%au!>n1e008UO
zt;4Wk!@7N#NF;*#`g+vX*5ciF-$iY0EeZ<@ML5(zPU3Feun56FtP+2#*+byJ^}EQN
zFt5u{C8|ddtX+e^&i|9(#mE>}hP-dA?YA*YBofKRgj6IXk{%F=M6hPf8mwHo5`~3@
zDFy9=2M=QM<jMH<x4(_$%a<c7D+}+x|30p~@=ARB+uw#|S$OKFOY!N?ZW2PI_j7k3
zfA0D|N&Ia2_qhn|sRqCVtIM8vABryr0IN_mdh}@g^FRMHva_=>ckWzFpFSOn7A?XL
ze((da55q7}U0sdk%a<b%2#7q2fs)v37zSQ{{q=<LI~6@3uI$})*IhVq;smOysxW-`
za10$f6q6=R!s^wlG5qRbsQyyRIloQ-Fn#)T3?Dum|M4IHffXxOpscJ6&p!JsDk>`Q
z{PWMFtgNip$3A%Qph)7bt*yneW5+OQ(j-wGYW(=|7yPvj?0NxbezREo?YVX`^6#(i
zv7$$#0i1qiHX;YMir2EHJ%;SBJl<zxl}IF#ixnB#B$0H3#>Phc_{TrS)mLAQ-~ayi
zc=gp+QBzaXL5ZlXt;NKN6R~2&3WP!-ghC-~+O!FEb#)jsW(;Dn81nP;L0n$s+!YU_
zh<vaaXI_6Cu+A=?{mgF`3*i(1vhR8-K{zcaD8SOCOVQrmj=g*L;=q9esHv&JFMs(<
zl$V!_&>2nBaNm9R;r;jD$LiIqv3>h?TzTb{Sh8e^=#6n9(%RaJ=bn2GBS((J+O=!3
zbm>y;-@m_u5>#7Ti^-EGW5I$2m^*hae)X$gVa}X67&&qz{`}`ZWBBmlENPi2=jA#9
z!1K>PkAMI7f5%HNy@c}ea@5w=;?YMR#f}|2ux!~f%$zy1*I`PdMvcPk*|SkuS&9Ao
z_v6TsBbYybK7zp@mMvR`%P+qi<Hn7{!i5X5apOiDJ9g}>zHeU>{p&7v9c+A`pMio0
zU+<N-h<N<SzrPxp|NMY>t$piLGG{^}kx06MR3s#lPB?Vv5X#HTF?#f9G&eV+rltm)
zHf_TA@#8yucIVEWm@#7pDl02-&pr2G%a$#8>ZzwNcI;UE`q#h4SHJpIG&MD$pr8N%
zvu<ZidrWK}*!2RM*WL#j4fK4VmVuUkpDU{W0Dyn;!^jxd(Q5s`0}tTik3YtDzVjU{
zS+WGJt*xl3slkB*2XMz7cOVc*JpQCfldyU7X4KTw2#?17_ur2L2M+Xnoc+Y1Lx-?%
z;X;xBuzB-lY~8vQQ>RYt@Y#(UH)8tq=~%sbHSW9bKFpXg13&%gPw`*>^<S7aZ5m2S
zN^tu0X$&1Y6u|krPDMpUc>M9l@rz&l0_)bT!yR|rfrAGRV(i$l*t2I33JMBv-F4St
z_wL<2A4d|YlDJo|UM-TiCr+FwlDMCH?z!`u#BCX9eQkkI<~-L<#-MMkIXf?rq9OP0
z3V1(vhj^)V!=nC4u$M?Al8Xo#+9Z*rpsubC6%`ezt*ymF4?Tp3AAVRU0IArxaU<@(
z|9))VycrWFOu+ZP_dOgqZ~$AkvT%v@>(^t#gb8@$kw>s}=~9%Gl!$GeAua%*4K7Aj
z>Gzp%*_Ci)83^sEM*H@s6Ov7RW2a-#oLACrzjNnKJo3mRc=p+6@$kbB<DGZjK|w(Q
z=FFKR8nYD@6{Xy^si_Gsyzl~Ee)(mTl$2n>f(5ws)>}ItXFpL}TZ`q(m!rPEJ|X`h
z9Y6p1&#`jlN^IS_6=TPa#hf{F5Q#)kP*4EB-;cZRzFX|Ksi_I?zWXkA?AQU|{9Gr)
zFmTH)w_wqtMQCbjLPbRd_UzdszT>uS+i?H=_oJ+=3_ttX&-%3|NMmCoYHMpn=~=GS
zIQv@kMG4{R>T3A?e%yZh?J3_6{$UkbH!K3s_jxNc8o;L&Ux??e$Pg!qL?Y=FsYpm9
z4tQLBV`F2t^8!|_T7_lHmSNMTO(-cT!OopKF>~fj?BBn?gHRiZL{jdr?agIq-}+R-
zYijOL_->dE-}V0jHE$@CtRVncCuFnb6NLBu7sBsv5><aV{>cxsaGWlL+dJ;K17H5~
zm(kkVinrc+3p;k~fTn3!vSbO?tXYH2n>QyYJjp~N5v*Uo9xGR_gr;dC523#s+!=;}
zjT<*&`SRt6L?S8kA5v}e$Rm$n_wL=;v112{ii)sm)hfLB;)__jb}jC{`)+*r;fL`1
z69v-N*46~!_<UTa`uciIpFSP?_wUEDWy`R0=T6kr)QGV*H8tV>`|romqet=TtFL0r
zm@!?S#6F<ElDH2ZJcub%reMX26`}}$lg7t~i{$8>|6Kw9<cH7tyEqBGyB;m;=K}x~
zUk(bF9hN;NBoc`v4N{SiT=GOB5xnxsD_FjKISL92uz2xe+<yD*-4ckOd+s?@R8(Ns
zu3Z>4Y80B9nsCDnH=wezGOa~5?KnQz%<AAL37p+U%^rg6yPirJCX<RohYn%l#EICy
ze?R8TnS)WIM&X%fo&f;7^2#e%xNsrXty|Zvs!dzAY{ANvD{<h!0W4Us01rIyK%Y0b
zYi(`Cs#UA7a^*^l9Xl2a7A!~^x|B>H5WvitGZBeIuxZmK`2Bv=*Vkjplqq=Uop<oa
zBah&l-~1--yYIekjpJNjCjeNua3La*2r4TpF=NII1OfqU-n=<sj;>m@3QLwO!P2Em
z@$kcaD_nP%Lx&Ct#iFjR4o8n3?Nt(YV`C#GPo9kV^XKC`-}#PsJ=X9xPCYjT04woY
z_|uR2UdXo$G%o#&xV{AsZ-M99$$fhai9{l~NRWzz<dVf1qBDN{cq~}30Fx$7>h|^v
z7cRuMZQHPG*Dm3Cm_B_vii(Qx{PWNEYD`p*pnb=31b4p(D}1I~+YpZ*{z(tP|K$Z8
z5_Y@dhd=xwT3cK3v!DG8<Hn7{lTSV=ssZiZy&E%T%;=F|x_9qhtX#PgufP5}X3w6D
zhaP$eBSwtq(U_7sbm$OPu3U-r>(}F+d+x!41q-@ub#H8J#I$MCFm~)%tX{nunx+Y5
zZ^eog0D$Gomy13c-Q`?gr$8Wp(W6IW!-fqgDJj9^$&)c^)F`Z8y*lA@hYlUWtXZ>=
zo12T(t5>HDPdiuePTag3cYS?5MvNGN2@@s=uLU3Dv17+z7=|cq+t}EMDO0B4?z`{C
zkAM7Q06^Q8pQ3$x1%Pwc6}~@@BauiX10AVING>^&1=B@~7WF6u!!QgiT(}T*b#>Uh
zd9zR=c&N;tJ$uf&bSBj!h#h_h;rBK|KmI>3+fKr2XW<-5))1)KL*TmNGw^<PDm<g7
z^x7)h+S-ciuDcGKH?s;g)22<sjvYIMpnmY+LELf29hf?GDpssm(e1FM#>PghT)7f!
z)~vy#Nt3W>(V~<I>YcHB_in6Qxe|4Cb$IBZhcIv6yiW5UlHnmTbLY+#f~a8_La})A
z$tM$p^WJc-t`oq*?v^ZBg7@ElAAvvsx7>0IzW(*E<B2DpNcfy#82HIgeu6b?*5LW)
zpHCScbUxX;cW**C6ab7LKOTWV0B^nZ7OuGB3fytW9Vjg=#n`c9F@5@Ul$4ZU#flYZ
z`oB{V{aXzHAb<Wwc*jiZmoYj$AMUGe#NhAM^viK15{YD>BNYirmmE9Uf*o}Sap)hX
z@M%jsnp=Yafc)G{49dyGs9{4e;f7+2yy~*^Jkri_CQv`{zyo;bp@(`Tm;y{ln>lkP
z8XFt2b?a6Ur+)C@K}?)D5j%G5z}T^4`(yb1#+o&2@T*__3cGgg!us{=v258g?AfzN
ze7DBNM$DKo1G%}msH&>!kVnuNkw`=+SltO5i$o%*uCB()l`8=N3l=OuSy@?+6*FEz
z>-p!OPY79BvSbNrYiqG%#}54b=RZe7Lj%^WTi2s~pHFy`!yo+M2RM54C~mps7CiIJ
zGbzKe>gwt+bLLFkdh4xNv0_D!uG_h!v9S?#b#-{_t+(*bJMZA&!Gp-n%|$F0LrY5w
zCQO)s6DLk!`0(MVEcpj;>TdvmAy2#yZOAqKGA6V26ErSi`&P4upm5pYemRarB9RPq
zq#_|n%NsQZ@amR#@%Iy_yY=~^A$gef)tm6uiDRIu7fxkio<M!<*f9~m-y4rXAP~Te
z88hJb`>}4_Iw6=DhJkV8#^Iaa{ANNt_dsIYxN%stXc5ZF%J9e|kKov`W7xE5lXyQ8
ziD1s0IXHOmAhvGZ+A9TY%a$!7k^P~E9!j_lO-)Tg;W*n$P&~h5)22-cp=w*UY{C8a
z-;ej-e_vEXa#lbZ2pl_h3^&|x1NQ9MgJHvliCmB5@5%`T0wT%0s;a8TUZL{=PvWkt
ztHYKpTSUk4SS$v&O7N9p1uxv@!4=P*?7J@GDfr}(O!52B=Y#!r9En6C8OTUQLehZ`
zk2K<$S9ajTBfV=pHoT|+i)P)58%JN+$0O@LyrNJ=MFsqRKNc@ujC=06r`HvQ0)YUg
zO`C?Iq9VNd>Z=L+NiOv|5UH)L#jIJg@ZpCaLen%%o;(?)rKKIhW_U#>UOu%q)Ya8t
z`SRu1y?ZyNPoIuxG>YH;_O~c2E5m{X3wl-Qhx6kf{}{jg<u9>y>(+$*96EFex7>0I
zHf`F32@@t@)~s3h>}Nll(9L_G@Z59HVf*&&V!mzJvIVnd%|cC0P1@X%jT<+jyu2I_
zJn#UPE?wI1m9=_GBoe`_S+mgC*ob4tj-k1^8SU-uaJgJCO%s$-@TKaiY=XDH;ggDl
zL?V$~07ykblE51^2k^81w;iTwiPwByH~!a+BXINQu13*ixya9D3v6?15GR`2@b=yY
z)a^fl*7mU2MpYFon)PK&|I)b)^J#5u#S1UIAS~O97A@*g0(B~Q1sR?v;AHpi-IzIZ
zCf<Ml{Q+g!PQ|QQvvBRT*W!sMo<L(`BgTyzhjr`Lb?^*ui+@#BRkx}prDEH*ZFuIH
zXYlU3?}Ac_JMX*`ix)5MwQ^z@hVYm;^Hu<+1U($za{vG!07*naR8E{YQFx4MYiluQ
z&K#jM4K$p+C3s@|nl)=g{zSTYc<k6Q%$YL>fj|JSzWVA}C&Bk6M~@!Gs#UA--h1!i
z&wu_i6h(ny7-(y20{~c7{CPB?NJaHs9t`=>2hau=_se+9wv%Xld^i9Z+9Z)kB%MMf
z5}TJd*3j{@o)$lo?|+W2{!J~7#`G??jmC8P%guH4*7++F_OW99@6W-=DgE2u{zkv^
zo$pY;-%n@Ho=x}f-`{8Z9W`ncUAlB>hxb}qT4+&G5#79bbDtdReDm?gAJc+@0{ZdC
zA5%&xt*NP@g@uLm$dMx*KD%qzE?Q7fKr1UNyS@K#I80ZsUQNf08AHd89ZT1(TSvp;
zFl}jRq0c<?3@s`uqPO09E8V(vYmdg=-ri0pO`1e+zx{UF-rnBf{n@i;)3UNMN-3qf
zuG5l|k{%!9LSxUKJ+!E(h_<w}h}WKY;t4ut%$Sttz{!dgD|&qG`kEt0j?i`M*3sFs
zXVYQBhS5=@M$xHLr_#$VyNqg@Mm0^NH{5Uo9W-bVC4|uI>};wi3U#T3{>w;}9(y>0
zhWEeOZ{v#|`XfE|a0Wg0a0Wg3^YQ(59En6C8R$rlgaiPv?d|`;PgcDl{vKXbfEAD4
zgUbeG^=LoMXM*^_%GYt=&~fqFqFG<YJyUM%v#~m<udhc%MFn>6-i_J+pS|~wYqH+|
z{~rPh=#;5Tr_G#-$5~LAX!AG{3RAzq5j*&H79<uXC?p6fB!(U|G%)0#2Ms#l!GZ!q
z9R-F71%@6dG$=4II6;Adfo{6#2G7qQe0Rmz2IGfWdEIX}Za25<^=sF))$93s{&@KK
zAS5JY$UFnp)zxrualy82+YIJDtX#Pgd_I4`rC$5u&Xq5qsyc%^-+zHl<#lx4>MAp8
zHqr)W);1Xa(BrVScf*Kj^ZQm-Hj&-CcjNNq%ScO01JD&l^X|LvqNu1yFRw&f(aFQZ
zqgPes=H_M`K76=OC2WmGgN%#}?BBm18jXfIaqlgkrM|u%%a$!;5{i4SL7R6`Qc?mA
zhlAwgWE?+!{0|+5rlq^KgcfahP;PE+uilo67cXM%+O-f0g-A+D>Q%LUD5$TmM`2+h
zKKtx56c!c&0Gyqjv1rjExVpMRAQ0fa_ugZ?TqjPPKtVwPMvfebnKNhNfB*X*hzOl`
zZsD0J8oc%N2)6ty3kwU&?*P`2U_s3fKV$vwbSPDK0058Ao`Trm=U{C$VnE|5Rd=vE
zDGz5$F9YZbb2_|zHSBCB580YeoH&8__;}RT)*>V%1U^1KLn?q)TwIKmD_0^eE{+Kw
z=}vNTGUDUohosc24xJj@EKY{}^qY)&Z(o>k#)I?JCUBfL4qBW`rBY$`?Abbrx!&I1
zu&}T&Slvil(TT_7AuTOUr!r7wWhLU{<B^q>)$ja=o~2&{0s{1&Z&_Ix+}+&~5)y*Y
z&``ZGx{J<<L?WitZGL|Kpz<(!(%s<exN#L7?OjH+`Iw0?=T5#W1|OiSEuno@8jS{v
z7cYiTDD1Nul}e>Tcz8H6GBS{ql+<ql#op-6aBy~ZX0#%D^6tCu;-!~f!tmk4F?sT2
zOr1IvSFT(^Lqh{LZ{Cdjk50nD{0gF;9Pyh8(v4r20jo#dhjtDY78aI239KQ(f{oD`
z_^PS_05EmZIHc_I9<ULiMX9=jjnVHj3EMLtnt=c8UNfjMwF%Vw_wR?5l@&H^+5|5z
zuOW|f*XBJKtHG~L+#TvtueUE3p#A+#(6n3`P=AXDX28Z{&!9IwTCYH9X(<3OngyFS
zZGx|_uU>nFLV>kw*P_0@9x|B>Wo2cI%C)vS(?CzWtE;OKA0Lm5j0|{rd12G0O|Z4K
zWhyWkdq&+w=d{<iY}o<;jC%K=xW@*cmhRdT+TVfpd36_Z>y0yK&S34@weaxpKuk=`
zfDGg2=4KQY7UJ~j)BQ3Wx>H?UjTc{h5u-+p!mV4kFlo{xT)1!nwzjrtY;45KFTael
zpMHwRHD4jvK?4A=d2Sy#E<>y0ee1$8v>jUypi4w>QuP0Z-dJH_VPW}`z#0<wIp;23
zLFii_0suw~x4^q^_&_jm?2wFo?fOkfx4i?!t=j;ANWW*X^sf*1dz|hG)OL1u2nh)p
zaFTCdWMySx-MV#<$z+g7Bzo7iiLNia@WPOmdQ}u0#Pt)~fldwco*8F6tRHoUmAxA*
z9+&}hZkI==<Hl8Ju6_qqMGll-%h0K~rZd*)Wv^k(|F?Zm>v3^$!J0K|;N#;1;8)`*
zH#gUyc$-S4f`^9(KK=Al*xK4+`}Xbd^z<AuZ%ua<@(B|rpsA?|AAb0u(PyL;ozof(
zT5-CHii$ydu6{2DpO)_05?Y#@n=xn397IP)GtaO$T3cJ;@9&Sw%1WfCr}t?fYYhjj
z$DzHwUB__fugB-$!GqYdXAdGHBVlJ}hm4F2y#N0Dh>niN#*G_s;=~EO{r20iwzh`Q
z;u<#EbP3s+kC}*xuYWys)tfpsxVrms=Gl&3vJGS0ULTsVSy)(D{)DiG#C^_7k!g(A
zVAYbj2zueEAss(C`yAfM{sKUkw<BZU%O>}&udhdZd^}Q9Q{m?3hLDhuyDIjUoSckZ
zyLKTvJKLzzad>z*E?&Giq%rpGnIX9O`C;a@`Iw2|xNgQMiEp1Lp`=#fW^pnUXWr5|
z86P=Mim@-gGvGB{ym%4r?(V3ns$#;Ga&mIu@9&TD@^Z$*(A?aNLx&FG@ZrOdNF=be
zwMBArGBPtW2do3p8^OWB$jHdR=+UELV`GDD+qS{O!$Zd_)m?N>`~I?J%kcNV|J|TR
zr9b@M3_d_#TS7}^WhI=Poci@Fl9Q9MWy=<9+qMm%p`pzE8*0O$``Z2e{n6Um%2bl7
zudj!blM`ZNW3hARPN-BW)Ya8t%9JTsy?Ql9T8)6e#VKa9Z}q4<#=m@QNW#Y2{_`?!
zm1Y3w`W;S)D2JJ~&7j9+VPRqU({hiJyjgw+T)lRKsjjrpCze{<6+=FU{HBUr)*WEx
zxzf<mXP@%&a*|4=#N~1+C@6@jB6K&2i;E*ZpHEd)RYuzs6ciAj&mYqD$j>G))nOU~
zMp8?{v(%~Tz3Pr3I#qINJ^Xi_v95o#dr)ih_4TE&urQtXA|oTo)zy{C%F4*g%Zs>N
zE(HVxP)$t@(<VPZpSWBuB_$;dYX0uX<#O`$^dyNyLM<&_-yxYyMy{@|BoqoME-sGb
zayiLlGUD_3)YR0(^p(kE<ml))=ry!`uvzE+HoZ2D<YyD8^NzC5zMXfJBtM%#O|MPU
z8RM6uFAaKKL|xzCrAwFUy{~;1<>lojk5yM!M|0=SrH3DWm|l3{1rmuw#N~2HDwR@V
zVq&kqk^YdGnMr&;pQ56oNUiRw4A;`qLL!lf;^N{cF)@**O`AqCnT%RmT1X%eP-J8z
zMMg%F^3o}t``CVbD^W+^)#ZAl{rFa$F>n4ieJDOA3kwU&pBmPXxR3ep({g5mAGr7Z
zyEe~`L#LQ|{(a&LqwQoe896&U6Q9qg=;&yj(w29V(9lp4i9|Y^&z@*Yy=G@;581q`
z>a*1N>KJC@axG=e;5I`YYQ4>_^3tgR57*MtLVP}7$4JP^%A#@O#?h!zqk4TtRaI3a
z6bkhWk%7?E)I<`AggiYxNvYJ|w3nBclaG%NjU79dtgWr-<jIrFHMLqzwzjrZR8%ym
zHT<3pKB8aC+NP)LZ+=r!Qu;K2+uGVFJ3E{F{QMZhVfO6VG-}i++P!=5>+3m}mzNib
zL?RsnN2yejL?WS}pde~$YSJk^TvJm+etv!w85v12F)>6$bp4~<I`^^l?NtMMCe)#(
zUyi<{Z<w&Ku&}W72^-pU9~1i4hd6h!D?A|lr6u^A^P_iVp6;b(#g9%yT<EXKu_~2{
zN$v$;QpwMuLZi_jI5-%^#l^_Y&F!^pthO>y_fngKqDL&Y<t!KQHk=rIct)oN*WU4h
z>T4MQz?}PFR}A?8lSN}=WAXXtpW~Tlo<V$kJUAQ<UU}se?Ax~wv9YlR6P>j*H#cL&
ziWLwD1V~9q(W&TUD%I81Sg~RSQ)1Q_3WWk<u^1C3Oh83N1(q&dija^H<mKhzn{U2h
z%GnyDtgOsvINR;Z1!(=32NTX@J$EI>y_h`kXVs}e`|)i$;cP=u8AuzBW+)G2_wL<z
z_uY3<T3QMYhlBR^cAZeA`ucjEP$g{$;ra9D;qC1WM@L5_CMFI#zof9RkV)*0j*e!2
z=NgR$t5>fE0Ayxn8dV-wC={@=vSLE6x`!eGUHK=Ymu$tzdD6b0Pp1aAN;4oo{iaU7
zi?zcFj9Z&Jq!qSUSXfy8wA^b;hUMO|_VxcTo`P?`H+~vFSbl10XXfz??Fx5kYipzE
z=xE~e`Q+^EJftW6rl3}<nNXR&1iX@xl1L;H_1UgJC_YQn36UAlNvaV#RdQ<HWk2W>
z?}mm3+PZZsnVXx_!i5W|prC-cR$g9CJRYylFc)n|l2|P6)#GCbtstH$!f8G}KIG}?
zNkm;I+X)E?G;P{6vb40Ml$4Y{`wN9agQxk_q1L&VEeX#KI)p|$ZtL5te*F$a%rq%P
zsxLxAL&?w2Pw)M<wl-S4crghC0($JR$B4t>(9)$#DK0Lq&#))CTu#2ez9bL`biM=q
zL8(+yXlN)21Om#>&)2&i6cj`fiG-9&CFSSmlSm|D!kzk}r)NTYKiiLQrQ5aVNOQfJ
zX{)*3Ot)*#QTy?&)D$sOuisFFNU^Z6u-s3u9*O&y<w1w>^DlA$z{vxC{T81yl{;z;
z7QGw?02roL;0gW>q^73A)zuZ-wrw+d5`4E%C=^(^awV*+tn{=GdQw|ki+S_rp`f6^
z<V5e}<Yahwc=THGw0Zk<COP_Um#{RmwgG?7_a=KK%F4>HfB$~u<mAA|$A>AS+P%am
z0Hmg-V&A@f%qe$ogolSCD=P~!narfb+^noD`1|`KB_*X#eS^b?4>Ot`-Pf^Z%^GMl
z8vO9X4`^*|MMy{pyu7>&db`e_KM!|zcfEw=o1Y&>du9lLp|21`w-xw#-(P>N5HtkI
z*9wIK_V)HjN=kx4p<p}?wY9ZaxNsrr>gq6k`gF)-vVNCMK5^m%)~#CyA0MAy1qgd`
z@!~~zdwavq&d#7$<G_IfICA6&ii(QB;c#GYZ;zCe6oVDHjG_8khW5-5M*E?^n2(u=
zF&=Mpc`{g7SXfw0#_V1%faTtyH6j4qH6sG(Dk}>BW$#C#BqIv%z4snw&6))(D=Qp1
zas)ef?nG>CEK*ZbapJ@Y6c!euy1E+m_4Px(7KK8AWy_X<!{Hz^GqcwXur}Oc`}Xbq
zsup$m@@3fD+ao6@$KdrlSH5732s6%jjFJqll8_-r&XdBN`yc?IQ+XYCzAx#uy+)(K
zi4!N_<m3c*cXvGY*kfpDXh1?j0$zIQB?trp96o$lr;m@151gHyv3Bj+KGzc+9gS_<
zw!z8CiP0G_#@@Yq5f~VV{QUerjfk?cGK7bR>pjc!=g;GdFTTJ#@4SPeq9UZFrQ!7H
z)0jDPCU)-JiPqLuq^71KFE0-OAQp?UY11ZndwWBp`L!aG{Pdg5zd5d(hpx;hx-<$#
zFWJhxzFBw(q*e`REQLaWyu3W@*s%j<W@cEjWC;!*K8%SICn7O15p8X4$ji&amtTH~
z=H_PX+O@0Sb9i`opuD^sm6es4H*X#)D=T|#uhD1_8ykzoix(p@G7{<O>3T*)R#q1F
z@86Hy++6T@JnY@O7ZQo2Uq%GbRk>;6>tAE^ve)`mWvS~KY{P_za@L4oVPRnz0IWyi
zKBl`zA}3)3#@md#EAwbQ5;dP6!?hnOFnQ7>`1|`qEEc1&u@MS|0<EpBxOVLt6bc0z
z8ylfgshDdDg#vs&A6zaMTrL+p9uFK22LgcrmX?+f2n678IN<Sk%r!oruXpm?+}sQo
z7Z)sDx)gD7aeb~kJUkp_Wo5|E&+qqVE-WmBx3@Rk+}sco6Qi@qy^-?|$WQMB0F3&p
z54fuj^?Q6%xc=cbC<+etI*&r3Kyq?24jnoKE|-f<n>IlzmFk@~Yjq@QYHD;ggBpzn
zPEJl(zI?e}Ji8&zoH@fNhWFGr&}cLW3=BkJVIlJK^C1ujdL2tEIu{cYqo+Q;V8H^W
zG;DXYC51CGGBAJsd{kCe;xB*s3lb6%AQTGW;^KlOOO_xaA_8}=e1Vn&ivi#_Q&Hvx
z<iK*4OP}2o3I&Rbiy4nYWo0EC9UbxX(@(?I)fKU^v2bv3Ktx1@Uf<^CX3U#650R0P
z11^Vq@Zdr0*s%kVk&y=VRO;*N;qC1WD=RCcq@);pmc_-zSg~RSqfJs<TMHK#7oGCL
z1A){k-1)u)%CEAZZu}Y@?LRVxyZM-jFdH)wBOZDjR*x)&<?O|**c=NB3(Fv24T<}h
z?iv#R*}VocADVDi=4ooZj^{SN4Wdp|=In=AhYAlq_#pUvJ`xfVU}tC7=NPT6tp<&Z
z-VBh|)>a6GLReW@!N$f0-+ucorca-aWy_W^28flFl|e&9t8QIdTH5D^))?*W?FbGI
zMqyzg($dnHQ`XjhF2(JdA^^bn^;xj8TQ;Ea`=a|sc!Y319tbI5u4y;a$BrF?L?S^*
zNJyWjz+1L#fl8%9LPCPh`;Co_Sg>FLQc_Y((ksx4!}<95ASx;fK-b22_3G77sZ_|$
z&h9f*N-H{NXJ@Bp6dpTv3`dV1?bQHmZ*NC(ax&uM<H6-}@zYN~;gwfjfw#9e7A;x?
znM{U<TR-_-8GMEe2W@h+SS;2toEsY(F>l^H6crW0*49>Uyz1&|I5{~XEiG-p;*OP-
zmGJiV2A|JIQc@E0J4sGXMtFEQA|oRa5MVfDue!P#E-o%eN=jn9PKy^W#;R4T2CenM
z!otGB^4q~068AB`Rn?}mrI)ci;S>O1s!a#-()MD)gb7%`em!DiW8vZ9fvBjcL7hSx
zqqVgamo8nx|NY<pVb!Wtm_L8MNd}0yxjDv<ACHG0ei&9(R*Xl)#>R&6b_j(+SXfx-
z7$Szq$;m-rU?4m_JrNZZg&XlMP&a-J0GRMvDTYt#zuLDcbo}x^G)H!gZ9Z-)_`ANv
z`Sa(ofB$}*IdcX+K0esEaihVFrXkwf+hK2SkKEi`J>&1pnKSVA_BPq@YHn_ZySqDV
zZEX<~69ad5cQ`mWASo%yq}cl%J9eP3un+|W1v>2&3I%4*o^5cAhR|p<$jZvXo;`ce
z+}w;|!-nDSfB!r3^72r)!4?)jbcrec)&^gH4F^LUJa`Z%Po6YtP!$&!!`<DzU->^h
z(P%UX4-ZFbYAW7*^G$sC;fH8$Zbn*Kn$cXC=H_NBSg-)ww{K^RhK!6196EFeMMXse
zS_caY3k%D=fi)!VW3uwU!v3^R0RRgfW*~O+b9ZH)U57tH-WT5j0ABgK1m6~ah~na6
zw70h-FE0-V4<1BnYAPZlBjM-g*Y70I-Y70E#>$l|5fc*wFE1~X`m9{J5*!W(k&%)8
z_JEk1n`6X?5wNkb!RXPWF=fgW@OV5-m@ol{4<Ck|ogHH5Ux#Q!SEvPl*S9bqH+9H9
zZ+A$o!cUvWL(>VI{+}6AuGyinu@Rd#ZGx|_?|@2qCMPH3{rBHDxH*lDjm7)#zmJlV
z5|f^xLZQI&<;!vI+&R4Z>Z^G3%{Tk(19TZ?>(;G9d3m{B$=>kra3~ZCJ+Dbmf`fxm
zTU!fTTU$(>Iu$~pkWp8@aNz<vIy&GyV<b`+cjZe=j3|f2#J`xdzW$;$_%2`T#EBn9
zp|oQrE?&F{2L}f@J3C{^k|ib?4n5I^oo(E>(dc(SBO?RB!NDjgDbYzX?=R8O(b%zL
z2OfR&QJg({*64Rjp-?d4g<5Y^Zw4w03kwU&?;F;TxR23>906Sk(H|vj0B5A-kj|mF
zbsK*RIt-=i4uGx@s!8KU!rtB<ixw@yl`B_}o12T~=4J#22BN;c9tjBvCWXlKMPXqf
zR<2x$#Kgp2^$xmo?AS5v*|W!_N<=-;Xf!A<FUPmvev6A2FXD$Ee!!J0SJ2$tjFy%b
z000qzKiUGPR}RNG>)*zZm~}*nn`-uFJ`iS%HN$5wSYdMP)geu^?vD03Elg9QO*IV9
zKDP=hSFVJMi_4&O8!leFh-J%`p{lCN=vaIA?#0ogM^REz((m~c3I!9smzbD{BS(&)
ztgH;_>FE%Q#X4;@8Vy#gSOFf7hm@2Q=6!#Ee{i|nUUfoPSXfwCexI;ao9<&K@obp9
zh&yTxGESEb`5YOi%NQd<FmWtqJ~ROw4hIPd3Ak|K0vsG1;O_1Yp-_n2++4)P#UU^-
z5bo~osI9FX@Vr@BSy-`R1+ufVO*SIx>+2C17>M-r^Z|*dSy)(L-n@BOvt|vVqoWZX
z9**aqe;(t<j|TvBc6Ne@pzZ+1S$Fm6ynVCZ^O#Dfyvyt1WoLn5!+_DFN5j$45h*Dt
zP%4$6E@k_E|7qjy4UHj}%VB3{hm@3*UdKpDNdb??LqS0ShzN;^iQx13C@Ly4+D9&z
z!@<D;F)=X)ue-UqAu%!0q|e~x<pmy(2MY@eOqntT_V)I8?6Jo%Y0@MN8#au&hgQF#
zCfO#(5m2f-QCwV%!-o%J=FFL}x3`DCzduq_Q&C-A-S06S930@~<%KO<wis;_78V9q
zS68^ZyX#b}>WkvyV%Xc;!^+AE<>lpYb#+B%W+tMdqOfe)GVIu~LuWjHe}AY{DkLQ(
zG4Gu}e;#MfoWb_(gDZQ>!otGBa*r4qISQ6PDxZ~o$B4zbu8*hIcEym5-FD*^xvr0A
z#?Se@Lg%`trzb^5Mv_!2B~MRJMu1AKR#Qw&4Don83JVLPwzjr@&6|{zL;`_;N=iyh
z?xR+#Nh}sqOiWC_=IV}8sU%-tUvhA8APWl%8Z%}L4I4I$h7TW3ix)4Zkt0Xauwlb!
z^E1;K0W4+3#{-_PFK*YKW9E6`iAiK*V?*=j&nFib7vk}F6dD>zb#-+E8e1xrQgn2*
z!E04jRm9`*sI;`y;Pr@z2oef~dSZ6Dxw*vUaw#n>&0xRoqH{gT&(9|Z2M3cy%(Any
zY4PI4#N+YE#>R#buLD3978V4608qf(;nWx~lGH!fnl$b}&|Ir$o>PLyWSTf}B8?k2
zj$&eBsIsz>Qc_aL&(DwS?Cglg<B^Al2SrCmQ&CY7DV2ST*vaK`5(<S>R8(ZNjascH
z4-XHLN~L{{r&g;eEG&!!0s+ZnGJ|dE>gq@$k&sv{rka`>ii(ONJ3BiaQAf2}O^%L^
zcSVfycI`R3F55*d@k^*V%7K0inLs~=OrYjn_S6!;gxa&i>2~coR(y_yg@t91upWu~
zoG0hbWV{lJTeq?0tq&Ow!eHp==*0GeC!x4?8$g#gV(DLXlZq1(5^(6yA*Mv-x^?RS
zbe-&nhK8c5stT>Gt+2PZM{;tqN%I~!Z~!}Y>_C2gzFufWZ|vH&3mgsyp`oEB_c4S}
zC`3m`2Rb@BFmmKby!F;wsH&<$MMVXyt*tR-$`q_v@+8w<Rbg0bVkl5vI?4R|K)`Z5
z{P4q2C=_UGYeQycCR8dF=FFJ`cXxNAnis~1j*dord_0<)oAs`VL?R?5C1K^tm1u2k
zW!~3lH1PKJMqXYXN=i!fl5v+VU5cWjB7}#BW9QDDI@b;#K8*9{&+CN5bRRb`Fc5KZ
zaVF>22m}JGSg`_&7A?Z9TenbGSBKG~N5k9O8)jx^u&}UzjkN{-GOo)zp}G2<N#hQL
zj<#P#)K*FUf}o%vOr1Ivr%s)Mudgq}VlfgE6H!r7fts2ctY5z#H*em=u3ft@Y0@Mt
zSg-)W!NJJN$};#ov>w29>(&|dI9OO%AT2Eo_4V}#4-YrGR;`9aZEY>e%gc@Gd<ca?
z6ciL-`SRs>?6Jr2)?05OKR;i`(|7RTK?no_y%N0xrc;BPpC3l^_UULjuo&{w`*6Fa
z2%4+kfo>~6w-wN|T*2*{A}BtMN6Uf5Xxcs<^8Eb+*6(0pVPU!Nx!0Bq%e|+f=0{rS
z6U%rGUi;@sx~055;PEt?4tnjMCz<gU`oz+IE9(umO-xKAi9|w5rII8P2?YfO>9r{@
zFDHpaLXM7(y`HLug@utwB%+3fhJLNLsHlkee15<CX;G`yB$LU=&CQK$Y;4Hh-kwgM
zKFzFs{P^)SYSbvo&dw%VTU#AZ!B1gRsPj(Wr^@}NLrqN)Gk^7bTslQfO-&>a2<U|u
zULZc7PbDQKB$vx6F)@+s?Ci+a)|O&oVode`MMg%FkB^Vh>tSJG<m&25YPFi$+S<t3
z*_k{%JakT_4bcDqfd7Bg)I^Ssj^yLxLu$2}N=r+L%jHr<MTNokadB}bouq5Y&CMk@
zH#ZtSd^nkznbE|F6Y12cQxqB+O5?|mrx7DY&{I!6MKdRlqYwXXMU4R?sqMWDCXe4=
z+K+E#o|AT-pr9afb91Bk_;}*+coY*8W6;~8R;#JJyqppe5=bhQl29llp-@Otsgx2D
z5~#eqoayK3=}A#hQN6CEsi}!<ZEYzrF;VYYOiT>%`Fu)ANiq4e<>%+q=+UET`t<4K
z=H^B%EiFVu)X>mC0)b$_zqy{Ms?SpME_>!a_V=%Ompv&jof?w0u&}VO+)uEE1Pc)n
zefViPv+);uze&EkjtwZxNq$pB8{SCQ8SCFCzUZ}&SS+Tbq$HBd<s^|vjE2mlr>8TU
zr0yFKwOUO<K|$o;;6P1HP5oMLTU$y#di4MRAOJ~3K~x(Fg~9=aS2Q#<P-J8z2?PR?
zNF<b=o~{#WlAD`L<HwJu2OfBU($mu^A|iq!A|i-7)bvx>6lN16Kbz3+x%=Yg`7~zy
zA44WE#!5j!0SN>GijR-i3nMBjDk7;=N*oS{e0_b5h9+rIDwQM<2#mH<tJUP{>Pi6t
z0VEQMC?Fuf<j^CzTuvSy9<*@bLYh2zGNq@d8*JCo(n5Sbzt0e@wzf8ki;E+XNJI_}
z4wRUfNZYq>r_|I`lFQ}f>FG)K_V#3HX-TiV@(S^IJeo9-N98YB|K<iCQP;im^z<Yj
zA0KLHXdpK?Hxi4*df{M(XliPr%*;#*3JM~zSWH|lmt0+4>D5<XrLkkj(wAR;*=zr*
zsw(31`ApbSLqh{OJ3EuJvva>f;VLRBh|A?tQBe`e<#O`#^JB)9N~MDeBkYd+YyvgD
zI!4DZ_$h1(wY|52locP7y7@A7s^rwEl9T%9T2fYgOl|LN(D@B&|E_<udq~#A!otFG
zzrY$2EDUkSKGiV*T-V1_<|kj0M$^$}UyY`NP8M9EX9EuDj1l#A-#Gvk6&1we@u;b(
ziJF?4NF)+bTwI*Nwo0XvqN1XR%jHsJWF)f*lt?6fo^%^RDwUF-pP$L?yL%saJRSuE
z1Q<LiPfAK6KA%rdJn;nMWwEujrSkG}A|kr+Ni4H@X?krMb*lQmcB6Etbxvom%XaBp
zj){pOu~<yS#l^(u^C>JWOlO1N)YL>#QBfoi2uLgzQ(9V@(OCTS^mG!7#YUHspPx_W
z=H|3!&6<9H45d;@Q>RX)apT5OO-+r#Hom^T6d4(5bc~9M3i9*wBQBRqQmItWqt(>Z
zL=uUF+}+*D#>R#od+agF%F3dro_dO`tgP;t!AC@lmo6eAf{2JxQc{S|=Tl^4q{#-E
zcATQ3B8rZVrbi!rl!gx<PIh*7<m>B8DJdxijT5bx?jQg72l4s*esB648XAbt=j$1O
zGMS9Vj2T1Y$B*xK?vo+fKG>{d2sFJmjpSz&Ofvd9?<h%rHi4R6o2E0yFGpV*^txDB
zSXk~CSVMwEhm5>3oiHb{_nY*$O^NizJ9$)GUQ6{qU87sd+jL8Ln;M#bq2lsdiv7<S
z`rD>Noj#^`BDxb15y6C~Xu~TqGc%30Z)j*BsZ>fMM~);%N5=sf5ou{@Boc{C>f7D>
zAQp=$B_+k^<~l4ajBIUfY2(I?Bo>RA@Dp2GTc%Ct9i`4@zxC}^LzejY%h8u~HdY<C
z+V$FadU{eoKmZd)<mTq4cOTShHDzXIlB=sLllX4vL|P(|7)+4P&dw%2pHF-D?j;_N
zXVPhUcOoJpNFtF?e0)3!1Oh!HKzmPnJ_qf(ot>STjkh6BRaI3Li9{j_3k##UbLSF=
z!=a|8Ci3#~qNu1S5{X3j)ZioP@}!7FA|}*G>z#0LaA1tm{-7-?uy5Z!og{89m&+t^
z7ZemwV`C$U#bO#hd^nvt)xVG*xm->nk;tHDQK?kYlqpka;lhO^5{U-%8JKy_Cg>Od
zEeX#K==pT2<kWij@2qEng@uJ>0I-Gxiyr^2tS8UVBt65x)IZPABq}cNUzHoBQc1S9
zwv?NjOGI6pJb^%9)R@qQK{-1+)7-gpNg|Q-8H&@Ly1F{za=E>3WK8uwbZ;+}N=Ymh
zQ&UqDMMOj}Ay`aUQ}@q&>6FgqrTzHUK^qg@<Lw&*M$*my8V(84ZuZjB(nv0slT<1t
zJ3Bk0p(|BYRTLByL_8jk+}zxl=R`zQT3Sj1fk4L)Nk~Z0+59IZCFxb|=?$4oMtnY>
zF#u#T8S!{LofB?tIGL92o)qmhV<-386Zgc#MEc^3FUZQuiV6!0NvTv4m&>Jh-+h;s
zE?s)h4L<GX>iJtpNl76dkJoSS1W}g(#^>{OJOXWPZIqjvOA!$fG-u8nGBYzHKA%rd
zKKUd)_~3(d>Cz>W##XD<B#}rcARxft^@xZF^7Zv4qOR`<m&>K-=xC##AvZVIVA!Fm
z`m9bk)3uZ}gL^I=YCZ1;n=`?}!ot!wtRcZ-5RImTGC%oJFI1_wzoi=z=&0;G-M%xh
z|DosS=aWz<WHy`HSZzb$D0X&sI*HlZlCQqLzJ2CN^i}G$si}#gqoYmoK4@ucYa@w7
zVl<h!dstI<u79*!XY<nf_NsxMdUvRGHl~bW(hC(86~yQB8RIB2GScAv?v7Haq{PHT
za&U0aNzV55^`(f22vV!n6dD>zB9TZh9Ld+$*QBKAnwlEo@px2FP@wa^b^{z89Zl)!
z=_HXzh={19q=ckWDRH@6^7HfS^OQR?Gn05c9?4`flFQ}f;NZZ7(q(67ldG#MB_t#;
zo8fzD@M$shTWD!%Ax}@w0eL4vLqnMjy%xD#P5}V{Boqp%u&|Ix;+{2Y7Fk(Y(bTC^
zNh+06TwI(^5_fl`QYm?Oco@8<{S4g=n5wEOa&T}Ui9}-1h%GHGC81ELJ6;b@PD{eG
zLu1@^sHyesRlgc{5i{>jUJMHh3(KDf){tQ7lZ%%d=tx!(ZFnP{R&7ltmvsloW!(Yt
z3{9d9Z=_Q~dI4R$++b2JMPK;%_)utQDDzr-a;(*asH>|Zkw~O>x=+-#nGXvK>$S=a
zQP-)ctE;Qt`?<Nf<mu^YlJ}uI+BNl-Oq`#eZ?u0;1E6`AJ>5K?X4>YcLrpi&r|DI!
zxt9EbN&VB((#Y1<mN9<P)6<E|<(gEPr~3x}g%@6+apT6(vSrIiB9SoFdAg%iD#_8&
zvDbKe?Z&=0Bk$2iA0-ZlLlF@X<ml+wuWD1#(b2@`^O=pekB^UzaZ_4aN~NWx6c-mq
zNl8h}`}fk|)1v(?^b8Tp%*<qRT};uHAkx>CC@Co+kw`>7K0XFR+&n!!$<578FNxdP
z*_k3DB1k5aQBY7&uenOj&dvtES6W>P9*;+9X=#+6p01-$;q2_J6FR5(Eb*>|n{}$>
zy5VMQh!YD73rnxCh6Ky+3T+jh?kBAI`S~Oe2<W4aJ|aG!Z!{5GOHEA;xw*ONgi2}Y
zS?X2meGm$TCVL;cQ(9U&pk&mZ^xUXwPej{~Z>8I{=SXv{o;vR+sq>DKG}r3scI`Q8
zKfYC`;?F=&%mV@f$iu@!?=$sG!Zt=zQxm=R+G}KCVL_Ibmh|s`|J&$2tgEXdKA*4W
zZP3!2=$y9yym|A;%*>2<JRW`c;fH;$kEm<2>gVUDQyy4b_SV#Jt9xniY01pYBwJfs
zJ+GVAJ0TK@Ocr94$z(KZ)-2kwV+Zm1{9Y@UX+sIS8~HtxxXsPYNhA^(OyW*UOCx7z
z=U&%SP*6ZZp^%m=SwfR1Pi8{7WHK2!I5;rvx+h29?F9IrwoGEZ5-cn%EWI#{i0EEx
zS+M-Rx%6ElE>zUx(szxx)_xN|w<!Ps<84M^!Z;3QPvgVsaa-8Um<)6C!D}3*rl#V^
zks~N7Dq;l2cJJPeojZ5pt+(F7tFOLl(l}?%oIzk<AcR68;^N}K=kqaV&K$(W#lgzT
z3h%u04hjnkA(cw8e*Jpb+1d4LojEx<Si5#D5)%{Q>FL?;&)E~z*D|zchM=SU$G#gI
zz<kU^jPZB_Bj-u`)lZ|*z{$x8%a<=lSXdYUpt-pj?(Xj3^Z7_mPuCF=>q&KWHQe3Z
z;o;$dci(*%Q>IM8_uqdHUteEr+_(_}fk3DInKNgwcI{e}l$7XPJAC*s;^X5{T3V_%
zUtV4w4jnp#bLY<C&Ye3bEG)#)qepS(%o*h7=0YeG8eN}4p}^|ZtD#b<ke!_k4u^xX
zvN9}Qyx5>HUT@s^cn{>cZ|J;d&V3Npb5_9mvE?uy`yk9lPXqvT%CDlM?MEmtorJPH
zTkpAYTmoR@u?H|SO+-)2fddEd&O7g*q@+aeK4oQPAuuoyUS3{^ii(1jm6g$Ps;jH<
z*T4Q16DCYRad9ztJYKK!wzjsy$;k;DH*Q2gKmhapi4!Lf7#N8B{CrqgSfIGL7#A*F
z!1?p%QD0w=g$ozr^UpuW!Gj0!fB*M?y{@Ufy&eAk{`l;(&oF%Wa0CYjBPb{cbLPxJ
zbaXVHnmGn72NnYW%sAu0|HpS2Hr)7l1EN!d=E#Sc=fw-if#ochp`C+;g@xr$0&7UH
z7^I`46WM1kBK6dHT)TeLq(0oy)>yr49;8d=V#M(NZH{{4;^Knk%a<c4C<w*H#aOXo
z1w1`HQCL`rf`S6@`FxYc(P%U{eE2YS?b-z!8yk!rI~J|2t>E+dSigQfq*7_G8yjP2
z$IQ&kghV3gcYkA$S_OIje%vfPgihskllly^<bdP65uB$t!OYrbK=U>>He$ho1xQIr
zfvc-406?WuVcoiQxOnj*WHOn-&3bWhF;=cziO9%E`1$!ECnpCxcI?2hW5<x3oQz|~
zjzJ=kVEy{_Sh{p6({K0g-T3IEj~HW7yRk1SDq;+}_V#whsI;=O!p4mo@yREj;K?VS
zWHzz~4<5w6efyA^nQ2hTyt%m<%a$#JgM$N-l9FIyVS(1xR>q(lhyi%748HDc*|G&?
zWo69fy*usg?FbGIW|Y7U-Is$04`R=rJ$UuiSMkq({u4z-MX<HC?Q`DR+FH1{xF8`R
z0UjP6%=0()J7{ljhnJTZ<Z?Mij2MBkvNG7(+Cn0cVBx}r5R1inh9&@HWMp9d`t=ww
zVg%N&Uk{N;gri4~;`k;f$WQMB0F3&p54fujnR?6m#q|%jK~Zq<uFu25!ou=LhczTv
z^eFx2e|R%BAB|Vr2Gn0LaV!F*i}2*!nFC%!ZEY<UELecuyLTfjEDSQ43=)Z?*V9;I
z<mKgI`}XZ9FE59+wKYOQLh$<Quj_5VOeH)#94AhkKz4R^zfQCJ1F2QG^L+`FUu8l4
z)3@ljaTT5Ns{jDA(Gy`lW+H}9ei&AdEQRIl#Y1u`Ys^!yd-rY}I&?^HvzU>Qfxy5(
zq@|_l7zxXkEyMEV%i-te2bD_27y~Mm3hURehmVgBxLht)tXKg)pO2`hD9o8N2Qe`*
zkV>VftgOVLLx+%&k%6U4mtxbVO%RL4C@d_5zrQ~!Dk^lIT~1C8)~#EIgoFeg!=Spl
z8jBY%#>+3ijGa4o0_ZX<wT4AZOw54q)x9$Ky0d!qY5+ibdb+{uIXO893=D*un;W8|
zqru^D(Ae0Bb?erly}cdj>FE#(g*bTdAWoh<iTwP0ljc2t{ybK!Sb+lv4j?o%lrbud
zwOze>HL9wr7=!)d#fyyBqPVyi03a5NF>BT=%%49W&ph)CEG#TgUtf<GUwjc?ef1SQ
zJUnpj+&QHD-(<|ZbrAqCetj0K?3VTGo|(#>D_=04j}gN8cp#+UuFS*2@<-s!H{XOt
zqd|ChIED=ycCVMi@_XZ6##OQW{xGB?v2;U1uR0QMypu;uHzep)aZ38Icu;G3?z!j4
z%F0SF<~uYrv`+!L?zs>4_V#3LZB6ISoui713UYRKCI<%xqjCDi(3W?VNF@DM(Eg(k
z9UaYRUvwusJ6k6SyJymJcMMhMA?ix#_44v!sw<s4caCPvm_ZLe{4l-x>Z>~14^dH3
zI`>$uR+F8bozbNA^73*L2n0;7N`8L6o^m%)SE9YMvva>orW&L3j*?W>XQ}PI4fJ!Y
zGc~<Fn|=%)M?VISqo&tq)6cQaT?)&WP7Qgiy;eEAd-bxOw6(R7kB<)tg+ki7b0_h5
zJiT(O+A3y-v_OoJl9ECe78VAJ9&{hq&dyFRPpKzOO-+=YolQ?X@dQ~|Sdh87IZc@|
zg<g2!1^VEF4=5rcg3Qg$$;QTp{$|Hz@)y+2mrY)8f6-j4|20?X_1SlA9+rX8(J}bK
z9$Gp(JE^m?bI8W~vr$-BNFzs%q~PG-A-(S`e;!yvf`uXWKWB6dfoB5_QAS>wN#$H`
z-%(RWUYTCG*qw<v16oU5TpaQFe40Lex<M_8pr9aHx^$`DhEQ91NxNA+fBw9|Qm>hr
znIsen$<x!*sCGhkwB=nrJv|2`e)mVh!^6X%4uE#EK4;DxdgPHun51Px1O)}@B<6Of
zrKN>2@*a5L0Wvc)qX`oxkh8NhWoBj?+~g-FCh8=F8=|SHi5wgp$i>BlxLmHDq1aQK
z;?F?O^0kI&YilDH7Z<Xyupp^aYViAONL!+}IVBPaEnd8sL?V&V`xz4x(`({<Pdq$4
z$jZu!MvNFi91e#pEiGx-uwi6oW=2+4Rs?{C4Fi25wWh{^kwYsE*n`eH%3l@7gU8*q
zd06^Sc6K)X_rL!gvhh?Z6=i2<(>LFIGh}1_S!iu-rB$m|k)@?2ZQi_@H6&OJGWg6`
zmOlmWpZ*eA`Cl=w=RGnNnK8atWn#X=h~XAkwPY?bV|=mDVFvSl-WT5@Is06{))F2b
zjw45oproV(@4ovkf`fz6-rla$CMG5Z91aJoSFc86V<YzN-HU0{reVj99eDcbr_s>R
zfW*W^<mcyu!{Hz_G*qX*r>7^Xs;cnVV~=6pym{EMV+Rxpg~9dI*Vkjgf(3ANbnG+n
z_|HIES{m~5@^I|fF`f5qZEZ1g=1hG5{r8wMWeT`luF)|fBO`I_*fCUBSL<El@py1{
zcE&>wJ%rZQR&cpoT)TD+4h{|wi^T?G{&(%#)n_OYpU=m#Wy^5k!Ufpd+r!b(k-1h|
zTZ^@8*CI1B)8zb`KLQ*M2f4Yqh>wp)R#ukY^}@nJ*xTFVvBw@mV`C$DJRa=r?NL}*
zsMF5D!2w=gUf8l_ORw{3G#Yq&dqW@);FC{2frp0&R<2yB_uFY~Y{dTk`w<rxXYyys
z&d!EXsl>Hw*HBSWfiq{$;Egxlz~hfU4z*eh02l@!^z3bu$7C5eot>RfC=|GP)3hA9
z-vaG_(<e=uG-P91T3W)&$_j73`6e!3zC2{({?XBBG)PKHf><oZj2Sba(P-}Vl30GP
z+-pmQ<=*q(%6gq}rX7b)4N4P2qv_D|ZhThuU7!8bYBdD~1(BVdoz5wzpP!$>6Y?`>
z&X7PLAS){?^7Hf4Q?@QCDbXqQYK*3)Ci3#~B7s1l7v7;&ZSJe&?4OOEVs+Zneyz@c
zmzS48(Yfv<CMMF-rAwLDN~MyLl9I^L(UE4%m_egPjbiiye0_as+O%oJ<MGJD!$T(=
zCLkc7*AN<_uJ4YQmlruYI#NSJ1Nr&+k)53#H8eDsbZS2sZr7fp>#|+c62F9+qa5hR
zkO}l-$OLNMWlt^fOQ=0NoNm{i8!|;~Lui%YwYm^WrILbzf=D0`=y_(eWmbKCeRVt#
zJ+&na5fBhS5{X2|Yb2FQ$<xzQ=RFS(kAB^6rBX?ro}MI;NSNO=fdAhM(dCuUzTWWo
z@UGCNpKDDXzrWnCp-mc%hTeYrZJIlGF4^1L)6AJODI_H1UN4J?h~9tyeR}4ZXQ;lu
z{;rIll9ECm9v<||FTdQC@rM$%T1~OBv9x*fW(o}rrL9}H(v~e-Xv>x@v~}xN3JD3J
z(9lrkT5N1A<>uy6b91xFVO&{RS#;pQ0lISK3eA`?gI<00Rn{ZHVi4AlxX;mOI><9L
ziP`W6?tOnqgyl4v4%&Jkn;G|Sn-Y5sk<yA@8OnWVYinaf=~`M^C?+O`L?RJ6Iy%yU
z0|#iqf(3eU;@VA7Z?*AzQc_YvVzHRSVlkDLmNKC*hC-`;3%YMmukIC7)9bUT>Gj!k
zb+7n0*`R90>MmTkKmvh)qN1X7u50rojOChWW8_m)Qz<kwl=yr;xw*N~$&)AbMCa6M
zH90#w)AsG#8Dm2v64BPJTWRv-$-Rb?$>nl#c6KH=H#ePjF)=YD5D3W4&CMi5?S9dr
zCdFroI+_N3{rwa+g>HNjd)IUcv>GXynVDo~XGdOMUPeQev?|sDfj~$6EjKrpL?V&F
z@UrOWXcCD;1_kRR5()Dgl*we|=;+w5Je0b+I!4^k%*>2991e*@BAPjKCRtiqlDWA#
zV@RaBSyE%bNK#gOZ1VX1<#z2k=DGbG+q?e7pNY=SPO7f1rtIu&vbVP<0QA;dZ{6!<
zQDtQ%IXXJ_D(pEFtX;d7Hg4Q_SLYZCG#U*hCMHr)P!P?UHH)5n@=4mWXAkY#wTtG?
zolDcEO{2}5H`8mcy+-ct?lgAnSQ;~C3_bkt!{qPp-)9(Cb#*oQ`T3Drt)`lq8k#<R
zI%`O<7=<+??sGCf`BEn*;+FFEkd1vyd0WRwF_wHSm&?h`%}sA3*qxm_can{b4e@w9
zJ@12DE+<DvN1YQ;FE20h^Ya_fx>Hh8Xv~-~G-}i+I(hQsfW{awzq1YM^5x5E`0(LI
z6LDoS8F9H>9TjLTxw*NtV8H@1H#euvn>RDLD8@wRnwpw)Hnt@tB{XT$BpNw#B>DOI
z8B`kYOI6&@&yOrDEQZt=R8^nV6PD}GU-K?|QeHYWWb4tQR;$U|+ndbH%;@mp!zT67
zdMA8*d>ErcDwXOPjp^y>y?XcB+S*7Y64Bnhd&$<;wog&Ky1F__Nl9T6!9^kwEnmKz
zTwPsh-n@Cl;c!SQmC}+WOUTN~iY88+NS2nCG=7XVeeK(oBhmKW29rMHKxjX{m3dxw
zbDrNbuCA^GfG%FVcu&`%(P-$!7hj}x>(<e&Tet4&Ty=GIBoqqi<B#v2kvi1G#l_Kv
z4ZnUzB@zjxr>E<*`QU>O=#fVrq0c}6oHlIOKu<jJ1m)%B865A%jT;mk988s!l|)3W
zA;HooY>vczPU@-i%)h<eo`AL0h#?!>+G+%R{`PAP`}a?Oi92fDI7@{>fo02<!OF^t
z5ew7O+S-cP*jUV-JsUYWIe6%yhY%PTh{VK1o%nYShXa{Rh9gIg;NZc7$jHb*Sy|bD
z%X@zF%{Sol`FQ^M=kfB(FJtfCy-=xC0~)J8+`e3ZtGgfX(kQrb)#QGiifg!W>UI1a
zJs+yCWka@})YMd*J9iE<XU;@pW23<~Zf<TUDk{RBJ$n!w9E{f1Rvb8R0JCS$#*Q63
z@X|{!;ctKY8zxPf1ffuf<m6;V-=HUaJ|CHxnOM7aEoy6P(b(9CsZ*!ofB*X*rcRv-
zcXxL<IXNLCBLf<Z24!VsSg>FLUViyyBqSv0<yMrHl_4V|1L^7M2o4U$!Gi|}eNPkx
z2hsX34`^DhFz=ah#$(i9eK3A~7A8iNV{+_OOpd*ZiLZZ+@$0iN>aRX9<BVt8Yg(@0
zT9OnuKHf9v^=PTDuZNS96IxnYuzUAz95`@5FR#cD&d$!Ls;UBy$HSaCbC8phgSfaj
z96EFewY9YXy0k+4{r!=fn`=<>0RXsMF7os9v1iX7OrJhoPrIVNz8<NmsaU&qEv8MI
z1{W6>eD>LAShQ#nii(O*RaJ$ZJ9om?))ue5_8Lx~K8>%w`U)2>UWA>U9Y%~8(e>Yn
zksOS(>MB2}{8|Q5--X|0rv}RMZ04oaBTIW}{O6>$wiZAB_#-Avn1I={XW!GceER99
zICt(Go`3#%SX*1))wzU1A(k&+jyK+T19$G+xvO&x6_%EkI%`#_RG2Vff=-*2D_3IL
zv}vfRsllN`hv4n)jhL7iT)A?k=WsZB^eCQq;)#3y+*$rW+-pmQ<=%1ea)VBZS5vAp
z^%sq%gZ{QDk(uYemA}TfHZ?Voot+&81qJDxCKnVGkW?zw^FGwo)e(=!Ga8rQ)YL?L
zKA%R99&NBJX<u}Y)7Iu_)YR0FhldB*+S>LjOsc=g&n8ggt7G&$4Q=mjAZ5kJq;9@U
zohmtXs^p~pxt5d_A5+_V8|bI7DS9W~*FV}l==DTIM37J@q^hbaYG`O6fk4n}SV2KS
z0rB~K8Zlx7Nu^Sq6Y09TI^y&Bl$V!BJRZ-WXQ4X@2?_MbBahHS4?U#gc~Yy@B$LT#
z>C&Y%cI;T<a5zR!-dkE)NFWd}o`{Bq2C}oWGwQi8g|-hi>)hw2*QSyDY=TLipw2r=
zlAle`^ECZ(^rZo<r8`MUNyO*#DIp<&c`q_Dvd<F9Jt-+EA(2Q#QmK?;Vq(bE)s?EM
zs))<wniNt}QBgq?Cr+dZ6DCk*W~PqELF@HMNlEFoN}5`&rpU-hnmBPHi9{lDb#<i~
zGiK0~DN`suKAt>0mg{`y<!2L&jx|tjo=^L=VpGV3yB3P}d**`=J|G(#8}jt@B#lOM
z&(?AK_HA0fem%LnyVLdS*ME~azyA7b8aHm-kcYIYR4OVfE2Cq_j!{BF0>#J2Gk*sT
z9H4*y``>i?cK;&+4jno~zP`T9>v{9$8T`FQM@N&tzdsRm{m$Io-RbDjqdILq{q$4X
zw{M?LNMub-4cXe-QczG3TPByqAgo8?KITG2J@fA;=gu6o8nq$J&CTF4?=Q^jGZ(t5
z_|(_e!^On~Zf<Ufi;F{hdpqNO2n-Cw!i5V_S68RweGm$T*tTsO{Qdn6&c);L@Zf_F
z!pzLf=n1+pT3cJOcyX5iRc>xBQ`yJX))v{>*+@)G#Eu<1uz2xeR905@`#$tWdu9l(
zf4B|k?DE!_kC_OY=k|gBkMF=;eF#=|%V06_FBoRY!7xh>EFPEvE4yXju090*KfZ&_
zbNgUEW+F45JogQ>{paNYtwmdvCoeA#B_$;gi9`?x1V~9q!P>QJb?&Q1qd`_y7F=9h
z;O*^=z`#JPSg`^ZFJ1(X$79+Fg+e_4{PS43awQTH5*X!bV*~^QV8n<K7%^gmj_1k3
z!UAq?Zg}?DXJKh+33qpQ?A*B%D_5?>nKNf}*0p-|YDlG0Mxah05TK-_1huubSg~S-
z(F$D}jmF@2M^Qn6SXTf5AOJ~3K~!)MH$OkjytbU>f{Cwx4US8INn(J*hFgK-5`c-X
zf2|{;cB?dFz@CZL)>gQ?yW_}_BPb{+VAQ?=VCT-A5Q#)syLPR~)mFq}G0Mx!ArJ_#
zfB$}b|NZw^xNsrj;^G*!b7M3&H^bA@6My;3UodRgFsxp^8mCU3!lFfsP*6~Sy1F`~
zq@=*d$H$;TI?yE`=;Y*t^XJcF>eQ*2HER|sD=YEJE3e>@M;^hA8#gd_t|K^4ZDRT;
z&b$S>ZTMLZh)xaUr{82=a-25~iP+;GjZ2p<;rjLKaCUZvxw-j0TSr}89ddGVuxQaD
zj2ScLH<@$#^y!#7bt;Y@KRzVmDHIC)>tFwZlamvkd+s?TBqSg^I~zGUIXZuzeDcX%
zt&B8&{CLJoX<=c3sZ*!o#~*)0XJ;pXuHW$S<Hym_(SZvWE<h%eAvZS{XV0F6LZQHw
zD_3yp)F~7d72UNpvivb&4T<}hOW*yvVS4g$+q*VTcSEA)e?OzTx*7`>EWrBp>#=0X
z60Bam8Z&3k#5do3gOrpMR8&+TARxeCnbn}6Ahfr)>y;)2fW3S7V(i$lC@d_*x^?Rq
z)!e?Qt*wQVlT)wdU0q#WQC?n-<;$1D#l;2w{{AL~j`YRvX@lC{-j2nK7ek>?prD{Y
zr%bA=t1C8c+=!JcSE8}85xaNq#<XeEaOB7lY}~jJb#--k?X}mCk&%IyUw#=*PEJgT
zQH@4}ii!#h8#c@&CGf_^M*Q^CPq4JK#DN0`bgpgLvIU0@9YR4t0p5G>J=E3J;n`=O
zMR<5PX3w6Dg9i^HJUkp4jRw)t(K>y#A#ehL08UO$Xl`!So4c&6j8Tl%a{F=tuAkV>
zytbaZ61)v3FwC<5Wq^lSaxi{f21Y&U$Gj)ceWTwYX(vvcfW5sv=FXkV7<@fROiYAI
zr9yCUu*u_ESy>?_CI;`l_Z}J>8*$^t4LCVD>9uQaZbn8%2K@c~F?;rGh(sc^x3}Z@
z=buMmVIdL|6H!r7fu&2A8Z{icbMW9nxVX4r&6+ich={<vdGm1Y+&N@sW+FX39ox2T
z!<S!v2?qxUaGW>7;(@Lb(;YXi;+OyUGDi4dX*;%_30pHCGZCDpH}%ou&&TcCx0$ld
zixw>c0NlBA2XeXmHxKuztgM7wF7Na3p*tFl1`34&9UUDy?{{=`K%r1DrG$-PWo3oM
zix;D!qQYS4Pk;F4n{VLe=7xX$>tA^O`RDQZ=bz)unKL+b>J+lGvzfmWCr;p<ciy?H
zp<6_xV-()Ga|f1|mM}Bx+6G!!Sir%-0p{lBsHmvG<;$0G`SN9a`|Y=AZEZz+dpj;)
zzKr_%`n$G9mOm)>+9kqr?^v}pnF%?n|LNLYo9F7a8_YZl{=S(ePo7MxR;?nDNJMsa
zc9f8iV3H7)meSHv;`8~`($d1b*R#~Cwt`JxVKgNrCH*e%+Sb-a0RaKT<MAjVA)(h$
z8DC#tovJw9QB|MS31_;NvSx4<m^##Y;Wwrx_4bvtO!Vu$vbMISfPjEr?`>{wE|Y|<
z4YNs2O(ls$(&t*dyu2tnI+_V(D<~)+xm?bKoppci-6<_CrKg{Mn#|11=*1Ub>~(!H
zF)<_*3Yj)xVPT|Jt4Xa^6OYIHHL18mt&>>YlJM-%RLSa4Q|sHSehrg~m}yc7ja)7#
zA0HnQi9~%SG;7;SBoc~_jy8E|TE*<OYuA!QA|Y#QYf4H=qV)81^7Hc}kw`>*KA)sg
zDJ3Q*(idNRK>~q5FXS*HB7($Xaj)T34Gj(C=H^CXv6$&!S69b`rRC=4l7oW-5fKRl
z0_NE(FP+l)p0^+0I_T%pJ;Ay$U?koAZ+hRI{)ALkR+62a9Zj1yjT#yn=!-ADpw!e<
z+P{B4?cTkcKK}S)x^w5wU0=tYJ9lW)rcLzdqmR;+D_8n#-_g-QWo2cQl9EC(F)<V$
zA5Y(Y`z;Z5g*v|X-g^`uA5U+;{Wg8|)mOcS=^Q_PoUE;_>BNZ>17827OPA>3haV<i
zUthX<_3D7f=?hasn<642C^$Hnh=_jt@kerYb~gI|rtW<8)mLO`X-V6*Z5z5pv;3)G
z4T<|0mvsl24gOG8Ychn``%Rj@z>|iVnbW9IqsYg{$E1yrF@l1E$j8Trh>VwdmC0lz
z5D2KMs><LP+1c5HD(_lRQ9-V*u4HFtXEcU9H#e7TZEf{8=f9&3s#Ytbr}{UMuJ(gS
zB%;{ZSeib4x?WWfLsV5&(d5aKY1F7u%*I?S7Wdk>sHjNie&y!o(xgd~X#V{9<mu^2
zN~Q77Qd3hyJRXm7a&j0$L0iGZka47a{<*oi<l*7LlrQ!5^<@l8#b=2+IT1strrfEL
z>wE|L%55nsDk7m!NC5!>{mOl4YHA{pNJJ?qDJHe|@$n%S7Z*Bq>=><Ew~j0<EXd5v
zj06G!z468ydcP-MUtfxhj5Ioyhlhv3`=6PaNqjz^qN1Xh>n$xUBoc|3`yUh(L^7F-
z$$9C{^^bPzZ2Vi_UNx}i)1jtcj=rRCnB1piXJ?bSxjDJHxzV0Id*~nk_y^_Y=F;WM
zmuc_bz4X8X573b#NACJMZrr#*^XJc}XP<r6q&$tx%uL$4bt@e|ew@Dj_FMAz_ow;u
z=hKA?7bq+&jFOX+skpe9o_gvj5(otJ!w)|g9qZDiO9X)S@83V*wM!%tdgYZ@?z+)s
z$dEXD_N-2uwzf8Ma&n^6r%%&&-+f2VKmR<fS+j<&T{C`wc>Vfy`tr*!>7W1nCjp>m
zpM93jo;_>y|EDbXFRUSPAM;xq5*C)D$jsb=7A{;!K0ZDa5%K@nJNvjM%l7|&cu<Cd
zE?hEiXHG?(28sqbYvxGEd5Z}OcbHIMcms-xfr^D;k%6J2kzX{l>5Yos!!Xg%P{FXk
zpwJ}o0Rw-cpkPCX4&C7R{lUFU<{lV6WaZwk*Iuu<c3$Us?Rv2DxX$DFeBvlIHI=fn
zv#F@4s6*qp_9zqz#%#-&)T>M;BR-$6WpGE-R?y4i@g6Fe(U6^;O-@cu<n8UPw-8(+
zk?2g)|11+!L%~#4RTbm?aKAy^{bqHBsH&<W2L}gob#*0)L_!LMf{KcYh|lNi4G2^!
z6}h>&X^mA;Q9&FIhj=`m(Ul*K>D>M2IVUHFyuH1N%jHsBT%685rU|0ftXabZqj`CG
z%*sjo;^@a+*n4GBAH6}JN~NNhm>A;o`6j(V)W`Yr=ZVMTX`S2l$mMd%&d#P6UU-36
zEEe_b*^@DqTfcri4IMg^mMvRG91ce-AkhSVh5|gz>PCA*Nx59k7#g-0MNlf0T7DGw
zAHTk5{Qdx-?n4*4Rh(g3P~M`VTg4eVQoh$W&3vrpfq!<Al9C7j4I4I0rx^FzwQDqL
z)F^Utax%Fv`0m}i)X>mCjg5_+I*x1Ct}!p2I-<C^nC8x%tM%r;yu6(H_U%h9E-s80
z#()0vAL`bv8v!utrEvcIdFtN1yWV@z6xOU+LnB6vFgj6xRNNm(xVgE}7hilqzx?tG
zefQmW^yQad((A9kPPVqTG<E7!dgYZ@Xztv(Mgu7#qKg+V(z<o)C@wCJLPA0)GBT19
z6BD19uacQRFOR;u*34gqUOl^`rnxQW_4<ul;5|a=*Y;e$aSH&zcYhtf6=k8SstR6S
zUg*`U7p`8til2V^3DworsH>|(O-&8hY&Lj29=KdCxLhv!_U#KEkH>ttTrSvbHqz44
zFk{9H^z7LarKP2M$M*B{LrqN$JUl#@y#Gau7GdAMeaO$xhm+I8*M|7`_&_3&VC~wq
z7&~?>#*7(*k3RYcqeqVh0Hmg-V(i$l2o4TrijcJmIz8WgpnQ8nSlHOXe&S-tw}k-!
zZWXMDy;rnO&Bf=Re~y(aS3)L}K_n6Z01g~Dfc5LwqqMXX!NI{ODk{>+ad&ohMq*+j
z{Qdn=Qc|L~rlh&K8NR;0Sh{p6qN1V@5fK4*cX#CE<UlMIBPl5f%a<?L+Gop_E#PoC
zkVx9(Hjf=U27iBlBqSu@>#x7Y!i5WwnwqNjH_w|l4^B=_h>3~O+V1V`4R3F6R99DH
z{rdHAcXx+KBtlqN7;0*2z~OLER8#~nFE5BhBFvsW8zm(rsIIQY>BIj;&;QBrTH5tO
zcTuQm7oZb#a}U7HeIKEv@iJPKH*oj2BG?S|V7@<b;sioMLg3`&gp!gHts?f$pb-t2
zGGz*Ka&qA0<b;BP0vtVh6a@tZsIIQYfB^$=@#017+qVxBCQQ)Uzp$_nUAuNgUS1wT
zLPD^6_im)7regN&*+@%E1B<1<p2ynS8rj*|7&~?>R;^kEH#awggoMDy#|LF)Wz2q>
zB7ZKIi<FcUy~m%HmZr1)nYT8>iZc+3+)vv2slNdEwlLh>_YrJI`NDSOR9HPbh!G=b
zxp@^W^%tN#`8AYf*=T9Jtks{LM<jastN<*Z&i^&uxN!p~Po4w-1Ox=&%{SlF`ksgY
z0QL3tOp&f3e);7WeEH><Xl`ys|Ni}<R4P$jT@814cg&nQ6AlgzM)z-OYQn8sw_tB?
z-{Enmq@-ZkvSnJbr+4n$K}$;uE?>Tk*|TQ@00s>jgjZjE6>e^B7&K^*!T!2-?TX&L
zd!xR-9(V5CfsKt#hsU6ywY3#HcI?2cS+hF)jgNztmKLm8vj!Fx7O=FmgoA?vDk>`Q
z+;h)i!h{JJJ9aDt0)gItx7*XFPanMX)?2W&w1l;_HCkI+(bCew)Kr);!|<dd88c6g
zIiF-QD-y@bDj(Z8?PX?Pp89X<*RLN97%+eW0s{1|LdfNEs;H=-yu3V;N~M&LkU-(#
z;pF4vLvC(v#N+YE&d!ed_wP@ZmX<VR$PkK+jir>76q3ngR9IN3BQcqroJ^xfk0u`<
zAESBp4@+%rEsY;Po-8db>EHkUH?ut^CWd*V+TJzyN^HN!BQM#aqT0B@%s9<w?k#m|
z-f#;90y=;GJjvy9N=Zp!+`=<5GK{7WX$TJw*J~_Cq~CNdB_)NpTrTa}wM)AWf$q7N
zYgTk*G8u6=9OezYTrMXkCnvqecxh>AdL5Vbp;RhKDwUF(n;Q)nFn}B#9m&hfi+=j)
zC-U_4Bo`MK8a;Y6MMg$aT;PO1#FWgC`B`#uGI6<FgJyu8L9^m8ZQ3;I(xnS^>(-4V
z5(%ZGq)=H|8ROz^C~ZL_t$hCcc~YrVl$@MQ_V)HPX3Q9q#;>lfrtaOlQ?FjV^ritu
zMMaTFBr@r~(}(ipUakARv!B}c20XPj5$!p1<_rxSIFJMa0i8Q{PUrigq9W?wzdwx_
zF~VTV&h6W`DLy`)UVQOI+Oua5{r>y!bmPVix^d$MUA%aamMvRGW5$f3Z@>N4=&_WS
zmlFVrj*d3k?(EsKw0!w;9kaS^+qRLNogMl3_%PdATU+V&?b{t1t6jc)nMRBlK~twr
z?et2@>C>mFfB*heUS3X0rIK#lx@FSmLCyB`r8a%_)mOA;%^G^;l~<^`x|&K#N@&QC
zAssqen=$hsJe{vy%m4reKi3;SS6l)BeD`xDUUoJ7hUQ_&FFD8j_vF{7p^IoRGBYzV
zc<^A18Z`>h(b0&BiD3-I*lae~Y_?H_AGKPIv17-=!@~o+ckhO^wKc9@y^513PolcI
z8Z|XFsH>}kot+(cJRTez9B}sRS)4g@1}j&tL}_U$v%2x1Z+Z2><#JI_P=Fmfc3}4G
z+1R~%H)Jvy-hcmn3>!8KbLY;*bJh2xN^M6>c|7uxme#Nx<%_2LHWN1G&sne;>Vc-F
zCWM59psubCUwrWeR<B--tgI|ZBobs~WN68)c7$f7W!0)xS}Oq>)47t860P=8QBe>G
z1PBTWf=DF7(xpq0k&yuaSg~RS0s{l#<m7~;q$I3cw+?xEd2n@g1<-a+$Ye51nluT{
z&d$vC($Z2aUAh#7g@qlyVFTI}S%QOu5gZ(h($Z3-rKMrlu3dQf<(KiVfBg&p_{Tr6
zZ{I#}I2>I0^+$yJ{%=1QZ<EhUXR#eQmAOu;E2mLiU5${C5CG7-B4i4Ujg49>4waRa
z5Q#(>KYl!1TwJho=T1naQgFFkl$MqvBqRjc+1Uo4IWCur`1p84L_{DjFAsixeptD3
zCDdv)CQX`zw6rvX$9dw!2?PZNVf^^<IDY)N&g#Y5wQF(UzyTB%78+dH=m^$`DR3O-
z1x4O!+$va)R^<(o_Or0DgPnLT>?SOLrESj#8vF0W<;$1x+i$<&op;_r-@biyzW@2>
zpHWj&gUOR8>y?F7sZ@xLj>drl2e50`F1Wk9Ykl9NM-P1T(MPbevqMl&5H@Yv1aEKs
z&z43CwM&;SMvr;$;K5k7Y?;oR@*jWv5lu}^jI1{RSXfw?q>N-~X^Adfx<I8;>8L+-
z#FZ;o(AwIH*w|Qf>(-4~#W4mEfy3co&6+ijM7imiXP$wFhX;-yKMt8phM1Tb%$zwB
z(b3V^yLWGg=hTdu&R`BCo?<-QhhW#ip8x>g{d6ADK@%RimqbfTt5zWK^2mXB<%Nm3
zeEBkpii%KNT#T5Q7`V8&AT>3$L%n(pNl8gyv)PbJrFh|m7qET%b`%vA>9lKXY{U;g
z{DAQAaEu!_4h;<rNJ&Y-uwlb+_3BmB)YPD{u@PJ@7koaS2`>8f?aQQAX|~_*oP0lO
zwHoE+<q!x2c=OFSF>Ts3OrAU$uf6sfyu7>+78Ztu3l}1D%Dw*q|B(|^jn+Q^SXo)&
z%{Sk~+_`fZXXDPINn3GucZZvs8^mHUGqKOl&(}M#mq;WiEG&eNj}PkV>TvYvQ8+p}
zV&~4CC@U*NL_`D%3JOqCQljIc?CR=@<m6-~rAn<<!`IgrX=!Pll7|G^Qn-A5ec|lv
zjOo*-<Jz@r*u8r<)M_=JfBtzKIdTN8EoxNCS#WyBl93yI99TVbZ^E{t@Enp>jb(ys
zQ)y~y!m(q=aPZ(koxnlk#nS%%WwBWB_4UQ(&6_c0$`qufr7`Jkh6oQ2$JVV|v2EKn
z?Ao;p@$vBp4-d!MwQJ$-?vD8Qcr7mrwOWm}Yu94s%9Th<OM{=E9|{Tz;P3B`{QP_f
z1OjAbWnuN|)hH}1eCUAQq6-T>{`o%ay`pjVw<0Ki&VuU7X|&wDidMz{Qq=4nVb#MC
zUH&l~tmh@L8Rqp=`b6l1i172zKLY?pj2MA#-MZ<t`RS*h(9+U^DO0BCO>x<@X%n_?
z-HPPoWSt<QJyB6nC@3gEL_`E!TwKt<e}A1enn0zaiM)k{1uQHqw6?XhwBYR7vjBis
zUwzf+{`w#yw6?aw($Z3=?~bsxwgwSl`0(Mdx3@Prkg&J6@AO!PP^;Bov)Kp>3qyQ-
zJjRb7kHw1@!`s^%>(;I7)W0oe%yh^TTn#bvgi)(oNHQmtNjutkp!AWCvG2Q6O#dFU
z*J`<E`}z4%U|=8--BUL*l<w4?`=wrq+SGv3($e&{<?(oo>#s_sB0oProwS>(swyfh
zEF_ssMky&N6dM~$fq{V}7K_Qr$%$Aj7I8Qnrf^uJRFj^bPPw_cR903-2M!z{fj~gk
z*4E_g>`Z=sew2`qK+)0B#A30?#>R#K(6(R!lTvZ_%HvyVR$s4X#@Q3xpBx+<$ll(b
zJUu-rJ3IS<9iHzeFE5XHJRbe}>#xM;^G#B8lFQ{Za^y(r(W3`Vm@t7p|NL|E_Vy-E
zPtOihlp-S|Y2w6*<mu`8z{QY>iHWp$@nVXNjiotr=1@RD0F4<lhHPzZ$<or201yCr
z+r^q{BD+1(V)*-My{n{}$Zq5{z>4g;T2fe880F^X8kIy=C=`^Nn@h2=u_P1<$<EG>
z#9}ceBqUH#QISd4HY_ZR?Ck71rA%|`)G1=K+2rQtrZq-IMFk0kLK2I`R8>_)RaI3a
z5{byu(^Kbp&dA6hCnqQR`s=TW!{KPTmz#NV+`M^{yuH22-rk-L95|r!{pr)EX~c*T
z#N~47%9SfR-`CgI)4+iPX~2L1CZ*{}rBdqNy*s`8?z?)wKX>jN0iXp77IgZz{PN2$
zBoGLwU%!6T)YR1J{V!d*L_>xQA%B1WPVay5;zb%XXi$e@6pxCI<X_)=?>!0%3Zh%L
zZc$-jA&nkAn!fw)yFcXE%sd^K1Bs`ctvSWaM1OMR`bVnXq*k|(UrajF|HiCBt?yMT
z6^TS5iiwFKqPG0?goFg*a5$8hn5cI$WJv1u)TvX%;c&FnnKbf}_qSE4R3wo|Iz0)k
zudk<5r%q9BZZ1isQi_j{r_j()^7i&7S65eZaByHIpvFFSHkMQw-ZsHkU$5@eF?0sa
z1eMLQFzL9=AKi}w%i<3UBo+y~&^x18l$e-EK0ZFg;c&>=*_pz_!)e2Y4fMqqU+4r5
z@$vDLpP%39+5)9gNiV<rG7TO)*d$dP4GM*VQFOW=l}bgasj1YnXHT-TvtxpHeaxRf
zpSpDEVpf3p6LICr6|%Rtrx#y*QLk^q)~#C!0L`C2pPHMSNu^RzQBe_9SGWBewqwT*
z>fXIO`T6-#b8|D*)YRx5N3B-VwQJYt^y$;ow{KtS-@m`!f9q>&Ysu2mQfrcIDqFT}
zp)Osz&|7c4rBlmMP*BjJFU5rm7pPaSUKAD<*6Fc{h`hYKX#V{9543M*=_rtp%jNXS
zE3eR&EnBFywUv^Rl4#<@iBwlt_lF#xnZG~g^82TpfQc`F=lBeOHg%=t8^1wIi*Yp$
zQ~5YO7d2Pq0NNCy-khYp)NO5TjojQ^95`?QYuBy?i^W1*TpUVDO7Q*n-^0bl1&0nD
z(%NU?!iA7XB=GU^(c13p?2ORRP|TY*4?tVq^}>Y<k)55b)7IMB8Zw!TNy9M}4u=D0
zXJ<$x5(EbaWBKysNKa2kPEHQW%F1y4`gN#ODpXZfp|G$JnVFeby?QmKPoIu{{rWNe
z^y}FL)|w~pF{;B@She*%p}!TnTD8>~I6FHdH8mA-xg6B?BH@vI;^X7t;NXDy^XHqq
zk5Z{bpFVw<yyd*SJd^gz$;m<Q-o4SgcW>n8=04Ez#>B*c%jH5S6vE%%A2VjmfS;cq
zTwGkVa=#-+x1Gb5|EV`U4m4>ulLuMhM7;%$9zBYrq$FfyWMJ&rvB=BI!@PO(uyEl*
zeD>LAu(r0wk|j%!kdT1b*jR|g;!f2TXcUtA^y!12fBqSjm6cewY?(>>e)!>s2nq_q
zi4!MuoZ}lC8*%X9K|J@|a~M8+ICkyY#W*Clr>?FJd-v{zP$<OKty`H~cr#CybLY-M
zp-^D(;K3L;aG=(AO-)TWa^wgA;PuyEhmDO5u3x{7?c2Abd-v`D+Ekj9N+pI38;0Y@
zk0U532uVpv_~@gLn2+Y3{osQSpi-$|Z*Py^fBzll&Yjaa9u|v*0Rsl$_uqdvdffH(
z^~lM|(Q>LUFE58mrNV>>6LjhUwr}6wVV`&I+`;wh*U_g>AEWII5gs0nufF;Ur%#`L
zp#3|8zI3Se+t_S2KKS4RtX{nub#-+J3kyTfo;|T<%^LHwXXerHhyxQde?g9xo?})G
zgh8KD%C^I#RvTBf=!leUhqe05{oZg2Pi<{2@%en6x0Bh~*~I7bnRF+aOlDM_N2yfO
zph1IZ>eQ)>B9So^3Wb*W)uW`Wtc+q}VyJiT-o)qgsYj0<#AdU}-`}6Eu5kOqQ=1Cs
z45Fb!htg}Wy+)HKPbM~-P2u6;k0h-mH#e8KTrQnGdzPG>oJ>k>A|iU{op-2f*RJH{
z<wXGj0mR{O^rok^M`JpdpPx_p`T4}*a5}us`pC=6BX4hS;&3>`X0yq~#f2Ok9LU1L
zf(8y8NEQ|rWMyeVzl7ShIfS43rqg4Xibloj@C+8s^LUQ>_wP>@78W#U&>)J9jn!Il
zkjv$io105<adG77=}Bxhn}k9kMMXuCOeWLuOVNi$AxZNb$>nkq2m~FT`?9h!;`8~;
zF$e?#=1sCj^(ihcj@g!)no1lFhmw<%nQaP%g52EPn0DUY-UdBj9)>%W-_wnp52=3L
zM7o+Jq}mULQSArA=xUOX>eo%A#_XkZr}F!!+ArdMmMvRG0O;e7b$w^fpFdASh76$>
zUwn}+Uc5*|MBje<EiGEKh-niZ9!>x#DJh8#95_G#h{NGfuU@^hKHa)?BcV`86%`fa
z?Ceb4x^>f=YNJ#t>5VtupfO{{7`(4<-@Z+gCr>5-6cG_YL~W}HB9VvyP+_6=DtJy#
z4y{<RqC+L7qeqVt0Q%2={$u>48R5-0-=wi)$9Bpe=|R}AVT0B)Boqqi@ZrNc?V_Wj
zDIg$#h}zV-CQO(>8#it=>hNvGj47Clt<B(-7Y5@U-<PmC`v(BPu7f|Jw&5n0hy4?_
zo%EJyX=%mB>A5)Y!@V~#Z%ljvl9z@X+=t8MA~!b|9v&Xxa5xZ)#Q^U4Gpty#0wYI`
z#GN~LaQN_HgX%nLwHkf<_Qk=22XW@i8NCI3?Xk17Lw<ffJUl#LXJ?1d(1-I0sH>~P
z&Ye54b?a6%G&F$6<3XiTK_n8v($W&wu3f{99XrtYfA<QkTdrS3mp+Ei&BM?lzo(Hu
zbYMRm`%ng7Uth3TEEE?PBQrA-zP`TTa=Cctop%r%9NcNuoa*Xo1O){_CX->vkRe*i
zO2!JH*R5LzsZ@%cJ9om%%L{`C561TG+p%E50-QW~5~-=FI>qfxO-=Ck_s5bYOPG7)
z{rBI8zrVl9s!bZ$Y&HS|1M$y){u3!FDX6HZz)LT^#N2N$yzm0-?l!=IbqxT}d}@wW
zDO>;mAOJ~3K~x`D&XYQIZcIga@@oJ<)eVA`JqH^$tU!+*Jur9fT%0*`2GP;c%ynV2
z*^o#ijMs*y!2j5>W7xfWHx?~g1ON~Ug?Rbpmmv~~;Oy+ooXhqKNt*M;X0wr>pAUC;
zcW^iyrXc@*A|fJ?n3%{M!`7`^@zF;gp|-Xb1qB7j&d!EVC}i44Mn=Nh+ne#7*tBUA
zVq;_B?Cgw$gaiOUW@aWlJUoz;l!VyW*oQljt!mslwh4-ZpBh|2YWd%b=sV{N(R6qn
zEbV&1?$rgb6VH9>i>`BXbHU+oFmmKbo$qXIZSl-A&w$6{;hATi!P&ECv1iX7t!u{N
zaA0L+g~rB4a5x++TC@n0CQZWKyLXv3mX?;ddGjXz-~ao6Xl-r9-Me>TZEcNz{No=w
zW3pH*y!`UZC@3hvg$ozJ<#Kh}G&D4zwzd{*HXBo>OhI#VGqSU@F>Kf{)YR1A`0?Wq
zi9~2=X+dFOA&wqBinrf>8$Ej(R_G!kl$4Y(D{Bu*YHBKigM%@B`g9~DBw+mb@tyLc
zFa{Cf)TvYW{rBIQm7<d;PvY*~ySRJzF24TyYp_@>aJgJ&btyJB7E`BA#p>0oA(2Sn
z;o*U0%a)<Oz8-JB`6dPo81P7r&CJt>1(6Ao0%o2HKHRWhD*)g*K7-)bg^;{799CAw
zv*21<T5;fq)7Y}Nm`P^>fLGmz;-fj<9qtd@Ga$>$%hQ^Ks?}<UL?X!La#&hg>Q#5D
ztE+>*zdyKKF1mE-g1&wGA~`wPq~Bd#U5#<$#vvso#o#2$5Y5fa*t2I3wr}5#W5<rc
z)6)|-Z{EbuKmUxtz(7PtN8`|;Ls+?TC5noQz-F^?<Etf%no{?dg2A4#zEfkGioS8w
zYBfSaLQq;-irm~>@OV7z*|P_mH*ZF9aWMh|0}&P$W|9h0b8|Dsjvb4cGiPe4fNa^a
z1uIvsG-y`0Y}qobUAq>uX3fI7b?X4Mnd2Qico3PHneg}bhgz+MOeO=H&1Uus2?;?{
zQxjw|nO1*6K|!##wuV$HHR-%GH8o+=rcGGAdNpp|ya^tUhwa<9WBc~)$jr=yjg1Y)
zjT?utL;Jw{%4Y!D4C%NZoqP0?%~mz);)gTFXuW3d1Z%_;0B!gE#~*);jT<*2H8s`b
zd$X>t4#$oi!}s5RkK*EDoH=s_Zf<Vq*|R5(9zBYK2M;o4iS0Ra<_tVMJhTi7HEh_h
z0bhUpHF9%vnQeRb?!~le)9~h-Z{q*{@BfSja+@}7!u<L3!Q=7p%P+rZ1*~;-br?H#
zED{qF5fBhy(r>(<J7@FJxN8B_^%ov!f9q!lp{LIZ=G;GxxVgE((a{kZ85w$w)c*V5
z{~{wJgHd!EKYqN{eX@7&UIYdPLL?I5n{U3sty{O4w5R(~sZ^+_sKCUD6TxP)QBhH$
zx809F{)ks!eHH80t;0L-yrZ|x#*G{C?YG}z^ytx0tJQe!x#uur#th`<=3>{bT^KTC
z2yAU_VQFcJi4!L>($R)!Zf?f(>C@5D(t`c__v@9pH5IvBjuk6bVE_L87(RSBJUl!w
zY}hdL=+Q$bC5gpi;rZvEH%YlktyUv8HWug3ox_zYSJ10hFE}_jfQV3EUk`;s0WOyd
zZ*On>```a&_B(v|Fh2hHV>miGqDz-9sH&=hLZQI?`ST5)Uo&Pp<cY3_nEBI@{?#$9
zlq6x$r}X-QG)mcam`<F%L|5t?>CRmh-MOoxEA@?Z;_M|#*>;#-Uy!D=--Dz`WoKs-
zkH^z8luJxZB(YdbDwRqn-HE78F-9N|Fh$$-_4UN%ayyl_Q&CYtJRXno^Ycw=Usza3
zp`oF~;c!SIkx*u4CMlIlN=Zqf<m6;Vai_4bkl1XtmeJRfFr-tS+^h9<e0)4{xm+qL
zDq^-(RaH@JY%FoPToMX}9U9Z=Go90*&#X?RQc+-FAPpNfj0OxCpw+iZr6Ol%XUfaV
zBb7=;QBhGO5D1v_X3TU>p-_;sv$N6SUd``|iHRXDmrJ3cq4fUy?^8xb1}PK@^7Hc}
zcXxMkaB!gG$Bz?-!=d`CwR9!6A9D^BM~wIXAlxd>VEVrt-COUyP*hYz0)c=60s@RG
zIT=E!RMPtO>#2M9?j#nAnIi7c&`^>}rCRr9VPT<;F`edl(xi~7R4R&%jU^tBM|0-P
zAx}@w4v!%rA%TVt9ZC|3goHvNm6ergeP2;gK^zW8Cl$pM6h~62W_}MXgSjiQ{YbuJ
z4k=H4L#n#7)Y`0|)@B8%u2quq)HfvGF-Pm#YCbpi>!$TQEmTxg&~Lx}X7GEpT1}@<
zpQgiy59@7r`}S=bIdUX9Iy#zE$eWUqLN+!wl$e-ku+8=B*Xgy_UZYvFW|3O0HrVd$
z*|T)$&>{Nir=RG~oqK{Im6err=+Ghh{`>DuHX*%y`7%BG?6b6L)hd(PcSLh@GZhyX
z)1pO-$iu^fMvWRpuCA^$a^y(nGh)OD^6>DW8#iv4)MsmJEB*G{Z&XoHL6w!2bne_a
zs;H=-ii!$4ckUdWJ9mzL{q<L!lrWV_MHenypwp*MQ$<Auoj-q`&YwSTF1$ALP?!S=
zGddhCJ*PJ?F!eJza=p=-h>l24PbYyuK()2CR8mr+<ASVIDk&~5jyN0+g@uJ_$-8RM
zxEFUu;#4CmYiKf4RaHgt@$uy3<V3Enu9TddY&0kR(xpqp<MAjrH&^?M7S*3(f|`+$
zL2Nc#r#3~YR8nSUCNt@biHXs1Jl0$zL-i^um5SWl+$cFYnTXo*@Wo;=`S|#dySuxN
zk`_^0-9r1k`}Fj5;&3>$e*Jo4v)M-F6g9OI?E@nXMMXvA=jTT}9*^SV<F&3?ZEY=y
zL?W6#eLB7J$}5zdoJ`r-+05kl=C`Y~+>alrdQ*#v>OOS2H;K*p&|p)gQb{o}F~sNd
z8Mkj!si>$RE|;sdUqwX)Nu^Q>4-Y42XJ=xw+2rHnLy3urw0!w;8Z>ASbDjbN11TXP
zfr#4F(Og|!$<NP^nV4yUPD4ngQsVJ=On*|TlsFs?#mC2MJ)ebzg~Z`-^tx-SR4TpK
zU;f{BbsVY{M^a4+&Rg#)NpU2VYTp~6)yMB!XLY!*8U5_tyO(TjZE4ApB}UuT)zy)^
zyE}~-F`~oZI6Xa`oSdBK<jIqd@=y(unwm;ZPEL<}a;;LSsG*^OE?&Gym6esuBwq8W
zs;V*?ESWL$XT=;yn9<9fyDCcm>KJ*3tur}*@R+@pHf9x);#TuRj~^c&Ph-c9rGWzn
z8kC4kO-&^m8yn*Bcv^CI8pL98rwgg?e<Q0<C@4KWotaceMMdenO*Mq8tE<7cZGV;t
zs-|FBGvU9Vii!$~iHRW&heKkqm}D{;6&Dv1hr{VmC;if;OT^`JDKj&Z1Ofp?Mn=-+
z&6|zB!S?a-(FzLp?Ab$BR#x=RJMVPxqwf{`*4EaNN~I#1Oh!VXker>JDLp-1XLUuh
zk`)^pONohz%y9(<22y%@IuW%^Hrt=ehA-ZDWCgmvZ=I!e547AiUI0qecD?v~J_QE{
zcj&i4)D|c?IXQJ$NPT}1x2>%$+1lEYkB<-a?c0~Cs;VeCIhnXzE=i?Qt$k0OIz?PA
zSMP){FE3ALMUJTL-q6S<w||~wG8ystd?x6Kjg6(UvNAe#>J&LUJ8Si!IFhOr0Mw^W
zexT>5wOK(88>X9ACLR%M)~q2upHG`MZPNQ9=i0Sv^wwK%(eUBJsl2?r!~U*by-FS)
z9`xy_pFWPm)#CQ;+vMWnVsw?nj2Sc9m;(tjM!9oWML(8T(<hq`Q0Rx-$ampJdS%uc
zdS%uc@?E%*LO<L_pKLxrM@!FXnaw>4h7B8LP-8qLC53oA9+i}o=uLMbx|c4|K26FL
zcJACs91e$GfBki0v)Sb5=SMj?Ih{6eGd6kqGfhw{Dk{jy$%(?l!wvpMrBcbP@>p3}
z(bTC^O**gZ*RLllD=YfogAYidP!NyD>u_a(%jHsieLbmED)RL7q~PFS5(orFk55BP
zObj_WIT4@FCy7L&yBhRAGy$XL8VQ9$x^(FhDV0iMv)Ni{5XzH#wI-R3yB9z7wQAhG
zSgX%lKbod=MbsADMn*;wpU*d%iq~Etsk5k5Dw;WSCUx!Fm0o)3C1SBy#A2~%%9JUT
zl9EDYWo25|A~rTwNAF)_US}*_DKj&ZxLmH*>O^vKGP%0Cl0u;%sZ>fnK0c&Usffj5
zF~L*wnIl^1OxLAvKioBGQR%F1+@B6;#x&GwHSO53gC<X&Ov{%qr`+6J`tipf>4zVF
zpdCAQP-ti<&6qKR&YnGMa-X|*?<RM5cRF+C%ws%qqNJoG8b5yg1DV*FG4r%y4kXO{
zDUr!!G-%Ku^6~M}nxM4LpKm{rZJ+Mc-pno`A%VQTy-gbP)TvVx6B9!`9*>3&9ZJtW
z`)sHFXV+Q&OcPX1ijPDhF`BL<kw_>gD2O5>BZ<vslSCph7-VH<XA_sprGS6{5{X2#
zc=2M2jEwB?SYl&iDLg!!;^N{+BodKIr6PqwLEhfpBo>SH<~pB0f1aYEqKL!c5Rb>B
zpr9aw{mW!B;&3>6Q-s>5HMQr){*SfJYr_|BJlHByi%KidW3KxHkei!JJRXlCBO`UL
znMPVw;~f7WXv`s5EEbc-CzHu2Dk_SELLsr)Y!Zvb6c-mqyLa!V=bn3x2^!k3Ms-Ae
zeLea4`H`!uD-{(LQD$Z)d3$@4L?R)jQb|ruPE=M_Ms99yZT;W3;#QwJ`OyU7Eh=jG
z;*EPjc--K}Q@`|-P*+z+>FMdTdi84Bv}qG<*sy_Cu3SmExw$4eU*FHtrAsL^G*qhw
z;!#puTud*$^b!>p7eAK%&6xSSVh$wCbjYQ;-|5ReKhWZ}*%b8t7V->RN1kEpDCqqy
zw0LbceYxicI(PBvqZ{wiCE{>6R8mqx3Wb71A`!*K#W6*(B9X{oUhVnw=Sd=wkU$_{
z3U>tpfx+~s`uciGNl77BS6AZm`4kry#}t*Oq@<8QATYT|??L!8O;D9eB?SZokh8P1
zUhVVv_;?Zug<75fX=!QX=H|xKA87VVO-&^pkH<_bJv=<f&d$!HVqt|sK^zW8$EjRX
z<m=?*#H7j;78a6^kB?UULw$Wc@%encdHacpiNxh{4W_4+l$01O(!c-w)_v$gw~8}N
zo5Z%L=vHxt)&#gFvKw9BH1nY*!E(8rS+Qwf9}*fGN}isconA%L@Z*m^5{t#6=bwL`
z#*7)G*9BgwR8nDKA>+i|qel<2v9Y1I-g=Ar^yx$IzWZ*c#?&~`&zd!h`u6QhFTVI9
zQxNXs<3o{=k(82>LQO~09$Q*qYqLT-Ezq3e^hi*tR1cm1-_+DZ5fKrzV#SI_bX51K
zs;Z)ZfB>`8x*0PMfLZ?4j6wDnmLp@|aa^o5?gFZT=lBeQCclWu<D5;Bd)0?pt%jGE
z7bZ@e$Y_)|G&ErB*s&lYxVyU}BO^n{W8i-F?Ae2b3l~Bt6yjh1`WNQRnS+Xo3b5I1
zG&eV6-@bj=x^*j#9Xkd;KR?WzIg{}wXwSzVe~g0%4<a`=w^Kd^ok9MecW}F8C-b-U
zvx8tiaWT5N2XyRw-KxgzlATZ-{8UT&($>`%4k23}$T@r2vSrw`X%ljDa~Y|`0|yQu
zBqRhSB_-hTcsl!(mX>1k=FQl)Z5y~;F7Dj9gCj?dz{$x803eY_@bk|<<Fn5`>rmpe
zva%ARMvcPIp+iwxTB`H?mtTH~dGqF>Z{NPKv9ZB|1q%=u7^o#Fdg8<hczJmtKR+MN
z&dyM))tEPL9tsKyke8RI_cxfr&2Lsfk^70(HY;{t*pBjr?Z~OHdUg=3dN=}TbHi?_
zzX0XQuc0i<W+YxU*m*>vr_YK<;%=Umm4$ip<{>aJ5Z$|X$L`&`QB+j)K=<r{0|zi|
z+B8PSv$?q$<Hn7{+i$;(sHiBT`%axY72kjVJ^J+N18Zw*R99C+EEZ$Tm@yCvg%Apb
zM!iZJ8X6E05rGpYPB0z=Z@>LEq*5tn&YX#>SFa+W_hH5-qUW@gu=9xQ^lvoA?c>`Z
z-xdY{u(a(7?uy@@dXI@e3yqD9SiO2RMvop1Utixx(&z2lxAFPspM%fm!{6WEB>7b{
zX3X5f97veap`xk|$y@SJQC0Uq`w!%C5FO-+(Zl+6df%j^Bpf_=5P5ldOt5g~%o$9X
zG6h$!Ud5MRerd9vesgm(R;*Zo4I4IKz<>eh+qW;cTrRS*vf$?ChM6;G!q3mILld@z
z3m2lav=sUI`5gu@56Yiyg1TwbCM;UC2pJg}aCUZvySqCwGc$GkJKEFK)P%smK$Mr4
zqiff$P%4!O3kyU4{{8Xkr=McercLnn_SW$UxxbHb<Hlj;%$eA=YZsO*S;AcJ#>Pf$
z*suZX)~!ST{{3;`!Ueql{`&?ew_CPs!HN|tP*6~S@bGZPtm<I{!scIc&?t-6Iq#-o
z)x!}zd_HLl6dxfC4Gow)c{0k%%8;9ziwP4ZbZY;mrY0<1x)i&1?LzO~y-{9X&U~lw
zdPq)AHv0Tcn>G!(xw$xT;sk~c9g4=rMidtpqqw*j-+%u-N=r-O<m3dANQ9SPei=fc
zP%EfwXlMY3!@-_CdoX|geB8Qq3l<g@kVquBeEBlu*DhoKt8M4~kMj25MDBylP>)AD
zh8Z(v%=}F-2NGtq*k4$V#4it`rKOeGX3Oe|@uQtEX2byW@8f`ej?Vx9Y8!5#`pWP4
z;lu?LpQ=KmLdoo7Wo3!zpb7AO)wuajdrC`7F=^5yl$Dh+lM9VWU3`2z#A2~Q!z@G8
z)YM?jnl;$4VFQ|*n=y6jRHUY+cKVI9#tbbpGxM<p6Mwb|>Y+o2;OFNDdwYA#ojcd4
z^RUJckjLXeDwQ(s*=cEM*tTsO#9}d)En9}_>T08Ab?r^(ii?X86cmI#d-h<%h7H)Z
zZ5#aj{IFob0ysN6qq@2pQ>ILTP$)!NTAJSL^7h+rW6z#Fm^N)1($mu)*|j58GZcBN
zajRfGT9r3U+Q-7i4tC<Xu$!;|mbQkSbsv;NhYrEt-ychtE=6*3GUm>mi@3NrlYVn?
zaWO(dLNI#tXdF9s4Ey)**9rE{oH+w8FE3<fX6k+ZmM&e2W5<pmARqvH_Uu7kUY_2u
zPMkP_W5<r+`0?X7cI+5{HYe`x-Md33lflKs1%7^hc<r^<@X05iVE69bu&}TIi^ak%
z#Z6Sqwt<b+A8+Pp#*7&=W^^$J5@r~_*nJGruZx(!ZCPFM<|H?~<vj*nyBMF0+*PTu
z^Waa&*moRFx9>39-<bFUqGrC@;n+=0O&B$56cQ5?nKzzUSy_mPh=5cog}1jifVRNG
z*Vh+?g@q6Z1P1%c%F4plty@uEUXH-PK+K#u6FYbA#JY9sFn#)TtXj3IQ^AB<t;UQQ
zGr(f8kdcvL@_wD=&o)7wHf<UX9z2Lyvt}VBB}MO~RI_5_=jVsS#6+#{)~;QP@4ovE
zFTL~<HgDbx0O;AXCwlkpjlFyKYPHp@HfVy3f`S6P_10UE%jH<IWC=n;L&4>8wf1Rh
zYQl^eGnn9m!{KNhmzS3pT3cHY5fOp7xVT4kS{O*xjJv-TLHTnQR98-;<>pniD%#R+
zEbSd()x!~8{xKY^=OwTi=JnW8WXj9SF>c&AWM^kXEEc1trUnra5vZ%HLq<l1!Dpqt
zdv;n{8jc=43Tta?gRby~+~+_4{Bx{dzaIJd`QUQ77&mSl!otE37#P^$vDekrp}4ph
zNl8ig>8GF2+S&?RTU)5rY787W5U#GS$jZusTCGMGD+}zI))gaqTcTH37Ff=c9_)m5
zz}*W!pnk0v0H7=XMLZjw|5(N`W5$e`zdTQ@I>XGLirnvi)$)XRbLp3K_4>_D_tVhW
zM4=yU)9Oq1?N1%<7aAI>rOu?$tk+lgDwD~y46caUiuv;L@+dGckdbW7&d$~;HuduI
zqE}vdh1hJimb#NEs8lKvi9~t}Paid{ca_w9<_O7m%%N+m#8msiFuJ_Zfi5p}pxO_H
z(Y00LHs{`xdmo#!jK&D6va*tdLLvG1_~@tu-7lls9*rY%dv&e+{Cx8F_a{qBOLB8_
zV+w>zN=k^$W>aZtDM_VLa&>hjS65eBvt|uBIyxFP{!^(`6c-n#RfMhaFUZKqFl-F?
zH^G=fQfg`{;}dfKy<SmKL2hnt<n8TE_4V~sQc^;EKEFeM3XS``rm$Y~cYCi0jR{_7
zoVa~_e2By05C8%|*4EZ!VPV1it@+G-p$pYSb|Y2Y<5N^qU$4Gb(EY)%$2N``GiJ>E
z)iDPWX6W3-tK>0zEi>_-^GPP%RzA4I-fiU_dhfHZnf_i5UPY(QUpClYCX<nqlM^Wv
z3R0<56d4(*Bky`Y8bzfae)xf6V`GWO<B?D(q_ng&qbf^PRaL~{aOmK{gXHPy$*4P-
zibh2$K0e;$eg2AQ9K|)B4;sZRH#awCQlFWbNgNKx-~>H1G}PdE`tipf$==?cxLhs`
z8#au3_UuW%zP`lea>?7<TkD!6BqW$5W15kXK^zW;-hKC7Vzb#=9t(MSc{)MO-vNa}
zK>~rmsDV~hRTYWFViJi&%<oT4P1OnjHBRLE9LM#MmX<~Wfq-&za}Bz|$Hm3zcuSay
zN~NNzsw&#Kb0>+#V(QYR3jrVtfQC3&P)%evlMMVGl-9e-d(Q9+9Uj{_X3Ur|^H;|l
zNSL8HpJXzV{x=qHdZ-{m!)@gq3i;qaOus?zZ_(TCeyLX<A0MOgu0;1FTe(~=+1S`n
zY-}te*=h>O$;l)Zi;1XhGR))gbj<9GQD0wA0)e2@uGxPTjLD~Jd^Vz@qB@jOb#ijj
zag%OOZf-6)Iy#brg9BMwT9S>84Fv=Q=&V91l}h6C`C9U(hIr?lcgWh>nwBnIs`H)3
z=*-wL{gqIuR3sLQDLg#fr1r_l$>iYRK*NU*C!tWN6;!3Brkd=xqG9gbxnyHwW6&!?
z;{jpJkgk1OjkGh5$0HVt#jHSBSXhvil@$RXOAFA?vuvp*vfHC|gTJ2^l{t_wW5$db
z6L>I<PBVWSzCUpRKUZ7=0CeqQjaBbXgDtD;L-%XT>Wbudr@^k94FKT$|GS0*Kb+QS
z7ZMVJ=;&zhcszJ{d4a`ZAwNGKY&Kh~U2}6Yva+(^>+6fbg9qc}$&<*;%!I$cKPoFL
z!RPZ$KDMZ+C^R-UV#}5-2nYy3MMVYpd_G)UT#%HM1hraibbk(qgZ%t_Y}~jJJ9q9h
z+V-!8TCGM<P!PPmz4hj|CnhFh;J|@MO-)5|axx<idp`>oE<{2?f<Z;B0|yRZ{rdHg
z%jLLr>lQ9vyok!mN(>!36u!Q`aCdiS3glTV7Lt>bv2fwS4v+if$&>i;#~+cKn~T}A
zXKP){n3xziIXNLBBBGOL#W;5_{D7PLK0?E15?ot37IpE%Q5QcP*H(^2!)FrQ*z+Fl
zUiblMHGW@pmY|>@u-R;+rly+Ip3molh|tv3gznwDGxaWYb#+*=Vui{5X!bdL_%L30
z;RWp8y<6`y!(y?JmX@Y-9SrqnZEcP6@^W0cas^$wbiu@l6CssKv1!vL*x1;>#>NJ-
zUhIY5-P+_iH4?CogZ6?4miCU1Z5%UZ%$WJBV-6&qayDoG!2GxGt0TetpCZ$vpjXfC
zcw^!V%->tu6><Z>s#U9?R;w{($`p(nHx6R4SVtA9xVRYe=FLODe*Lg<<3>!MJ{`5S
zwUA1s5R1i-N~LIOYBD;>ydP_8Yow*6Vd>JPXlQ7Fot+&L6BAKXRD{Ea55vX91&0nD
zGTH~1%SCo}HWn>fgsiMAlgI81Phx`l@y8#dv9S>;DJeSNH8nM1%9JVS+O;cWG8yL0
zn}-b>Ht4k5xpOD1t*v$ZBAT0<v1!vLxVX4r>C&YbGGqvzdFC0s^wLXMy?QlxJRX)W
zUyiD(D#XXfWB>mB=+mbU=FOW2fj|Hji-m35w&^`CFE1}NHZ~$ZKOdt;jY45zAsQMQ
z;N|6ohK2^FtyC&SX=$n6<L(r#YTWv61M1!%i2Ai&P#j!|JLe0bs`&*izh6Yl?-!w}
z`2}~*7ozF#I@GWALhbtlp~zbeQZ+x^*l1Hos;;g!$y24Vu@ON*L0GnI8IBw|f(sWe
zKr9wx)TmL|vSkYvE?kHO3l^9hj5jqk!QbB>-rn9gdh{roo0|<jf1aM6aC37*Qc{xE
z_Uh_tY}v8}At50cFkk>CO_~IiN`*Od=HTMRi@167CbF`!P+VM$xpU`Y^ytxe=9y>k
z@7IPieW<UVGwFCAgckX|KtdzCY{rZkGiLPgq?bg@JUOmjzo}Kn(9qcQ$j4CJYSya1
zxNxbhexa<aj5r()ef8B>#N~1+Jw2V-=hCH1l#q}>0)c?Z|2CF(q);eGC=^mcLPDpG
zEh;LCf`fx~ws$7oNmEp6O8SOLw5X`*Xd2bNH$ck)+1TewY(KjB?W%_^y4K{o>-){M
zwYB8x>Po@E!A#NasZ*zj$Kz3KY%J4GlZMnj<*Bx|mg3{%wdx-<wJQ1f`6QRiiO=Wj
zO_8aps-oD~SmJWIG-AXEa&U0as)4Dhsv?0vK#`G=dJE?@McA5J52Chf#%8lkN|n+_
z^O++$4%MCc)P3ke%9DE^Xl$akG$esQV6*^TLw<fflZtkKN>^D~84VgVi0tj{P3nuN
zEuG58$A<y}0+?-@x*<b#8uj({^z5_G(kGvMLczho#OL#g&*yB#VRrxkAOJ~3K~z(4
za4<=wQoZ+ENl6I}88U<%9UW=z+_|)R^=b+X45Y^0i<$E%-!aFeV}20+sBz4gF=OVh
zjyaHciuvkr88gA3m$d7#jk9e1US^yx_x!*Vh(<?8GsU_Jg@U9~DS3K&5{JW~$jC^&
zicN;7t*s@2K%f<nbc8~oARdpWx7b>tP*7}atV!xl8s(yg4JMxC1XVM!*LN;70fW9k
zt+uw7+}zyA&(Dt(3I)Z*#W6Yir%s)s(9lp~v)L3L9?q!xD3wZbb#<lW<YcBFO<>u6
z!rva1N<}i6jQaKKN8P%0qnMZ&lF4Mm<#M(9(MLu`264Gu%E`%Lw&_#;G6ltvRH~WZ
zLnn}v@0df%Q{RxP?ku%7E2y<uL8@z&q&)Qv$#=}5E3y4_uGfwIA9reOBK-<U`cNvB
z6crUkJRVQ0==}aRg9Z(v88c=Om&+xYOxEG}k&%%k5{Y!42hH;*l}d@I?S7I<rA*+^
zt5+}La=9dxN{tr0t5hnAkB=uuM@JF}1QZn&MJknw2~O`+ey?@jAB$pHi;8OF1~cP4
zOweb>j2Sb3cg%srQ%v;g-OL34>->|CZJhSfvQf!03J(vbF=NIMm&>IM8#Yj2U?6cg
z9P;t;(JR?%DiswK#N+X_CX5}Cot<s8D7d1c!X$Mk&70qjCU}PEXo7n8%CDrpUQO!j
z)pYmDua9(ss+rj9d!yW5M%Cc4|F1}X)TmL^yLWHezI{7+dU_I<%cX>b1RWKv;NW2L
z^Yhc`M=F()Kp-$GKU!a3PaF=1UVH5|vb40M=bwL`WHMQY_e@Di3GsM5t=||M8%tub
z*yQ_7{@-`C&U5X114wZs)uhR6>s=)&j-=|WH2uDHmPun15fv2`nG~>=m6egRvoi$-
z1{xJDh>wqFRF#T~ibx<3ke{EQLDjRw#6*MFr?$41Qc_Z=d-v|-=;)}m;-Co}L?RIr
zXy~J&qJo4%Ax)e(kzRc9MMh>hBO`+(5=mR57M0dLuQ-xw^jtg$w~90F6<SC4er)o}
zX3Ur|^LM};NIb=~S5-RwTj$=)c7`kUjm$V>yu--e-kuyB9H>v9J|q+hDK$0KsAOwr
zC@CrF^y+}0pPyEGjy_CDchbD&HuT2T(4_83Pf&w{gUQFoM`ycKDrM4-IzpjPQ19No
z$;!%#1OfqNWMt?K&eGG<jRp&$p`m(%jP^{MHjQj;ZRzmg!<3nsNg|PmxLhv9#>N_b
z+pSqW(WGaoR4VfH^rV=W7^Y20NeR{0*He6ayw)3f#gSC4^IM-f`GHh}TALNruwi<q
z13yiWY;4s)rBYF1Vj^)koDNqPH2t-I?vzR;MMg&I4aPGwGquv*YHMpLGc%LI!^24+
z5D=HkrGS6{ij9pW4u_*RZA_B}sP9>CFGpKgSf~~7xw^V)-Gev3U8VJ`JW}<h7M0ej
z;EkLQA6?&O%$PCrH^dxBJjJ}eAdQ*eKZyC9soc4%B4N;{G+@j$f`tWj?b?+VFJAn>
zZ|^%IFE6iCs{<MdT0?0y8ca!d(!5pImomfUa&;!qPkMr?F`c{rxZ>jCh|lMDcn)i8
zYbh=+j(Ya&Nj-Y>pvcHb9S;W$_j^<5L#b4fo12@#bfuV>7#ccsC=DDqP-~1+r%o|r
zOC%D?$;r`seH01>1q1|;NF<`#+FHgmPxJOWAt8aHqM|4vA%WuJ;)tj%<*fZ`(RJzD
zL@f`tYDPpvEh?Sh(OCM7CT%D+)$rT*s;Vjy3WX$*NKBG3_Vn~Lm<E`ipU<o)$mMb>
zEG(oRJ$g`5Qj$*Kkd~IFbB`E%{^H`|wCa*BUAjcx-rgh>3iV1j=jP^;tE;Qlw${5!
zt;v4F7jHb=^=QZMTW4tnDUZ{u!i*U+X8sPC1Bs`Y_U_Yv#8{TrUC6@1lK%P6e^O**
zBqb*&Q+9SXm6ers$^q9DGBPrV&*z(*1D~3jN<yK~q_!QUJ88`F6bc1pXJ<1LXHQR0
zt;z3`o}lWR*sD}33JeU?GM>{%Sy>t5B0gu%92zoY2y-rSa&m~xW^1LfXuK&5c@DIv
zs;Y{(T&~u+(iq~2L?WuMuczGHTyl1H)(IArN+n69QgU;1BOZ@O@$vC`C)V-t@x<rz
z>C~xHl$V!BmX?;3mX^khy=~jJwu0jO-cZ-4PJT3#))o~teDTJ;No(9-y(>_fLgx0X
zCijz`o=#jY*Jz;8o{WqP5{X1c+f-Iol81)}b?@GtEG;d`&d$zY;9zJBeF3$`TOvO{
zpQ&+4NJuc4UKSM<r8iYkd2+ATecrfx@k3vi_6628k=^Llj~(BuX3Ur|^R#0QB%Wga
z=oJa)Ns(m#>~l11*f8deZ(v{`357!9a=FB2v&q%fm3(}BC@Lz7Qc_ZwK*Lzxydg9O
zWTxz^QmL3UD^oF+?i3dnM<S7kGBPrl03|*?{$9$)6P}>zGo6#m<s=r1$;ZdX;5p0A
z&L*)~Ok6IP5)%_iE|*hUTAEI3R9RUWak*TIi;E+bN<|Whgn8?43c0ztOfhtAZ7qpJ
zBJ%U|(@K}}_V#9+ne|apQbOV3;lyUM$;Zb>$AMduu9K6KL+`%(E?HY!)33k&N+OYn
z)~{brZf<VWbTsX;rO~uDE40&S?ps09C?pw5^{TJ0CvR_Wa&vPtdG$>$mlKc2(^(ag
z%jJ}voz1K`XjXQ*ckj-uG<EhFOiWB9p-`x^Uv_pj_2|)qh7KKS(9qBnZtVY9YvSMV
z#TyTHeOgpnD-ld!V#bUaGiEx(f{5rzOVFBmGR%t4Kt)v@0N~3HgD`9W_pyvq+i(NZ
z-u(gq(1+6#uaD@8MT-_;?%cVEi;H7)@SB^PQC(fld^9Fyn!kZIQ!UM>fB*hkf7{vF
z>5RQ_;X<4^aRPaHc^&HQmzS5r!@~n*Wo6*;cqaX}rluyWSg`^dHf+F>B})(!6NARa
zM%dZeVd>JPC@(LELZLuRObqPo?67g;Mr3Da<JNZ@&?t)r(56%G_`xr*u+csK2Z8Q1
z;o8cVpsv3F0I;9*9(w%qedc?OcZZXc6JtVFU0sbylP1B_(-SEvDO%@B<NvU3-8$IW
z*&#YQ8UX<Tu(q~FV`C$R4I75S!a_JXIcXh7U0od}O_~I?T8$n(df@2Mqa9v@_AFn%
z9Q*d|LsL@|e0_b9n3$;bePv}O#*G_?ii!#y1H<+-H8o+|wr$wBaU&WV8xa;3hTz~}
zaJgKZIB^2LzP<<x3qw{`7A{=4fE6oN;ONn#ICA6&PW{`SF+S@#Z6)kHB27MiQ@DM6
z8|2%<005S@J;7b^8!WoCnfT3{HxDOHoIrklzRr2uvu6(?A|enL7N+$Kbwor&1lVjg
zmMmF<f`S4ZJ$e)c1qG<Cu7+4F#`y8$Ar_0_<m800W5?o+H{L*GWF%(Ko{bYHP9P&A
z145zD<lnb&;X<4_a|Ss%Ik2|2MnORVLPA2oVzDrN`gDB!@y90jr4RXk-ofpXd!~@q
z&kln9#Kq|59spQ&a86p)xLvXnii4jr&k6w8y86N)WJ|~Un=xa?j2V~%iKm#DHDBTT
z6K($kT{>$bUKfveEaMz0Ig9sG_W}UipYM;)mi!BKb#<6GZyw6a%ORCYO`4oEH8n9o
zMP+3rE?&H-6?m{%EWLro+O=!Zty?#I_0?A$j<Iy<QdCw}LMD@S>Nl2`mm?w~0u2of
z@bK_JUS1xuv$OHxhaaN8z8*C-H7G7F#^Aw&A(zWh_x`{qHbGs!d^rvtJcz==LRec{
zqqMXXzP`R#uwVgVVq%y+YHDh*e*JoE*suX&u^0;$EPz-n)*2@wA_5!^2MGxYdXFPJ
zI~y}*%)rQzBe8$~esDM(lYhgpW5?j>>4}$Lei?@kAJ*Gu>C&ZWYHBjsmASaM7#lZk
zL{?T7oSmH!5fOpcUVDvkOwY;5!GHk+aOu(|P>TwMes|Hs#sZdhy}<qG9CHpI8Lev6
z#SdqklsS?6U^CPMt5&VT=FOW?R8*uDBsDcPVcxuXC@wBG`MCkwOzFP(;tM1uCgQp0
zp2Kgy{RWXpgozU;LM#?*Ih3o_YD}6m34A^u>FMdr_N=Td%$qk4fq{WWUCY~}R;w{%
z#thin+QQM%5j%J8gj6bptE($qTwIW!pAUgRVCvb@%gt|AK#}{2);244U)YZFh3&|x
zuzGe7V=C8j^D0{EFF<+nYbeXIwH&Mgz|JEQJ$+V~g9tNb%$PBiC%YhG=1C&^_9rH_
zDSGwp$2QLLw0&AW679*(&L%#e|3Ik|_am3fsjRGwWHK2gCnr;6WF&ced(-pJKTlRx
zR@A+FcM=MP6c`vtadB~!o}Ny5d3kjH{COrvTVtr!8420;Xgmwt-QCH-!GSh!-b{Xe
ze$>Bze@abFC1+=6`sLt`KU@pH`OFa_(lwpS&d%2H5GW}rp@4t@va_?J$jC^&MX*F|
z1<rgv-{5uAcvBoYbcjirF*OB8CX*3|!=ar!cN(p&(4^{gws2oAms6iUeaOPXg1U9<
zMvE6OCVzi_8Z~MZSy@@pkRd~8KpzMC=3lHo-2Ci*g(MAyg@q<RE1FcLsHiA%b#)~>
zJ3H#xvnRd%_S;lcRAf~0HaIw#Boc|<Hkx!QXJ==V(~^!KKTh4cb))B>e_pE=Dm^`&
z#A2~YeRPEK<X)}&y|bU%_Xe12BFvaEW99)c2NF*)?PXbCnYD%#x0)aM8239{pSyTf
zr;S`Lr||Ibhnm25cpU#T!HbNHq|D4rN=!_o@bGYwNF?Os<V4oi*2LrSNF)-`tFOLF
zJ$m$@4gbHr`wxq%PWuP`=7%!ah@+xTIh(jnH5MjrW5J3wY_P&3KEkF?xT1mKS6uKJ
zf0iant{E8;a*Zsy*g`vO=we|(qG3V{28AvtBv_cZQh<yx%IJ*FVeaoAJac6D{bNAQ
z&+EFnE@$SP&p9*0Tz&3yKKFg^-Aj3SdEJ&2Z7(u1l9n%DPJj5rA4n(^(%7+MDKs>c
zX3UsDLZOgCLqq8=%7DAlowt3{Ih9I95{ZNg3JS<*G*V_}CSOX`od3`rZ*T7|`%84z
zbS^eFwpXQjV`5@REEe+<)t;KwB_}77x3_n<W48DG_uo@xWhLe2=F+2&K1wz=Hhci#
z<m5y)Ha0X;U{Cve9a@vt%a8PF{Jv=0WGyRV28l!>i%GiCXr%S)*LVB-Xl`z%oSYns
zz`@tomttaKsHmuj;^N{uE%Do4R8$nn<?<c_6?19e=;-J!gA$|BNU^c8<m~KBsi~=*
zR-Wpqw?to<ZtLmVXK&F@8y@a;0P*9x@pLU~8>`O5FbvaAERcA>E!mvPPx6yLF0}gi
z$sZT;<1bj>eb?!Nf&!AsWE316Y_+};ZPnG)kwhZt^6K{G%a^I3pn%kBHBFyBom^dA
zNuf}Xi;D{ZAQu-GQYaJ@5)wku(b1$<tEr%%z~ajB#fujyHa3<N3I&ZEIg-YX9ZLd%
zfF@6#%y;(<_K@7Esx(9s)c?dh&o`YjPfTSp8J#(EhT`MnNh+0+TrMZITHUJ#Z5bIE
z-B!8ks_9&2W@eWS?u<qwf9In8)%c#8)yd`ZJ_Vu4$;ss6;z9y}fLvW&$;-=&#*Q6J
zwzjrpYimmY2mpo87)G^`Bgj~PzSm>-6?e6UY9mKb{$c?+3G6JA!b?j_$<58JL!&rz
z;IMJyMsjy|C!tVC3Wb8UZ{ObGj>F~4mpi?~(VqD;>20O6%a<>cLZKixH@6OVgf3pZ
zNS>aa<n8Tk(R-qOFO2SbOZ1oNww?@CC#dPeKhc$43aZ;Wm3~|^hJIW#hU&IXr7OD>
zt&JYfe9D^5F$}{D5DO$8a9^JKj-TjzuSg(`R%f-bo37s^?-dFB_}TyJzE1;D>y_-N
zs3;PP#ocyO?l1GirMoWGM0YwUmz0$7&t1HDk@E8LC^<QquQ=uD=}8iagzW9@Nh+0+
zx3@Qig@w`f?b~VJzI_xO9ZfT5&LkTf8?v#nApj&DC*UXew}1N9>hICaJVC9E96>Kn
zAH`Q=TCiXN$>nldv0??^QM@k={LIV0+I}`|_0)9E+%zycI+}m3xw)DA{r$<?+q=vC
zx(ZH+T7yujRNCt<)iE(Kv~lA`dj0j+Y1y)6^!wlco}PN@DgJJRIgpq%%7$tqM_9M%
zSv#iNda8{aL1EMFDgO5l@z0y@;HcH=E(3??=xEBz%j>c;J5g)H#jg5tm}O;UkytG5
zS8o@UN=44j&J-IPOGcxSl9Q9k+1a_%3TWovU)#U8_Pr$-hGCfd2TQhQur%reeE**-
z0D!5J#Yo)rG8_fN2Q+3&iwXbx?mzMG%F6%%$%N53@Xj*W+1d7L|FW_&K9N_YQo+T=
zWkBcCR$*Zw7A{<ftgI}^<?=4K+rNK55)%_qQc}`mRUD4v@cHMT<HHX>gjTD?wQJX)
z)oS_w^m;v7T3P@A!|iNvIz)icjy4c)I|sWlldSgM+9IO?Kdl{$zn$gq*D?-ipPs<V
zl`EmuYN6BVuyEl*EM2-3lP29czD}ouMx*I=T(w$_hK2^LUcDN%wY3(n)zs7=E-nrm
zH*Unli4!}#W_JDhb^PNW|G*=UJOVE-FQliZLo60!-n@CRwY5b<Ljw#3gT?+WEiL%$
zv(NDBU;i4euCDy^8jS`zoet;Dor6#)#G{Ws+U2>M-(N#R1N3@5Y;A2}V`BpVFqupM
z06RN7a2y8!c;Q!e_{V$)JhH37YE`w`Gk;I&3JynpAWZ-770A!e2NB`<=buMuX(=iy
zDj=83`Kn6p?(V%xc0PLaC^l`{)a~E!sZ*!m=jVsa%uINCdiLu*)YQ~q;lhQuaNz<Z
z5()nK&wqBAL~Z{4nG>xI1_P!|n}+1%<PORF48t(Yy^RGD3@WOBLimn!w6wHNq<%N^
z2}CXT?RPNI(qh8azhvV?$$0>Pot-V>*Dt`#r}{Qw<~R<!ckf1ATpTuU-i+|@@II9f
z?atxDhp}qaD&*$oc3U;Z%gYOM=gzgLX4IAX`g-i$ySKyhI-L$DPoBi7Q>WnK;)3ad
zD~NlZgS{;v-u@lzL=!t1%?eB$epHUae;qWS@~R0O*}%re2BSue!pM;$VQbqls1pbT
z5R1Dm1AOb&Eu21m8gjWDBSws{D3fb27?7Qvjc1;D29qaG?y#>!B7vQq9sl_D?b}eR
z)u^wp$8*m;2XAk0{xz{!-04JFqtRg7wrz-rh~U3Bkw^rQNQB15MudllBRM%4W5$f>
z^!$ZFA)K9^ar5R)I5;?1oDTq;Jb4nUR;@x)Qxlv7cK9M_I35<-V8Yh3upc+2%g<#X
zT7JHS`sgQ7e#L~SuWV3OcN->?33hgN7(IG4JUl$$@9&S<vuF3I!jZvXz|^Tzk)EF3
zWp$^Tni_a`ctE96VZnk0{eBPG+1XgWd^ucQT~St6hUn;ML`HU9iR{p!L)frk1B!}@
zAQp>p{P=OKTD1zLrKP<JkQjzxn0v%sy&uBdGd}*J)S}aM*tWEOEpuwVVW2;~oo+E!
z`$|oHb@Adw^7i&7cX#)GExqVUQc_Z<-FMrntgIwwXXid8T$>dX6i`r55Q#)0ij0ip
z&%I%Xd`Ooz&6C=btqo}S@ZmIP&YTX7+4>?lIJnbgGW}^fmz$eQB9Vv`3I)kzvM#Gb
zwP&t8)!FwJ9UV<!VPU;K2eabhVwygEI@#IT(F-rUKq8TdJ_wsJq`52skK56>k;5q|
zDT!a+Rasd{DJdxw9v)7vuCDx2w3wI}Dkv!Ec1crIR1}4Whj;mUV`C%9WHO46kMH-n
zH#av^SXdZIrBW&?D&o)C&CQJz3PrcSoA~&6a&>j(-)nGiu*GsWhG7`y-p2w7h8Lgq
zg+&11y&{1!K0i$y*V5y@9M?jh<ej0pk%<;#Z2znECSbj(6w_DH(b1iD-)+B*udi>f
z#?$Ndl$@MQZf<UTm74ZrHzv#((h2Ie*~95T*wduf>q(_jkyI)rS65d`PEPK2BHCVe
zc?i+b(d6mr+3WAc{9Wed<q^@HN=?1Z)#&PYJ>_q-Wv*1^>gr0vhYzP`pM92UYHBDf
zER4d#!#h;H8Z74HoDFlNMs?Q{f1=h3XE`}J6crUk-rn9M5{by&-JMpiUQHPp8GLYM
z&PC{|@|Iq&Cr?k$J_Ua5bytqoXf#rEbTm0TJ9k@^Y5n^3q);fxXf#q|V`IPbG}^mW
zeUh$aZKKA7IaI&hjecA=o_<_6p6a(vqsD|eq|Mw!x2jKCr<**(Fw6stEp1{f96WX!
zsss7_GA95SKV~G{pPr28e<Out!f1>i-MUu%>a`oVRQEHA%WLqj)8FID&&?KN{lAwy
z5jx+)s^_QCXs~kS%04x+>&eQMD^XKZ!*}0p&tNcM#*7(=j*do9P*AsHEnK(|27>_+
z5fSk9_3d<<YahQ3UEUr5z(c<cfoM_UfZs!3k8}9&VI(FdqN1V#D^{#PczAfXOPV;2
zgNKI)wr}6w;e8!FdK96dp(rga?RE^aEnBuAEiDZ>IXM<fb<7RVdb7;N+?`t{lOaAn
z-r}_b2M!=HF%bm?1)c7z)9Lt5-Fm$q0)YT&X=(8E^u(b<hp=VK7L=5fV0gn>H175R
zfFWy0H+J~}2%etT>)knyLq$ae3JVKy^5jVr7Z(EnZrr#5KR-XLS+fSNuC5k;*XAa1
z0Fa)Z-sk0l9LMqBVNy~O{QdpA+_tQ&42u>mf>bI+Qc_Z<9pe`*S_F>ckdcvr)YMdb
z@WBVj%ggK2IROAn9BvfuNAt0F`DTwju@#Pm@OMfG6%p3|ZW)GQ9sn$mU^*!I_7dJr
z%|&fPQ@{3?Oc;&Ti@h+*ZE)6<1FdVaSFKtFe}8|(#Kb@-?0+IG$8lJ=a3O?3A=GMh
zr`wnlL@O&REjkVN$L$MW-7^!^va&KHBqZSQ;lo(4U;&g$r9~pM+5Y|e@zF;gAtxut
z;`y4I8qAzI6B!v9JtoR>9EZ@*P*hb_AuB7Z)1afcxR~#<y>a8lZpYJTG?+PaCSqb@
zIs|yLXU|4NM1;ljH8nLzOiV;tS{nTQ{V{gzSct`9L`Fu!-rgRywY8WrV+L|_b6Yz-
zn>f^M{xwXxs{jVS1G$ZZ5D&*(8t~sjLP7$Plat}&<AdVjVpLUCK`xiW-Q69}J@*`r
z965sW@^a+l<n;M>Q&CZYB}<m@fkAINl^YBOKJe%)NHllSc6D_{e0)5-yu9$rE3Y6V
zB&65pb?bZ{v<H>o8ZY$e{g~O0n}SgRJNgvFF$}{nERbNj(9&W;=7}<-ep-yH*KYJ`
zAJIrhEb^O)pgGTA_%Q1vMR!N5)ndz*Ey&K!hDxRC_R45abUGdU{QThV?vB{l*iN@u
zzI-_VAUQd?-^T%PPfk$l>+6x2n25c5_d+h0L#b5qcOJA_Ev8PLih_ayNTpJKAA`XF
z4-XG4Uc9)+WOS`oi@?A@h(sc&)#`31ur)O`@bmM7r>7^9l9IZ;Vs5TDl$V!h5df8y
zl_4-N5S5jcC@U*NTwENAi;MB<tFLx?_l4s)`1tsANUU$pjl=a%w*mm{oF-tx*0a{D
z-els?@YZkm$?wQHufxfI>wtzde^=&;NI>iNbn4V86c!fZ!w)~ixpU|6_~Vab)~s2W
zHER~!-Q9bY#Jy|RF2u#fAtolKPm_GJ;^JZ~TC@mqxx7OVqSNUxd-iO+^2#gl_4S31
zj}J;qOM4Zl=<@d9+TqQBiQ}KM6^@1D)AJyh<`4UEQ(z~01OU)-y#ZXqcQBM^Lw`1l
z{|%ar^m_wN|FyZ#?~P#?=0U{*38qJ9zN^L8<uy3-T`jI^Z{SLk4gfHA)I%6QMu@4C
z#hCpYDO{&K((CfB)>K$nh~>+dLoSyiK0dxzlaJ15G#bpFJsT@ltibBkt2?}|)oStB
zV~-7}Os3hrIzcrU3`k8)MM6RX?CtHLR4Vc9x8Fh_5FjQd#$wyh&`{`fI%H&IbUUUw
zF!1*FMtppHua?s2bUMtNHxKsq_Q=f4>^AV&zkfgC;^I(JQo?V?aU6VoeR2N$d5A<J
zD3wYC2M2dq5$K(F-oY1Ne1Y8DT#M()Xuy@2XZg=k@bo;4eKifR9eAMJ^!HbBv*ZAP
z*1v)AQKhhT95tXZmoHxqu~>}l+qZXk?a-k^ShHpg^78V)aU6<^i}Cf>U!$<F5Vf_n
zP$(35?z!jS?(S|;UbeQj7E6{a0RW_=qztGOvrebOrcIl0=+Ge~CnsA3|Mm6t@bK_J
zY-}tlDk^a4(j}y%qyPY_tE-Wnoeg&ZpCDl0cXx<HB0liZW~{@Ff8D8+X6G~kLhrSB
z$TO_RJ3C}F;6~wo=#IZ<u@q{=%pi<j`hLIPBf~Jv1Lf|eXE2QQSgVoU<;#~lbl+_&
zJw2UdGTDHWy-m0ERKIN+pUkWI>&sS4{QUWYW&F5xZ%n3^o7#Sjla-Z49v&WKXJ<#R
zzy7*Km871U&Y6{zl#oOs>9HYNXN*Q8g@lB3+UdGIbF;dprY4Gyk0%!w7xMD*qS2#A
z_p0KSySsar$Izeol>a<yBS(<-qt^!fUA0Z*u8kZ)H@@k-+j?IV6%~<GD(y6ZzM!C>
zLxaV(I!oe~%jM+j>q{b$h@zsR27G>P<>lp(L?WS(kPwT6@XE?cl1L<U?AS4q$z=5A
zn{QHMV<VN9my?^D8-;{~@X6cFCsY=nVWVnpzZwUc49%q3`;x_2*FJm8T5pwM80Hs^
z1rp3JN_lxXxx2fQzrTOKO17HE5Q#)xRuJ;_^|eYJ7gRR@03Q@dL_t)U%KKr0>g(%E
zTeohdkdP1(i9{3@7DfjS93W?BXDTo6zEgQ-W+sWn;x2=--rBx>JBh{OZYwcWR8-Ko
zapUNrhaRG^urU7IVq;?|C@5$^$0s7X_Sst&pR4AtFZZw8b&Js=(Br@N0Wunm<m&3$
zX=z_`1*fd6tX_{-S64^g-rgjUNNCQSIppHvLM|>Y6ciLh@$vCgT3R~bV7jTPi9$j`
zNFtH&)w_sVgC4P1On>{^-)PjRQG8`7kw`>~7cZvd<YY2bouJzPb>ct6t0}Jx?6=cm
zq^5tawfJ82XFeU!`(qe}c@VHbg89WU8jTbmA5UVjm{clNza~5d1qCD$i8`GuU%Ysc
zL?V$@%2eLV6V$A%ERxIR{NuX1I$FDSE!o-G(X?sPx}BJ+R4S54B)u-@+LQG3baHlf
zrp(Mti{}dp3Me2TfFu$LDV0hZGiHp%F^xteNu^S&oJaf5w|?6+x>2m|-2}G9NH>br
z7I&d)BS+BH{fn(~C#tJ}sjjY$q*5s*B_;KGtel)2a&d8?_3PJL{C4W<>L?>4gI2Fz
zP44dQd=HSQs3^+H%IdPzY)`VXvdG!lnJ*)oo}NydH*Y41L_&Ukel%jl2x@9-B2Q1x
z)?O1^w^)3RjjFlUxtrHwB+Xx6zH>J(>M=6i?tOV=hGCco5zCQaez9t5YOr$UN@%rO
zq@<+usVgvWXH9uQK|zOg;k$P2!e^g-*1s~9?X+Dh542X089C=QjF=hJ^ICiphnpn_
z(0uG&i;6XlZh;sRn%eKR{04&o)22;>TCL_w?3zoiN~KavpFSN42?^jh4oamGAt50U
z2n66b4x2V@LUwjGva+%)lCuY@u&@w|7A?Z6RjcsmqmLpkE)E8R!6N^mvr@E2j~>OQ
zO`A|sQZnGq=+}?zKy%L97SGv<Cc<$>ARMR9hu!FjupK!80AOlvKugn)(4YAP`qE6k
zf|i-kD-xpub__V*qNb(>vuDpnQBjdac~zZG2QM!#`1<;GnlsU!Ie#HLI~!`Xy2m`A
zwn^OPTnn*S40m_;J|%Gjcgi}SI&})~yz>s$uU`*8KR@K>=cBf^7R#0`!?0n)P+3`t
z-#l!O2x05*&f57!bW4XTJAZp8zlbGYGYrFYiv<$QFJ5YDDmHD}gcU1RASx=VPm{^r
zyLV&XzI`YtD6mN4<~R;BXU^m&(F4`v1a;gL*g3UMP+P7ypr!G`piWTVdFLH``|Y<D
z<#6A8^GzH(b_@jt1^j1t^ypC}BqZR}sZ&_CY#Gj-I|r>+i_FZ-ekZ+mMXS|f$BrG?
zy?Zwve)wS|B_(0*+_@dLd-KgV@#U9aA~!deKTkhDKfLtPO9%@K8}NA;&SpWIv981C
z-dlD~6W|o^c59$$1%ZKqc;ST?ED8j09A{A_t0%?9#Rv@zg}b{uR4P@!%PCh^SMz~I
zad9zfYHGSn;_l40ZQJnPd+%ZK;>9>|;sjh=Tu@b2g}S;r?Afyid-m*s&#3=k&Gg#<
z2EXE&t>Y+&cl^M5OfU??bb$pD%mYEA(O}i8RVXVf>vJQ!4I4I~xVX4O-TmU?V$7R2
z50#abR+%*4D-+cE`g+WmF{8s({m{@*l$4Zo+Egq*KOc)0EyB+~|BRPkei>`mu5Inb
zU<K9H)ksK4Kw4TF7A#nRrAwFMjW^zaNF+jfdU}URuldf2tE($t%D1Yj3O+tQC@(J`
za32t$wc<~6ZX9mpC&Hw^)~kJN9E1=mA|QNGIpFF{W`_?S#*Q63P*hZ85g;#Lz8p0*
zHOR@y={9iYI1X>U^%nN++lQp2Bm@KmSmnITv|25Si;GcQT#S<^PvX?6Q;<rf@bvWL
z?^>Auo@#4r@!osyAv-%88jS`cMvQ=?qa&Q0obc_p-$J2K;M6z8c;&I1So`d-A?v~7
z9GMM=C%mkC42EHtUkDaRFb|aeHnLl?WC>sDwC%)f)v8s{YPG$(>f0Ol!UQ!mG!#>&
zOhHss6o5NT=hD;D;qC3+Vf(78D$JWVk8fzVckf>8+qVy{uC7ojmHqDTk)NNBgoFeX
z7Z)QUA_8GyVSHd?Zf;jmQGuMCoDO{<%+2azV`KRSXd5<c0Dvz0g!Bg)4Y>V75%m8)
z1mjQV&~m*2rsmdCqP8O^z|Ls`hCT8m1W)<GVXBW+C%rnI4l`!VuvmTu0B^nZ77iXf
zh@zsRZvVcks;aPL$r6agVx**`Sp5!CSIWxDES5t7fV;apCQX`zs;VlSK7AUuZ{Nm^
z8#iDu7%*<!IG9W(G&VNE&ejI=rr1FBdxyK$6`o-jhH2yOrDrhA-O=3KOp%e1<l^Ge
z>q<68qmg`leJLy~tixCmiKNqNIRjz3ttUg(32OTAPjqFMg6g(Tr61Rfp&!?bp}MV8
z>B=qzHGTLe(x3U%stKX(ONi?AdUA7fqnMbOPPaE#*lC~4tJmu(IXRhJU0q2glTlJq
zQm17}+tcgyl#-G{Zf<Vm=H^BzDJk9V7abi<VzHP?OG`VvR#H+z&d$z!QhZZW6N$xQ
z`u_XxdpwW(!N!dnDKawB;yJZiO=7XwqEv5ZR4P@c-`m|#S64@wnVB?e)-1BOw<kM0
zI~qTJJU#j3lOz-h$;QTpY;A1`00E#E9<^(&s#Jbt(9Y>r^+`VI`pPcFpdE){80LP*
z0tx1URa8_&GMS8mgM+EDv9ZVPo12?SE|+&G{hFDXNiHrfy_zWB>)hSlEh;00goIE)
zKtQM4nky;w6h!6Z<dDC=KRG))Q&dz`r<2^q#zwx(tG~ZL<>u!0`kd8jHHk!`PJ=>o
zFk|j_k(``NzP`S_9{XNZUS3WTiNvB(Qf_W;kJZF3U%pJfzP{w{?%wb6$b+G|xtSCS
z1-<aX3*_bHMN+AhoSdA<*4CEn?Ci+K#)c0hT*ui`ZR7|t)}J4=^Wm=6+^OEQb?TrU
zhhZ4ze#Zg{=7FZy>-nqNy=i1uS69bhVQ(uSAb>V*+&EaLIV4h2Qpnren}3{~oJ>-w
zw9}?@F)=Y+-U;YRWo0FWhli6$B%+Xz5GpM#wRkQ(JiOl}b-TJVLev@znM<P@jYe{F
zbF=y#q@m{N=}GD7cY1`Fd!MxJ$IxCzMg}=MJ5x+d%z%4942F`D63WZVBehyhDJdxw
z9UV;(5fSwG<ByY_ogD!n8-RZ0WJ9%)Bl=e+xtC10^?V@l<C-ypb{vLbnEM?IBp8PJ
z*2vD>eYb6+wab?;lSm}$)5Q8-($v&M5{ZPL$eWi1weO>0G#V*9Je*uzU3=^{-Id11
zMq0XbDLFVe(D32I>5qT>W3TQA^`x@0lB7~;hyDl6&CTTI=0@@H@kG?xRoNQd$?ulr
z<YbG0@ABo#Bo>P;0*khqnwls$IGAKI*?sZ%dHM2X+P-}|$z(DbK72R{1OggAemnu7
zxsN+g&7VfFK!RZy<{n{tH}f+X=3e3I>WYGb0=)R*i}3L9z@9yOz;Rrs+sb4zWM*b!
z)v8r|vZzEN!S?Ojv2x|gF88~a?cBK&0RaJ!$z;%IG+4NBA>!lX;p*zjZ==)cFmK*G
zR99Db=vmMk27>|n_wR?7mlw{SJqwjeg*|)r;M}=${AX@382bGlWHK2F3JOqMT#SVa
z7ec4g0RV(TAu=*Duw%y#6c!djp-{lh%?*3@?CJNh?iP(kgDqROASo#cK<jtn<KqLR
zQi-6Tj@7#I^Ybxn+B7&jJEOF;)M}NqtgWV|2Cu#L8YWDbfJu`kAvQJ^lO|2VzJ2>p
zUS5vh{`R+6uwVi9EqV<0|M!2bmg^0Jc0T5Wc>sK05QbqGrXyChiDBBQsj0!LRjZ)U
zXu54=cl78{ELpMy1qB6=$z<R-4zp*^#^S|`5g9q~+V;0Ed<8@0aoqmlE12}xV7l2_
z#mRQWDA+oV!mvkw1IKCp7(V&g0riZiuC9icmlw**%OMmB`KEI!m5Se{zP=uQetvLs
zb3<}+a-Vu})YsSZm7L^qIh0Cehw4wqj~_=uLIMg43lSb34y97rp%PPX84L!5hK8cL
zx*AzoS^PNJ+1XgWd^t)>OJOh=;Njtc^78T_t5#$Up`oFeG-(pveDh6k90wmCAIM}f
zKCmz|7!267X%h||Is~;^4TVB+cTTtqH8nNJ&(Ft~Uw(=F{Co%m0zCE9Q+VQuC$Mtm
zN<K){>2&b(^MhC{MtXWWw14r(t?vr}0Ap7ig22^pP|ol6g|E=K+XnzJ+~rw}TQ~5=
zlMKT!zeFsMV3;nXrKMrRh7H{|vP(-#<GUt{#bT6|mBGiy2c@N@eZFE305Ea5QMez?
z$KLJr6<1r~SO|ZogisODukxbv=FP+0xpNU79^Prwxr&Mk`1$$qpF?j|R8$}#ApwUD
z9YRo05R^(~kDZRIs;c;&5di@KShsFnzptWi*|G(xsj0}#&E=1~Wy=;678W8mHy7Ks
zZG%Rm=`acJtDy?`3JVJn8XAi7@^T0S0xVjz2nK_pLrLPYvN9}LvIK5!ZcwRIR_U8D
zQ0)T;08l6tc;ST?;O*_*>2JjxM9AfG#Ky+L-rj!5%CfTZuMER5y~6?thUtbzqrsXr
zYjEn+sV*DY?b@{q@4x>(N=ix~6bi9n!v<7WS0ghsvrosmbv_T;gGz9X7y5Os_T#2t
zRKN}ho}Sn1eU2VI$_GNnk00;Qbnf`^<5;+GAyg_Af`fy5HD-2pHWCsNP*G8Vh=>S;
zhllt1s=r2~!T$aGk&uu8nM?+yQrWL&X{o8HShHpgGBPsY?d=VY<M=x(+qZAW)TvXE
znVH%5U}cB{K91usZQ3-bR4RCTdt=k4O~}vBM{aH|-z$RSIPBWB3vqFANJ>iL`)Aw@
z-31N`g#s=vF5T|mHi(FikLRCnd#7Ni8q$qjexOgkDTZN~2MG%#7^WApv$L^g%^LXn
z`gYpL&Kzvy=H>zbrcRxT`1tr<PkwcIdvNXWX25hOzrt2H7LHHPgJ7CJ?8i-ko#+t&
zt!u-%hVNh~&xZbN7EHRU7GsU{djn4YwYkS*nkT2p$;psNBpsU0rKYB0!-fsW$jIn%
zX^g>OKx%3#5)u+15D2ht-8w8-umA$Vz$SSd$Kk+%1Bi=@gHES|QmI5(SXiIN&Ck!r
z!i5VF6BC25urO#e8qAn61M%_kFc=JY|NZxom)HBHD|aK{d*_{Z@a?zXLakO~&z?O<
zOiV;xULL<}tEQ#~ixw?{NF?IF&!JRbUyuC!d>lJ=tY3jcTUxCa^XAR#5JUg~OdRSq
z|C;}sAN7Zw5PA)K8DU#DzfMC_+6n-z%^n|)xn%udg<%-xm*Vc_c{9xY#oWkFDwTHV
zSzt68X~BX8v|zykG8&DPlaoUdiKNrgsqL#BHT`ofUm>P8as<`AF`1fAsCw0C&U9N(
z%_me;_r_$4F@FAFS&#e1#>P@mP*A5$=c1yb$i>B_$8xN7b#)XK6-Ca@&J++3&~5qA
zfy&Fvqkw<_5{X2#apT4wo36E0Sy@RgE-rkD-jb3MzUM;wQmWl)KB1!8|8=tXtbf}0
ztJda#<wwX^f1XT+W-=L?$#|uj^yNpW>BB$KPaA(_u}^K}2)g#!TfI8w#fumDCUcpY
znHJTxh+3;SiN#`4sZ_oGJO-++u8z{v(<wYWoMbW?iN#_H3JRj6q@;eA@HHzaDCn{Q
zA`#K`&v#k;R;*gRsl`b3+os+5j<U8{Z)}EPm|q}vM}lGcsJOTop`oGt6;t!F9ggGR
z<>ke%O<%NV5uBZ!`K0Ci{Cv2$xWLE92j74HJ%Ina6Y=ru{MZgpcwy}F1F&%rc06!5
z=#~yYr-r~#k;6aN-JJ=IMuTb7rlF{)2-~)8gI23WW@aWhjzef@D5|QeEE1L5D=RBQ
zTwENov$GK#91NvW38_@tr*rPF>gsAFBqSg;HMLK96!rD>2n-B_L?S^-N($1_(vX;#
zh{VK1yz<H`sI07n!C(N#aTedHIsZVLu?{!>wU-~y&S?UK-fQuYXIPI{tjTD=jl%uV
z9e>YaDb$FWK^VRC{ciX5^Yg>}`SaoC=7zw)KxAZOz|+$c8jS{_p`oa+uZLQ#?lJ#l
zAk23h%uAKDTCK$$hrv8{dt@}=O3btT9U;Nf^Dy?+v;pOxm^J<VRopB&0HF2z9UoN+
zTgOoY9+zPl=9h{E5)9K19LM3Ux8B0Oeftm_8_VYp=yW=Gcz9s(;>8FH3&UfNJ%;C>
ze;%KF@(KL>{16-*jHsw6T)cP@x6bE5^OpdAIg{fv3o&Nt{{ByhOdPZyy>2nt?P`7Z
z^5x4hapFWsBogf0xf7+OrQkRYfq{V#i9}GV)g6{^0l?wIhmnwwfU2r0D3wZthlk&_
zWL~XSi@kgI_9>4-r_=G1?~IHLY}&L527>_tfdEscOo3P|#_7|i@x&8P;M%ooC@U*N
zW@hGH3-}HlI)u2mIPBlQAHKf6h>wrQf&~k3`0!z@T)DE_LI4BNK5(e7uZOR%?_CKT
zI%7DSg{#ST%H0aRA~7mp$AE%~wh7h%Fna0x7%{VBNnM6v7^aQ8dqad_?r)Wql^q({
z)z#IJL?WS-loZ;xZyz~0IMAt6rzk2aigxbYNdkeO!xD-{)m)+$D>O)JF_Px5FW*`E
z5%pMyB~m3NB_x$f>Ey|ieABs$7cY`bCZov6$PSI#^m;w1R4S56rR3)3MryVCo@(Z1
zG#W{*R+F2X8%d>7ijR-)bV*rT8#itwsZ>g*PoE|?H#hq8pZ`n}iG;rS<{NT$cBX`c
z1PTlcB!xmjhN=@5%bBjGyfU!ws>Rr0Ih+2>ryVwHZf+(Q7Z*Bu^eD+>GE%8j)ZE-m
zAt50olgX&4sHp$v&`wiR6J=&*@=KLOA`t}y1W<f@{5{*m?%HQ>S$u|?zrNhRWlk+d
z`uT%p7Gr5Ydd>PL%rFe|3&ie7Fw6jP9EZJo_hQG69oW2iGs45e`Q8l4$;nu|b}fbt
z8-^V_cHkfX_y-OhIt1O9Nzi7j1JJsJV#3z5eZIQg6}qLvm7TxkmwvRr;yruzY%E>6
z6mP%%Hnwly4w+1bz`#H#l}fB%zn<T&wzd|DiHX>|cP|tQ1(ZtVJ=c$*y~4sm#Kpy-
zu&@vzAt6vIm0czt@87>4n>KC2?%lf)78Zs-{_&5vefu_QYHBcN&KzWAWnsh!M;!3_
zng1*up74V6pAHXv8I6g<)%Sy8IGY6kuoF#e{TpbrL~6~NH82{DICJI<+}+(VfBt+d
zS+WHF{{EdN{P%@ctF^e}P*YQ5u~g|^ZCux0+oecAYa;u|Ij^<eN$BZ2GI6+BasbW8
z-nB@acXSKHn9x+KER|vyhWVvqfds=?iMf$oU0og0($e@2(K~nUL}+LzQd3j$=Rf}$
z)z#Igdt)-cR(`N6&)7PSf_TRduo)&mT3Q<R@81tcM@LAdQoQ)$i&(jGB~&UEUoQ02
zsZ)IZgLyJORQV6qQe9n*#Kc6Trl!Kz*B9&7t%F=H@35V@yscO)#-&S_AQp=;fBt;b
z*4E;iZ@$5#u>z#ess%8#0bf~J83F?X;p*xN2L}gCo;(?c4jqC@rGme|f1i)lK5(e6
zu7;<lC+5tVb6*7xow<Hw2by!<ws_7?G!c$70^vA)KJ3O#ft^!pcj}hw4QOe+0R5Ry
zpfAnjOT3y{V~G^QFwBF51riKnWfLb(<P%|ie0;Ea^=drv#1lAs_AH19+NLJdtaJb{
zbhYrEBeOx1JTP_YRLq$(2WQTl!J<Wr5E~nd^z?MNySpPhI~#Fvaj34YzU%o9)}qyF
z`F<2GE-qNNZXNvn{b6r!4}-ygs;Vm3+uOs}*B4i>Ud8zF<1u>lXk5B<2{&)vg#2M!
z{BxcyfT0ceJUl!g5{b~z&;XOkgvTCx3`t2zz3#`+Rp4O0;~<yIt)5qLHyO@mL7TCz
zLtxNbc1{!E6!137iC`Fp=_3|MFpL#xwOZKQ+hgzEz1X^SE9~v<@zP5#;a~sy7cO7E
z3>Oy{Tx+bu@dYgyBd{6L?!0m5#-Oyc6sJ$0#{Bv7@#U9a;^4u9IC0_x5)%_45{aNx
zDiIVE^oyEg0<Fu>%!$idtrigx5x8{e5)K|bh*`5{VeQ(rShj2#zWeSwJpAy(7&U4X
zYX5TykB`*j@JoUr4fs;>&SUrP-DqlR0szFt#r4<>P^Z(Ou&|Kt<M2xl96Ccr1DbQ=
za3envCjGTu?PKF0gisLy;fqREorz%>rXN@!!7x^|X3ZL;rl!K*-yi?|-~WxzKmQyl
zDJd8|dNf*ET5#>!H3;l&@kP)u{L0A&V^<u4z}0V1&ZTV^;0C9s;hTJcZ$fwT=1n~F
z%rp4tqmSU}>4|mg*1^-$b5PFXUQ<|Dh+VsO;mDCAXlZGIlamu{ZEX<}5`s@Z{S-g^
z@B;(_0fyTWB#yUm^ku=21$;N2`X9`E{bT6$ddTH+eE8vqoi=kb2M*>t4iyy@kjv$G
z@x>S6?d|<Q1P)yxqXD;nD1!dqhhY5a99ph7z|`EjjL>%E1lT!Ez_3T2gy1P(I860n
z&E^<}VFrK&5)5Ny8jS{r4<E+Cg9mZy)G5rGH4Ep@pT~s@7hwLm6)kndubgZ!{*4k0
zd-%ygIggf~FQGoVb?g;i*yG>YhX4Tf_V&1b{W?NJLlF@Xao^=XSi|1Edl4BKiIF2m
z;@Y)qAR;(8IKa`-5hjxf*RNj(08ANei!T=ohAiOo&H&C|(PQ=M)p+l{_xNqP3LMOL
z9NgXA2i!%RVHk#C`s%^FWW_LpAU{7JUS3}OV~IopCnqO-{q@%{nM|GTW9#tHpq-EH
z$kqhY{QtDzi|_TgZPMYPhaSS#ty>Wm7Ixp~KMX{8csN2rLQqvzg|EK)3Tm|)-+c28
zZr!?Nv7Oe?8u;0dn=)wUVmEps03hthEmSqMATco!OP4Oi(W6H@4IE-(Vp!n7Fbu=o
z6WARIh8YAL$Dy{i*5coKy&fk|o<#QF;-Grb2EP{BK)n4s*oh_%&PkX!{HPp->F?`t
zRZm#DbSd6{|NRGc$xBZ-j>GQVyYc3mZ{o&{8vuZj!);Lc{~Ynit_G`BYif^-2K=;k
zEM}<<7(2oi!zam6R#pZ#H#aC03e1@^hXoD{!!XP}i3Ji2GsLdEJrl;da{w?TOPgN&
zP>=IJv!8ii*#MX}-WEsxM=&IT#L*vGP}XRRxqto`o}Qiq>Jz~*48t%(fnAzpm?35>
z9LxW^<?5xu3nZFaD*=7+M@I~Ic^2c=<qgVl?ni6ZtU*;(6(kY~CQh6P7Z(>uBodfR
zCa6>@R8>`By9bBaqpkpG?LS~YZg3{{=0srMU)y1>d=kXIzJqcchG7_nu{IV+Fw77e
zCYg>~-xmM?4CUE_mc*++^U0lKJ~BAL%Ka)nKHlQ7R;$I%ojZ}5nu>Mn)*&-96WYJ{
z<JR}Bfdtp^-Js=3m;*ileB(5RVHk$FAK2dQ6JVGJjpOwB{J-^Qvp`0J^$%j=pfAnj
z9}1pgSGl{AnwpBKQ>Q|s(V(=n6zkWohrPW$hDoOL+Zf8T2krPQ;A0quVeVHfkYJc0
zHhl84{PHG~?ka8+?zj3eZk8P2o1ED=2;nf*$Lhzp-xU`ZW9H16*tc&Vva+&}oSY1?
zSj@l90zQUe7>4N{3nUn3sM*>>_&X*4P<Q-2&@G+y#y4?jKK3sEP^gGtO}9ExR#pb3
zQi-CXBFN?P4zII-k6{>wVY<fx35K}~go+4$&3()D2K@Z@Fu=rFW$dQ372p~#0BBuv
zFMLti!yXT&@bGX12M2e(0SovThG7_{TP%=Zn7hDcm;j>!cJPl4XR~na@a6#r6W2a|
z9XCr3@Q<AW-iEE?r~!@nAY%a^!!QiPbd3cP40D$Vo}P!1esA!Pb$NSm_5I-fUG+9`
zX!`rB(B<vnpAvdSV#LfKYn<u>iv@fP!!QifHP(=hVeYb~zrSiRsk9$A1taIY)*1xZ
z_E4eO#NlSi0W=?bm%q9V0FG{f7!#V>^Zrb)TtBh{%{g!Lj|ET9!<eP}``)C^#Gxr|
zg~j(R^oqo&KkT&DsWJ@1FwBr)fds?c1KLki0l-c)5sotg;W&Lh?8Z&udknN(Z$L}q
z1?bOw0)1&FpR8*p^one~iq3)vt6~8k!!QiPSYm+$!`vebXS1NqSl1yi=q)>^32+K{
zn=NM=L_G$4qbI_4WNW}@YHmPF(~m6RV;F{Eez8~}!7%p_G8)jF8;2YDi7@G}^=cm*
z2O)%t2nb(PvUT=DfCYRE!!QifiUkr3a}Oe;0k?lBg8tu!VEpMETCO+1)Z737upK!8
zc1{y8?2#uSc*++JQ+-(3&>_YGK89f!hGBsO!!S(0v4D?Z7>0R}u|R@h7=~dOhGCdK
zV|^qThG7_nVHk$#GZsiN48t%C!!QifXDpCl7=~dOhG7_{&;CDdXwi!|*iirg0000<
KMNUMnLSTZ#wSkZT

literal 0
KcmV+b0RR6000031

diff --git a/image/20180117_011331.png b/image/20180117_011331.png
new file mode 100644
index 0000000000000000000000000000000000000000..cd1e29977491c1ed890d7b5ec1d23dcf65f61a71
GIT binary patch
literal 12180
zcmV;FFKf_=P)<h;3K|Lk000e1NJLTq00J-o004vt1^@s6jx`Y_00009a7bBm000ie
z000ie0hKEb8vp<R5p+dZbW?9;ba!ELWdKudX>eh4bY)!^&fNe2AOJ~3K~#90?cIA=
z6KB2$@NYs0pxhGFdc1S#iWhXXK`YB~+io?Amvu{B;-ydbv{p}Odu+RIU2$8t+HRGt
z&-StvdU2n+$4Y#(RnH0%-KABir&hF3wQjc%QL9!U+>wxk%=v>e(@8RcBm^cQzt8jd
z$dj3Q=a+eB-u&jBnRg@%!!RI(5JCtEAX2ddAcPP?2=NppFoY072njfpzz{+RAtc~X
z0z(KPgphzk2@D~G5JCbDB`|~#LI?>sl)w-|2q7fk$ixnS5Km2?J{?x8)#-Da&4$Rx
zNUUGK9;;Wc?zi>t-MbfWyzvIw+S(wMI-di`WHMA%R`%Qa2ZF0@%rFe(aygbRU5c$+
zx4K;(JKU5+B5`|}7hil4|MNfp1GCvIxZGga&Yqw;@qbiD1B((E5^%o$`fJ#1HiU(R
zIZYcnbSPR{THG#+VHmWvwSi$6L`O%vwM<J(3u<a=(B9teG_A9<Q!uFsG+%%HHM+XG
z5FQ?G_c_}T*VWazRgTqaMO#}N>gwtc78ZtK!-gR|Jlw5qR99DrD_5=vHpC{A2_YdN
z?th^{fa=8mQ5_8|35~={0!?UWC}z%_i8E);c(uI6Vu96ah0SKe#fuk_ot=#(OP1jG
zzyE!oW1BsDHqM_v4~xap=d#2U8XAhplPCA-Os%G-20M4|#DxnNaPPhMqN%9~RaI5U
z%F4pZl`AoH=uofAo<4m#zW(~_fZxuZpgQq?R7V4gdSFOE>Py~z@Zdq5IB^11RaIzh
zZN*n#eTBt~7mFU3zv;_&F&GS3zkWR;BO_5%RD>Zzh5!J*{PIhzUAq<rg8^H%Y;ihM
z9f;Th8P$pZqdFQmf#26nh=*p+o{eAs`qwBaDZ!R4TOgBB9`9=(ee@A7Uc87kYu0d$
zFaXS$F$0;InfUO-4^dK5B4UKWhw8-tQ5|`P5*QM65)u+HWy%!DWHP}U?nvKMRaK#=
zs0ic7kH_T6lbxogq@=)PGU2n&K7-k879qmmLv`Z+sE#~G2@D~`r*7Q1f%E6jL!nSW
zsZ=^mS1OfIDwQ~Q?i{}R?mH183_esR{*UU&bCkdkLVT*Ru@NmTEf_j<sNj=g5fKrH
zh={<oYuC`!)FeWL!H4R^|4|)zjuIF`h)><Qa|ZxiKCT%O5(1e_hNh+_baZqKWN1N)
z>csz19eIut7($3ox$}soL?VINY(`gC*8oIBs80MJ)sg2YfgyzWl)D4@Nu^ScMi?dD
zqdM__R7akp1cngeQ|uTOuFev>y1HPsS`ir;DR`})_#V}X|D!tc93?P>5TA;Sj06C5
zbaV(l?%C1NfsT$2j2blxQBhF?9bQnPI`My0N1meuh7jUYBS(%za&j`7o14+x-0U>H
zsi_Ig&CQrRc{1+0>n;%@3_esR{*UU&bCkf4pcWb$3IH@3uMZ_ACgOny9>CSBS5aME
z?KHirstRpwZJ0A>j^KC~#P_I9{2$ek=O}?8L8raF9k*`X!nJGHaPi_rn9XK<`|Y==
zsj0!un>T5Ug+7Xoj>huk%Mlh9h64u<*gaiw<HijX78YXe+_|{#zWc-rGRRP!_&=&6
z&(Uco2|86(Rrufk{a>`Uw&MKx^O!bm8ovMjd+2mJL`Ftp(xgfF+0T9^c9;PzJv|+p
zHf_Seg9q`(8*kw5yYEI<R~Jf4OA#9zi)WvG7V+`%Vuu-2s80MJ)sbf?fgwRBCME_G
zCQLwAR~Kf?n1RsHP;_;5!DKQ40EQ1AE^>r{PbQOL)v8sPIB_CA`Q#H+S69PqHX|u1
z3G3Id$Ak$J#11j&P@VWcsw2-(0z-n%gb5R<As8Skl?p1AO6)KQ57mkPqdIaA-2+1i
zA%u{CLkSECY7E1mwY633FbElNCX)%Bot<KbL3%)S)HAw-M1s<-Teq-h&mM$^h9WXD
z5=NsD<Hn7{>eZ{o4sFn37zQOJCAfU~GBPqUkdTldc1S_XWHRBzi4!<??i}vA>n@l~
zCRi*MEL^w{DJdyphetql<O%A5Awj36rUp+v^%NQ!8ZdF<L`<171@ZCm`1{}gj_03$
zo?evZ1GjG7LP0?Rwr}5#4I4IK!-fsmy?Zxq-MS@qXhEx^qXX}~_a1id-i^_tM`P;L
zshBox8cZe=wr<^u<HwJS9b(X<I`Rzlz>uJ`b?a7KzkVHWzWF9bj~>l^K4#1qWM*b!
z(xgfFkN@}&5hDzIR;v{zlL^Cy4a1NjLtwMnz%UFA7$~AoKKTUs`T2P4vB&Vl6HjoT
zr=_Lgi6@@G_U+p-cI;S8nlwqoD1#f-k!Pp}h6I(0iV7S#as&@O^pMkV+$xm{$;ruh
z`|Y;{-$g>)H*(}iWM*dKvBw@mW@aYFjvWiD)hc#aL94N`5g&j2F+xK_v2fu+yJ-;-
z5tuh`9x5s-@ad<YiW4BAI`V>FB``Ld4P|9zIC$`&-6({vG&VNkz<~p(sHgzLFar=F
z33SJf9Ya%76DCcX<n;P_hG8&y@?;nc27LMDmm)<tIE03VB04%6QmGVHs})^cU64p5
zVuuy93<d*Eo;-<BqefxOm@!V%$B!S6n3x!xIdcYeb#)>{NT`lH=T`~Li4!MKR8)kY
z{`9BZJ8JkE8X9o^{CV!|SfNm0>eQ*w>2x@E?%Y6!O9D_uMFng&8-@=b?v%htrBcMj
z#i664gAy1rsMOZhqN=J2(b3U}j*fPk9u*aZsHiAhzI++AwY4HdNT`lH=Qjz=*|TTy
z-~avJSiO3+%aKrb?b?M|vu4?4pOYp{!h;V!h`hW!T)TE{pu!~q>gLUx0J^(m9Z989
zgolU2Y&LWA5i%IGwY32N<Z`*-^w7{y$mMd>*4A?Kl7U5a<T<}cV49no@t42+1wa1r
zk1=`jWS8^Jm@xydz4jUu3WeS04?g%HBoYbs?%nIwr6&@+*fAAcUCxk7rLfs-G&T$w
zRM^*KxZ3X}5(%VIDcalH>HaT~P#t;BFA|vZ=g;GtZ@$5T1q*tdZ_%Pfc;=aBFl5LO
zr)g`~uEn84hv+fQeq=Bhke!_krBVrrL;|H!35`Z0c3AzwX0wSM0wF%*?*7a^Ek*_&
z)sg2!Phcz-3-o$D;^N|voSf`(zB_mB^jK;4+;b1iW;2c+J=z~(20f$E2$f2Oyu3U#
zHZ}t2zKMGO{{13H<{9?B7omNLVHmCv2@ek+(6|WcPwYK~uG&y`-<Qkf2nh)p$k53D
zqdM}O=m|_qOAG$_&wpa-)Tx4FM6|ZHV)yRd*tl^cmMvR`3l}a3mJ<>Zg0!?WoH=u*
zze5g62M-?P5|{k^d@u}y`uchl6cmUYnP=F`k9Y3eahk?33_3bGAeYPOjnrgNVSBC3
zX0zZAq}gnS*=$B!T%2GJH|c*=N1hWsfoW=LLQPE#l9G~~rge37p}4phHk%DOIXS4R
zszOmwk;|^O#Kc6LI(4eQLk>!Z4jlr}Jyy!Pb?X2CadB}0cM0i7Kl%}X?kCzD_amFl
zhNh+_L_|bz^AR!_C=?3B#>S$(y<PAI(6+WVw70h-K0Y2wrBZ|l3DuG3L{DJa+uL#V
z>Q%(X#yU+i8jbk=`|t7SqmSZ?FTTKy8#gdx#tf&&Us*9RG5G%b@B2ICp!CHTUjXP%
zS_0YJxpNU28HuY`uL>qGSFT(^OiT>s&Yde#goOCsxN+mSCpd-15Me)8sZ@evkdXdI
zb>unG6BveJTn;g=R4VbvBaZ+84j(>@@#Dv1+O%md%L)w*rNOfL348e{&@EZA1c`}>
z(ChV1ck;Kkw&LvBvskiZiC{uayd#xLA(2S9rzpt4i;s`T;>C+`<;oSoF|*E|J&V}b
zSfr<?)BP19p*r%M-?Sz|!;H&hGQ`Hl;_I)!#)%UrpwVbBV#ElSk4jsuRvNCH^hhq3
z<IjKoGd}<PbNuzMf8{<mnM`=@x#uu$+&FC8woSwc2Zy${Hk6l_L$B9k&z?QFc<~~x
zUcCyPPKV;+Vw^g43JnbnVuu-2va+%;fBt;D_10Ucs;c5XKXT*<4jnp#r=NZr_uY4&
zcmWcsBM<pJfvKyj<Hp)>M`UCq;^X7d+}!MPo>Qkz!D6vs!GZ;7X=%ZM0|x}}gK24L
z!Pv25J&w7otPI)N*+@!C;?5M=M}&1cU60GM^H)|@0swS69a2+MxzAHmQ<0mS>vkL(
zjfQ(nnZLZzX!Q7d@fnRqyz|aGSg>FLS2kPz=FOX7Fc_Sc(dl&Dd@Q|QZ?`=Ay#q;F
zS{hEAIDyjAQY>1u2pWwB3l}cL*s)`A{P=OFafXQJ+S}Xl)mLAkw6qkRot;>@awW2}
zvk?&yfzzi?<BKo8KvPqb*kJ~h5hF(6_19lVW@aXyeDX<TW@aKIBLnZh|2|%O?KM2}
z%rn$OCNioc4>3McUtiB`-@cuB_0?CI)vH%C#l^)=^W46Do6%~u%m*KQz*wzThG7_{
zuC9*B$jD$`eDOuWa+{l*nPtnCF)LTDWEh5Fa&vQ;W5<p$Hk-|9-p3z*oSV;GTCJ7=
z(BnU~TFung*9$Js&Qn-e$f(t7mt|<R+CIgRn3%{^R8)BM-B=YB6^ufm=&^i-LctUi
z6xc0SP*Bk8w(&NmzL3deOloRspUSY=Y)ofoCu1_1xc@B{OP^y)O-*HFGFhL?5t~dV
zV^UI5yk6dBvoThym9bbXF8>J~!|qB+Nf{K|*%N)O6PDF#WlSa$_ph_Flj-W}>T|il
zSSOCCjs})bQn@>K?qJ`(eMnAD#;<<$D>OGZ<HZ+WbUMQ-DJel-ULK4_BbP-gl}gN<
zITPP}^NnEHLx&E<oH=t)Utf>k{`R+sj*iCt_unsguS-Qm1@6E9ez)V^ym>S7^6~(5
zKf#orpO4bgQk0gKB0oPLiHV5-x_cd-eDcX2%UZp9HS~Ht5)%_qP*A{?!Jf_M<>k5T
z&Edz9laqt$>T0{klobjEs;jH9X3ZM6zZ=V7FyQ|C@8|Ae(Q36QEG$H6X(<W|3!&9&
z0d(KvvSP&wyB-ydM#J5s#8Ru(+-D5KVEXjw9>?SlBoYbaayi1n!nps1?!zM9kw_#6
z2?>ErCUg0Z?pG5>NJt36!os+Ja=Dz&>irDWk(+#x1zoyyiCMpXJ!7-km^*jwFlx1$
zQ7V<pty{Oad2BWtvu)cp1^{#X_;I`COG-+Z2OfBUxp3ivVEGn{g{i5jVXj}l?(!`8
z)TvX<j2SbSYuB#16?186Dc6gjQmF)cSnBKR8I?-K%~x7l>NF2{y%9p?@Yj=-mDOV$
zJ9g~oHCD%7lHTxpg<LJm?`cu1)q?Z%Hhm!Zq6dbrFFgT{s0T)v&1UoIb{=eJlJ4+z
zo%mWX)`=rJZU&Z5Qo7^Ek7LD(6_7|I`26$FQCV4upa1;lc5l?ItE<E5)2A_E!UU)L
zR8%Szl9G~e{P=Of0eoaK8ODzvk1=D$2%aU|Y&Ph0I%H;MV&uq?ZpFNB-#+f|KmF-X
zf{zEs#l_*JmtGQF#*s>;LUD1iQ#tAB=}@Uu0J^u6t2h)21)hKYdBL*N)6==$pu>j`
zyNtn+!C-)1uLscGbK+{u7L7*3#i-Zo1@DI$Y-~0gIy*aY^X5%_^UXJCYHFhQi}VAl
z)rzL3CR9~b;rjLKxO3+Yy{5rWbar;4sj11Mdlt#SpyS3pKIt?6+0TB4l#~?MY&M)a
zbqe2q|2<Z$SYbC>;O*PDaryFP%$P9)BSws{TRti(3XeYeDBgSTJzTnU2~(#|^=SPk
zPo6|aM+Y8x<PmN-=H9T$gi57CdV0Fc`7$yxxWCVyJ?nD5<;$1593v$)H5KLM<${kQ
zvvJItHLJ&Xlai89U0v<bjgRcuEdcOe|Mg!z&bxg1a+H^s0|5T{&wnBzA;InS1R8dL
z#O>R+BQY@%<HwK3xpU{BR4Vb(OD`clK3?n)2ZfrN8tmM;6BjOAz`gh0%QeVZSy@=Q
zawUci9V&K+LB(dX!D6w1VHh+uHDTw@oj8B~JYIhJWz3l~N9^#(|D)r^eLhKGQc_X?
z0JXKXIC=6UCQh7)yYIf+Zl0Q&8r0O(VC~wqf};qgrKO>^wiX|K^bv*+AC9~3y34I~
zfBWsXICkt9)~#EIapT6h9dmVcH30VpW>c%x(ChWw54@))OqkGX9PHCQy<vM)+;Q#N
zHSTYIZ<vs@v^4JTix)52C2oVwkt0Wtot=&S`}gCgKm959`75uyf(IXb5TAbfsaH?4
zkslZg2CQGd9+8oeC@L!APG-LR@=L5;yA}q60b90gp?6LVpl`qZ7Q1)v#-&S_P+wn<
zfBoxUh>wq_dn^119XFow>7IM((j}Cam*eL@|2h8c-~NsJ++wkyva%9#xg3)xPj<Qd
zvSrIKXU-fL3<kHl%Q`wbaOKJsWM*b!_UzeS#r(hn4|uhlSk!8@SIhO(%M?sZCKEPo
z+JvP`mpbh;Pe1)Mq*5t1Z{AFAd+no-KKck3E?mHxHEZm8VrR^lfy~TIeE8vqC@Cos
zF~Z<8a^y%n^2j6Dvu6)J{`h00rKQ1SGKn1);i2QkGd@jV3<d*QTU#-6=1hczg>j#^
zw6x&#>C+fHb}Yt^AKzmc^XJdUlqpl(>Wz@eWJpU(^E!C};L*;|pW}l#KHcN$UvY7<
zSLK(LmAO4{OiYYd>j(sg4jsbv>(`N<p6+zHF(f1eGiT1kKmPF#)YjID6k*_F-&r<c
z!UVw+mXwqfm`o;o_St82-_ZbyiHSi<N(zPz8wRV@3Y*PFPlEXoI&M7YvjoOsvA|$3
zVCc}HPM3e0nwn5rT8f!7XCgT{x!1CyqodtAutGya5g8fjb<6<V8X%6nY}4C)D&82V
zLDO1VT6&y*`t)h;?<rHJ^mjO-`RudL(9zL>QKLpVb)8G4Qj8fh2Cc2FC@n1&DZ;>a
z<Hik~KYtzyg+lOhu~MmoQmMqbbLa5gci)K+AtC;UjvLSUEP;{9WKb%VPVY5h7zQOJ
zC1`7FLsC+b-(0)P%E|%&l$V$H_|#2NQ4#m|FMjb0pT{wO{(J!4Nm5@&+jYdh+;sHl
z(H`eLaNq!d?u2SEUv6TD=Z=kybxM+@QYoUMqF^$axO<a`=NcOu(bCd_p+kq-^~ACw
zA|enG5rJ#huF+_`g#14`Zan9+1V$o}VD{|U7&2rC&YnGs+S*#&zI_`<jvT?JO`9-m
z*swlb>hZN@%a(C}XJusxCJ#oVk$ZYap-^Dnym|c^#|tmK;M20FPoK^`e%;eRdhfjR
z4tIkxJFwkg#Xbop^f<mmB0*?qD6Cei&yz_O`<jW=)YN_{-yht$a|ZxizHp8m;I65u
z2^}3B{St%0VBlWKv3c|6epv_cPB0t;-tdRxCeZkF=+U`z=i;rm-ol|nhtSf}0+~#P
zuC6XjojMh_ZryTvGD%DtjRre+?nHTcIm*k+F?;rG{N^{m;Vz#XJ9Z3td3oFq-m9;^
z+Aoh5Ycv{s@WBVr>-EUX%R@s$1D<;7DXtg9Xf)#T<;ysB>=^d%-;WPI_`stck~iOc
z6N?rt0syR7u>z+~ox<Y9ixC|ijqkquj$1d-JsR<I&pqe!@90n5xjC0%n0^}@gH05@
zeWEQ8xO&+tpF|>o*=$BvS69EpaP#I(?${N2vo8@(FdPHk@Q33j(D*EYv0AODtE+=X
zqk%@FL2Yd<Vq;@rG#asG%N9KR@WVYmfh30F;$kdVumI)d<*2T%#()0je+tgGW5*7x
zTeq&?;`s2x53y?1D(Llk?BBm1`}gm6Id4={lt*P}WMrVApa3gYtN_s66T`l?fKR1T
z;r;jDck8k8V9?*Ms~^lSjCA+0T&Yw#AUBc5#>V#hI*8{6^D*EJe>-jhfzRHBl#`Q#
zwQJXMgQtxcF#>YA9IwCrI))4xg2x_v%onTjskpc}oIQIM1qB6AtJQV~luD(7R;xvI
zb+yY8a)BQX!k(VoVW+t|VB_NAP+VM$f`S5MWo6mTr%))MR;#gN#|~6fRCx97A&o|Z
z>gsA}wOVe(U4GdG1qC>J_H2)3voQtwj{$oRmeAP_!!WQ|ERag2y^fpX4gS4Wu0};3
z4A^b#>MXIVs|!}E6_JsVg4g<efq#=D|1vERSFjud-tdRxCeZk#2d1{R7JvNX9}yE1
zWB0Vn>C>n2?z`_|!-frBk6$tn*j^)VG&D5yI?uXw>)h(W=}R2FNk~Y*u3fvlUf!MW
z83;y?9t}YFsVtk#hSt_rgolUs%RqL!ckc$!oeXZ<w$10|`wO<0u%n{`X0sV`x!i7g
zM@I+uB$%f?itgIEb0>hFU!g$;Ua%Yk-tdRxCeZk#2PPyW1V8@qkD=4)aNm9R0q7og
z<nhNJ$J0+gjg1>O(rAywFU*`d6CoiXxPAM!)0qy#Ft~mDHiirtf_v_{$EWKx8jakg
zyS;n&4(dyFcinXtl9Q9s+}w=j=4PkqO-)T`Zf?fp$&=k4aoZDRWo0NYFNZ>*=u^^8
zd@Goa0dI(X+yo+@WEG=FkH*U{zl?qR_Te|b`3*8NGx6@b@8a#Z-^L3sykIw?AR%JP
z$jHF3VZ(6#{CTGvdb_&1P+3`ti4!Mc+O%mtUGMJQyV2O#h^(xvLH(Krp!;U<2Of9;
zSFc_bd>p;1stRpwZJ0A>j^KC~ef9FoF9Ybm8}A2$kdP3BgoHpUl@8d+WiTBB-Vpn^
z2}C}*gd~+pv1rjE?r9f7{MD2xQ?PR7N*q3X7^_yT!i*U+xM_d;+uv~W=1six(n~&X
z)Y%tDzWw&wJ}uWDMMp<t`SRsBdGaI<95{e`?zx8>_4vk(8z?L+#N4@ax!zh|s;sPp
zUav=1R#v~>cpr!?77JQhT41qQaQX6O)YjIbv9S^V`q#fOZrnI93<HHi(Qo%x1k*9#
z4Ka_KK;_fNs0j%Kzx&<q(A?aN_uqdXKl#Z|5D^i9`uchl78c_9=by(z4?X1bbq<z$
zh}@N)o{mkMHsRpGgLvbOH*ojecf(?_pscJ6v9Ymu_St9q<*nb-r%$K%Sh>*L+>B2@
z{S?=(UBmV3*CCV1Fk-|AoH}(1w{PD@OiT>s&!69KFES0bW563?9XElB5*QM6lu9Lb
z?b-#MPKO&eZXi5794##^&}y}QeY1HWk;!COwQ3b6PMnBOKKTUI)zvVY&A9vSyYb93
z&-D0)cG5rOaydqg8ila1Fie>;1xuGM<;E2;o6QIh4@X2qgxFyQH9BrQLkSECN?~DP
zc=XXn#SUZ8Q>j#TkM0xkL`O#>EiFy#Fo+xIxN#3X8bk;ogphzk2@DBp48x$cwN>me
z20fF>)Nik6Al{)mA%TuAA(5bT>((vo*|P_sp`nP3jD*o>#JF+euzK}su|pd)OePaf
zoH&7V=gwioh!N=Q?1b5DMn*;kQc_aH4lgKCodgbsVNg<1g3FgLBO@b&h6E5mJuoEb
z)YR1Asi&SoLqh{5PMnA-Q>Gw3J|2Jn``_{W^Uu?Z(tMz!qXX}~_a1id-i^_tM<XRA
z1=FTYLuY3vwr<^u<HwJS9b(X-I`MzEZrwsbK>=QU^;P`(*T2Sw4I8j~_io&}bxZ8f
z{1WxRkf5`5>sEaC-FJBN%{RGM3jn~FF=LRKnTh1&WWRiOS0MT1lTVPBmxsq6e;iLd
z@dWpIT3Q;Oc;X3c-@YAV$BxCMNs~m3GPqEk_&=-F3X{o%;lqa`GBOe+B_*)gY>>(5
zr&<X0z>uI)QBi>-M~>hZzxajIaNH`D3dzaI*tKgH%x1Gl5eB}7h6a56@yC$M<yg3I
zq208IhzQJ^HxCsR75MbiPsIr^2vMB`hLIyjA~Q1+k3IGn9(w2@j2SZqR;yL)u>2M!
zFeIoPJ9Z3BO--0IX_C`uy9~o%^5n@d7!3IG%P&QWFz{Wuas?+(p2Vn8qcCR77^msu
z$B#!$ObpJPIfJ^oIuRlaK2#@xAv81;(b3V6N~N$`t?26Nf<z(_J1oCN2@DA;6%`e*
z*=!g-e7I8rBb7=K7Z-<)jt)v-`k=P97FAVMh>ng%bab@S^r)yPL`6k$!`YMmM|DC5
zBT8UMP`P>YCIASII4YG&5gr~6v)RneM?BZo)&`(^<X0h~p`nn=<*2Q#<>n>*i|T|7
zMwGyipu&!O;i_9!DwV=!v(eZvePA+~0Jz@95{U#-sTA$)?R2lv0HHb|gApY#gb1+N
zY+{EHu-x5tHk*xJyf{FpPRL+H2@DA;?0qjnjWokBTtgoo9zLLP4JPbm3Rgdb>~@yR
z<p>E08OYFr7S#zEj3|L2K}DfZ008dXx#KjAVHk9DbU-ebWBBml10C9+!QNkFHk$>1
zFxj^s$Hm2A$dDle9bQnPIw6A*B`_qY{OCtN0?<7!hGVz7&1OSWQxhU0BDnd8=M)MB
zVq;^`-rg>FLugxD8`|635g#89rBW$Egu#dEgbYTMz>uIackWz7Mn>Z5)vJOD%#|xw
z5EB!FxpU`=6k*^SH*Oqe&6<U}x;nuzMcB_(Diy|#9V<eF!H4RE3`Uf|kf5?;$r2<c
zCPJ^*J3VdD+S-b<XU}5Ek|l_ZjTI@vz!x7MkHw1@<I0sQICt)x)AX}v&muN97U}8f
zPGj+q{y}vTc%)J(BoYbtgcxx~TZIG_xm=Dv|M}1O{PWN8*T4Ri``lzQ;koCY!?<zd
zux;Bm5hENNva+%;fBt;D_10Ucs;c5XKYaKw4jnp#r=NZr_uY4&cmW0>suTa$*4Bpd
z@^a|)dhFS=2Ny41#MP@;q0{M5TwJCTQA_{;4;@KFK~#)Wr%s`vp+W30{RX`uiUcH^
z&4$j-PFO4!r)hGz+~t5>K=;e*PMkP_KmPHL_}kz9hN!40+`fGqsi~=W>#euA8+~1|
zSS;LlGJK(-p@Zu2YxbsQp|^8~hK3?6EX?JyBSwtC>#x6#y?giK$tRygWMm{dIyw*%
z5`x!Wdkq;G8NHrWx~kuhkdUB#)R*eS|MjJg+S}Xl)mLA^U@$-;kzm!TRbUtfGMNmg
zPoG9~bTr0{8Pnr^O2Je|5@xV{BQofPhK8c6s|#UaVRi?kL?Xe^p+oV~OE2NcC!g%G
z42EG~u~@(`3?vc>7=}SeNQhf+eSQ1wx3Oi*7PPmwJFUO7vlAg9A%YD^AYr$$V<N~f
z48p>~uxiyR<mKh{T25D2m)*<gBoYZ^GMQUl;##d1AAa~DIy*a^24FLr&4Xe)dxGl3
z|Mj(w*vHv>`dJPM3F-0uNWoM`)B{5T&fK|k(bd)EbdcL@Hbh27V&uq?y_O-7NP6t0
z>B-2EBaxb#ing{kr$%2QkqnA)G+b?ChG7sI8j6I31h>iw2?_Cfdn6<zAT>1=7K_EH
zAs#H-*%MSJ{;#if<cn<>Om##(FoY072njfJ6E7iz5JCbDB`|~#LI?>sl)w-|2q7fk
zPy#~;A%u{CLkSEagb+dk4ka*z5JCtEIF!H;LI@!w;7|fX2qA=!fI|rkA%qY@0uCiG
zgb+dq2{@F%5JCtcB;Zg2LkJ;+kbpx83<-D|jRq2l1n<1_j@Y4irLwXTxw*M0Dk>5?
z6ha0CrBVrrM1so7O0h!;X#Tz(Wnu?FNMAKIH30yco0~<B#5)@|ZiHU1heDx1Lqmhu
z;Sdt=8XFq{0IjX9B1aO~{Czu84-6q*dgq;YAdyI*(P;Wq&OP_s0|1ycYnCs<B0;LM
zvJw)B1WKh+>`;gcf!<r}ZzzEw#7k_C58DIetyf-o1q{QWxVYFCVUZxko+Yzq&BXr%
zdT+76p#+8yLI@!NhY}d#G4|34+YOqVn~S8RB(D29J3AW&gTdwU27>|F+1cC;V(ev@
zo^E0_8jVit*}Qo(j7DRx@#=Isq^72F>q<&W>T%i1%1W-Qmz_U1H<z29o0|)XM1qYQ
zHv$0kdObI<;|*_YIhB=_sI08y;!jFS;<iywm!itb%8;F%?G%4@cD7*r>}3SDEXVJz
z(P(<CoBqbuqtN$pj7z7}L8H-d+e{*nAT>4Bt}gia`=!xn#DWD2xP7HRZjg3dUv6$L
zw@*9nGweRk{~l#!WiHDW+D=NP5*m%hX}PkpGDsv6{QJNEJNFrXe{{TD;YrynclKjf
zWjod{TQ9Eak-t92*mXJ`x4b)XyW(k^&{u5Cdc7V%_kC~t@4%;2D!I>eIvux9Em*LC
zo2R!+QN2y?>vq)XblkFHwkKc+@z9PPI~V{=PEHP^QmGgKOk!dpqgJaK01N;|p-?c@
z)zwbRR#a3l3WdUMnZ(3IZn+&hb~r6lUtiCy2Y}r&DwT?xCbX<ptF>E>A7f%-qEn0&
z6%}^V)oL{tZ+?D0!!Qg}P*7kOgF>O;%2un@c4e~b%g@i}%4PqRmX_LWPqkWY7fV4w
zf!+3Wj9;ZvG4=KJcFUBOmU3mW-`(B1>2E^y$lt#F@6WF{Hh%uHTCLWpeExpP-=|#d
z8+|2o9Psx?c3NR!q1|_6|K{%lo@^%oOhG{bH-AM%h12%o?~jFrg<hA<a%Vqww|?0&
z5)%^zw`+ZUJy%9WMFsacf1gmPR8DONUr*cD(>B2ua&mI)wgtOStJP{ID=SMdcA;&}
zVq<o-U-vY<uiKGrV_Y4F1BntC;xV@2W`7L%4P<q7HFq#L9+>s@^-jqEi+@l!HahG9
zr%)*D8Z`b7gV4ds#;H=N>>8!|`g$fSD@!nGU_Tcs%T@V~W$-yB4(xX;EiL7e4_D>n
z=jStOwc2TWR99EKwH+O&*Vor`bt6W@!`7o?eK1USvc})OSy@?(R;zWIuduLC@W+i|
z?DtFlcdw|Z=$9WQ$K!xsPdPa`cCqlkbA5e1w_i9OBMkGyJ|nc>@_&3BzZ1XiUGcVT
zclKj<>$kePnk$RncJSwQOmNuG9JezYgX8|}sx9%RP4K1O5)Xdt{5b3D>+Qaaw+T#N
zw<G@qRP5x1VJLwiUf?&}LT5Pqo&$alL2p0!Y@^RVF!*O<LT85jMw@@I@{=W3XSqU+
zbx+H<+79j}FpfXCo|NN=-Byl2fc)(tw7uA~I+aT0_PTt5|D)y3w(SXfmhYIn@%Kx|
zY5jp+pJQUpF!uYGP)`{@5#!_6pR1(HRTA1;0@IhWd)tpatzWi0p&vn^lL$60cYD%=
zV)3?3@Fh<Yn8d_Hr~Ss=a$HUC%XZ{%KYvJG7=~f!9vI>^wOWnz^mM1s=gphP{eAiJ
zW$y0-2Mz!Le)X$g36}ShpZo*>?5?TumlwK6Bt1PHYPH(w^D}48ps}$LiHV7VF~-Hk
zL8Vdw0B+vA$$ic~%DiviKA&C>&&kQb^y$-mR$fd@41k`WfD+nXQ>IJ-0F;-P`z#iB
zeDTE>004zTAy^-th>ME@;QC1pl}d$m>(=#Y9iEsqYnD^p#>K^P`{nZG%ek0YvuDp1
zEbG{@V*r4xtSlrXBnZy4cI{dK!13e9J&My8WxLvsJ*{814bbUycAp!KM(p3e9{}+1
z!w&=KZV#%fs{ugpSa+AVZGu?deDh7G{iZMavK?DmTCiZj0yH)@LaWtc*REYYi>oha
zAUoo7{DbcF>C;?e!TxCO+_@7UeDHzOa%{rD-sr|I4|smSUA%Y^0MO9TV0ZHyAA2zK
zWBlFkeh0l?kG#A*96x>>YuB#D!w)~~vcY#3n{areva%9-y&fecCERCKRaJe8XP{lX
zb`5~%W8D-L72&hbKEt_l=eW<<A4^w!+35EdevD;hW!(P9e$SaRXS!TAEiDbe5BsmX
zd{MTm{n*p`WlwS%8yitnRD_I-3;@816DI(4C!y>y$4@5uauVQen;@3x=xCpo*O%?M
zdi829`SX|L1)v0m^b@sOZI_7f^>+5(m$NKKjg5^i<6yCkHqhOpQ(9VzmtTGvdc7VS
zH*UnnjT@oWYO!tGwgLTdG#ZUqwQ5zb@ef9om6gcM%=Gw2ngoWpxHxFFTIA*B;pow$
zTmp0W@L>SJnl)?sZQY)>2?Wq;wfMsy{($Q0YVPSke?XUzNWWkkh;ie_IZZ1qEd|qk
z|CQiBUk>P|R;znl7sD`4XIkm$=_oEPMny#hv|23yATKWut5&V@SzPXT;e{8tR}2&s
z6rjGoo{M?MjvWIU%Rpn37nMqd!ootk`toIhOT@Ey@nQf!Tt?zwKH^`7_BC(XgkZOD
z;X>r(<NyG&v$Or?-AI(c5TE1UJ2Ga>81C=H#6$qVrAwFGE^F%4sQ}<{F9e%7^>(?T
zC)1}-$F5zwP+D5b#W0WuZeCs<0ATOlz0hbh0dZ->7537DJD0x7%F4K&m*V1L?(94m
zu$N8FpFi(%9`>>-d%uQ1l<i6VvNAF<pin5d%Si0yBehy>cgZ#?DvJBNFJq4QqD=^7
zecg_)yz&ZEDis<V8?k21ntmHI#}kym5U;uVK|gr#AOPnZ`sUA{4*)oH=#bm%NKQ`X
z{uUaHOsCTcCO7Q0_{PRYj|aJO#QzRrywptST6mxhMSkzS_X6m?$3Un)*a6TS2_<d*
z&~WybxpU_N0QT?S@A7-T`|i5{x^E8lm$JRBU$%$y=+UFx<s-+N{HIT!4uwJi;D@%w
z(dNyYdyUbTZGzZhV`BjTH8nL()5^-q1lvSkY{&ik_d}sjpuD^sFTC)Ahf(_;B`~B<
z?!W(jyTqchvJ#s%Z2|!N_P4*an|H&84FI|mAEA+C4F&@?Z{BRzxFjSbaF-0WY}sPB
zj83P+iWMsa<4Q<K;2OuJOP2~ZSUR1~?to=S7<HVN?c#P!$oRcO{qdv9_E_!Px6khL
z+}vFJ;SYcC`TF|P^y$;NdVKcTXYI}aD=RCpV8H_JCgoA1Msd^lPpKG<Mrbse0e^yO
zAkCXMkE{0u3l`YzS4N`|+1c5suC9hcp}^yhKW?||q)C&wzlD<hzLeb?PwJQNm%sca
zfbQPLo-QA;ZOQiS+wG1|cAs$Pc<`o8@HO_ut?Uz--deV78G!EX#y^QHDk{R#rAu8d
z*VpZskdT1Ad-rndc6^F#zzxjP+GH?c$G=ESOtc$;w6{@W8ODB$7~qGIF!>`vI*wn$
zA3TX2k(NIaFFPiR<Jbm{BZKlszvO?$;*Vt^H2SM!T>Nnn*ti@Ah;nD#2Up|3@W%>q
z92J=T{*KFdG8V`{;}5{cuX~~G%O42Nao=(^mW4Ot>GVZ!>+7xV+3({xCJBFk=Wi$e
zzUFF7A^vt^j}!j-y)E0F{n(TG<>MdwLIeA;_{So<Pq-SF#MQR-v`z3e{_)2jA={nU
z9XXDA%x{ZbwTX_)dAl9i@_X7B2LdH9#AE!1n;pTE|HHat#}1bRFfmMbBdXPE?HaDc
z#6(7`)w(=rtE;O8*TXPB49@0i@G^EpTgSvHKR@3oPBu1vL!6bB<uWdI7<YcT{4&`=
zxq2E{jg4QZ@h&VZbZT(&^Ygh^9yl(;ey&g`T*lke^!~=~FZ|aqWMyRuHiA2L>~Q*V
zD=aK@S>HWv$NtdU`g*H-_In8pn#S($j>kw&PEL=<mg9)JiHV6$+t!=1-Pw=%>vyMq
zS^NPAT_rjEc^!Yag+}vbk6%~o^`uSkwZg(eyKSG7ljBkBELUwW!~C#KUDcN_wj;Z|
zn1k9$7=~d$hzD|WbFp#bMyS<lpFS}}2njw#MMYS&Xb}_&1-||E+kn1VoeV6x2Zj(r
zh-i);JqiE;|D+umc$B~pLI@Fs(P-p`3t-2EA;evjzz{+R5e0w9g<u-*hxi61FvMf*
zpjGTx1cVUc4R%Z@_VH#yJV7_{5<&<eB;ZgF3?YONLIMsYFoY072njfpzz{+RAtc~X
z0z(KPgphzk2@D~G5JCbDB`|~#LI?>sl)w-|2q7fkPy#~;A%u{CLkSEagb+dk&i?^i
Wjz-oe$cB*s0000<MNUMnLSTZBM2M^a

literal 0
KcmV+b0RR6000031

diff --git a/week3.html b/week3.html
index 2392325..b46d7ee 100644
--- a/week3.html
+++ b/week3.html
@@ -332,19 +332,19 @@ header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Aria
 </style>
 </head>
 <body class='typora-export' >
-<div  id='write'  class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n995"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n995">6 逻辑回归(Logistic Regression)</a></span><span class="md-toc-item md-toc-h2" data-ref="n996"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n996">6.1 分类(Classification)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1033"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1033">6.2 假设函数表示(Hypothesis Representation)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1057"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1057">6.3 决策边界(Decision Boundary)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1102"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1102">6.4 损失函数(Cost Function)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1131"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1131">6.5 简化的成本函数和梯度下降(Simplified Cost Function and Gradient Descent)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1191"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1191">6.6 进阶优化(Advanced Optimization)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1261"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1261">6.7 多类别分类: 一对多(Multiclass Classification: One-vs-all)</a></span><span class="md-toc-item md-toc-h1" data-ref="n1279"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1279">7 正则化(Regularization)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1280"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1280">7.1 过拟合问题(The Problem of Overfitting)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1356"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1356">7.2 损失函数(Cost Function)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1413"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1413">7.3 线性回归正则化(Regularized Linear Regression)</a></span><span class="md-toc-item md-toc-h2" data-ref="n1445"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n1445">7.4 逻辑回归正则化(Regularized Logistic Regression)</a></span></p></div><h1><a name='header-n995' class='md-header-anchor '></a>6 逻辑回归(Logistic Regression)</h1><h2><a name='header-n996' class='md-header-anchor '></a>6.1 分类(Classification)</h2><p>在分类问题中，预测的结果是离散值（结果是否属于某一类），逻辑回归算法(Logistic Regression)被用于解决这类分类问题。</p><ul><li>垃圾邮件判断</li><li>金融欺诈判断</li><li>肿瘤诊断</li></ul><p>讨论肿瘤诊断问题：</p><p><img src='image/20180109_144040.png' alt='' /></p><p>肿瘤诊断问题的目的是告诉病人<strong>是否</strong>为恶性肿瘤，是一个<strong>二元分类问题(binary class problems)</strong>，则定义 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-2-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.68ex" height="2.577ex" viewBox="0 -806.1 4167.7 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E2-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E2-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E2-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E2-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E2-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E2-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E2-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-2208" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-7B" x="1720" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-30" x="2221" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-2C" x="2721" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-31" x="3166" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-7D" x="3667" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-2"> y \in\lbrace 0, 1\rbrace</script>，其中 0 表示<strong>负向类(negative class)</strong>，代表恶性肿瘤(&quot;-&quot;)，1 为<strong>正向类(positive class)</strong>，代表良性肿瘤(&quot;+&quot;)。如图，定义最右边的样本为<strong>偏差项</strong>。</p><p>在未加入偏差项时，线性回归算法给出了品红色的拟合直线，若规定</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-3-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.551ex" height="2.577ex" viewBox="0 -806.1 4973.5 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E4-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E4-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E4-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E4-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E4-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E4-MJAMS-2A7E" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM674 172Q692 172 694 154Q694 142 687 137Q685 135 395 -2L107 -138H101Q83 -136 83 -118Q83 -106 96 -100Q100 -98 380 35T665 170T674 172Z"></path><path stroke-width="1" id="E4-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E4-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E4-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJAMS-2A7E" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-35" x="779" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-3">h_\theta(x) \geqslant 0.5</script> ，预测为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-62-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E63-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E63-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E63-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-62">y = 1</script>，即正向类；</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-5-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.551ex" height="2.577ex" viewBox="0 -806.1 4973.5 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E6-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E6-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E6-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E6-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E6-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E6-MJMAIN-3C" d="M694 -11T694 -19T688 -33T678 -40Q671 -40 524 29T234 166L90 235Q83 240 83 250Q83 261 91 266Q664 540 678 540Q681 540 687 534T694 519T687 505Q686 504 417 376L151 250L417 124Q686 -4 687 -5Q694 -11 694 -19Z"></path><path stroke-width="1" id="E6-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E6-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E6-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMAIN-3C" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E6-MJMAIN-35" x="779" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-5">h_\theta(x) \lt 0.5</script> ，预测为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-60-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E61-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E61-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E61-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E61-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E61-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E61-MJMAIN-30" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-60">y = 0</script>，即负向类。</p><p>即以 0.5 为<strong>阈值</strong>(threshold)，则我们就可以根据线性回归结果，得到相对正确的分类结果 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-7-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.155ex" height="1.877ex" viewBox="0 -504.6 497.5 808.1" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E8-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E8-MJMATHI-79" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-7">y</script>。</p><p>&nbsp;</p><p>接下来加入偏差项，线性回归算法给出了靛青色的拟合直线，如果阈值仍然为 0.5，可以看到算法在某些情况下会给出完全错误的结果，对于癌症、肿瘤诊断这类要求预测极其精确的问题，这种情况是无法容忍的。</p><p>不仅如此，线性回归算法的值域为全体实数集（<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-309-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="10.086ex" height="2.577ex" viewBox="0 -806.1 4342.5 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E347-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E347-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E347-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E347-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E347-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E347-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E347-MJMATHI-52" d="M230 637Q203 637 198 638T193 649Q193 676 204 682Q206 683 378 683Q550 682 564 680Q620 672 658 652T712 606T733 563T739 529Q739 484 710 445T643 385T576 351T538 338L545 333Q612 295 612 223Q612 212 607 162T602 80V71Q602 53 603 43T614 25T640 16Q668 16 686 38T712 85Q717 99 720 102T735 105Q755 105 755 93Q755 75 731 36Q693 -21 641 -21H632Q571 -21 531 4T487 82Q487 109 502 166T517 239Q517 290 474 313Q459 320 449 321T378 323H309L277 193Q244 61 244 59Q244 55 245 54T252 50T269 48T302 46H333Q339 38 339 37T336 19Q332 6 326 0H311Q275 2 180 2Q146 2 117 2T71 2T50 1Q33 1 33 10Q33 12 36 24Q41 43 46 45Q50 46 61 46H67Q94 46 127 49Q141 52 146 61Q149 65 218 339T287 628Q287 635 230 637ZM630 554Q630 586 609 608T523 636Q521 636 500 636T462 637H440Q393 637 386 627Q385 624 352 494T319 361Q319 360 388 360Q466 361 492 367Q556 377 592 426Q608 449 619 486T630 554Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E347-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E347-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E347-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E347-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E347-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E347-MJMAIN-2208" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E347-MJMATHI-52" x="3583" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-309">h_\theta(x) \in R</script>），则当线性回归函数给出诸如 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-9-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.626ex" height="2.577ex" viewBox="0 -806.1 13616.8 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E10-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E10-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E10-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E10-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E10-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E10-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E10-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E10-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E10-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E10-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-3D" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-30" x="1501" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-30" x="2002" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-2C" x="6196" y="0"></use><g transform="translate(6641,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-28" x="7650" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMATHI-78" x="8039" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-29" x="8612" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-3D" x="9279" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-2212" x="10335" y="0"></use><g transform="translate(11114,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-30" x="1501" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E10-MJMAIN-30" x="2002" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-9">h_\theta(x) = 10000, h_\theta(x) = -10000</script> 等很大/很小(负数)的数值时，结果 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-10-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.68ex" height="2.577ex" viewBox="0 -806.1 4167.7 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E11-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E11-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E11-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E11-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E11-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E11-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E11-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E11-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E11-MJMAIN-2208" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E11-MJMAIN-7B" x="1720" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E11-MJMAIN-30" x="2221" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E11-MJMAIN-2C" x="2721" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E11-MJMAIN-31" x="3166" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E11-MJMAIN-7D" x="3667" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-10">y \in \lbrace 0, 1\rbrace</script>，这显得非常怪异。</p><p>&nbsp;</p><p>区别于线性回归算法，逻辑回归算法是一个分类算法，<strong>其输出值永远在 0 到 1 之间</strong>，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-11-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.49ex" height="2.577ex" viewBox="0 -806.1 5808.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E12-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E12-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E12-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E12-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E12-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E12-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E12-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E12-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E12-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-2208" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-28" x="3583" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-30" x="3972" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-2C" x="4473" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-31" x="4918" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-29" x="5418" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-11">h_\theta(x) \in (0,1)</script>。</p><h2><a name='header-n1033' class='md-header-anchor '></a>6.2 假设函数表示(Hypothesis Representation)</h2><p>为了使 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-12-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.49ex" height="2.577ex" viewBox="0 -806.1 5808.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E13-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E13-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E13-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E13-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E13-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E13-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E13-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E13-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E13-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMAIN-2208" x="2637" y="0"></use><g transform="translate(3583,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMAIN-30" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMAIN-2C" x="890" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMAIN-31" x="1335" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E13-MJMAIN-29" x="1835" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-12">h_\theta(x) \in \left(0, 1\right)</script>，引入逻辑回归模型，定义假设函数</p><div contenteditable="false" class="mathjax-block md-end-block" id="mathjax-n1035" cid="n1035" mdtype="math_block"><span class="MathJax_Preview"></span><span class="MathJax_SVG_Display" style="text-align: center;"><span class="MathJax_SVG" id="MathJax-Element-320-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="23.521ex" height="3.161ex" viewBox="0 -956.9 10127.1 1361" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E365-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E365-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E365-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E365-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E365-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E365-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E365-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E365-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E365-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E365-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E365-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-67" x="3860" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMAIN-28" x="4341" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-7A" x="4730" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMAIN-29" x="5199" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMAIN-3D" x="5866" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-67" x="6922" y="0"></use><g transform="translate(7569,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-54" x="663" y="583"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJMATHI-78" x="1526" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E365-MJSZ1-29" x="2098" y="-1"></use></g></g></svg></span></span><script type="math/tex; mode=display" id="MathJax-Element-320">h_\theta \left( x \right)=g(z)=g\left(\theta^{T}x \right)</script></div><p>对比线性回归函数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-13-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.776ex" height="2.811ex" viewBox="0 -906.7 5500.9 1210.2" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E14-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E14-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E14-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E14-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E14-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E14-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E14-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMAIN-3D" x="2804" y="0"></use><g transform="translate(3860,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E14-MJMATHI-78" x="4928" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-13">h_\theta \left( x \right)=\theta^{T}x</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-14-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.116ex" height="1.877ex" viewBox="0 -504.6 480.5 808.1" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E15-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E15-MJMATHI-67" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-14">g</script> 表示逻辑函数(<a href='https://en.wikipedia.org/wiki/Logistic_function' target='_blank'>logistic function</a>)，复合起来，则称为逻辑回归函数。</p><p>逻辑函数是 S 形函数，会将所有实数映射到 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-15-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.168ex" height="2.577ex" viewBox="0 -806.1 2225.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E16-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E16-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E16-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E16-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E16-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E16-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E16-MJMAIN-30" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E16-MJMAIN-2C" x="890" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E16-MJMAIN-31" x="1335" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E16-MJMAIN-29" x="1835" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-15">(0, 1)</script> 范围。</p><p><a href='https://en.wikipedia.org/wiki/Sigmoid_function' target='_blank'>sigmoid 函数</a>（如下图）是逻辑函数的特殊情况，其公式为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.814ex" height="3.395ex" viewBox="0 -956.9 5517.2 1461.5" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E17-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E17-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E17-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E17-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E17-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E17-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E17-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E17-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E17-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMATHI-67" x="0" y="0"></use><g transform="translate(647,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMATHI-7A" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMAIN-29" x="858" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMAIN-3D" x="2172" y="0"></use><g transform="translate(2950,0)"><g transform="translate(397,0)"><rect stroke="none" width="2048" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMAIN-31" x="1198" y="572"></use><g transform="translate(59,-376)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMAIN-2212" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E17-MJMATHI-7A" x="778" y="0"></use></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-16">g\left( z \right)=\frac{1}{1+{{e}^{-z}}}</script>。 </p><p><img src='image/2413fbec8ff9fa1f19aaf78265b8a33b_Logistic_function.png' alt='sigmoid function' /></p><p>应用 sigmoid 函数，则逻辑回归模型：<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-17-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="25.328ex" height="3.978ex" viewBox="0 -956.9 10905.2 1712.8" role="img" focusable="false" style="vertical-align: -1.756ex;"><defs><path stroke-width="1" id="E18-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E18-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E18-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E18-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E18-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E18-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E18-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E18-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E18-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E18-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E18-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E18-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-3D" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-67" x="3694" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-28" x="4174" y="0"></use><g transform="translate(4564,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-78" x="5631" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-29" x="6204" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-3D" x="6871" y="0"></use><g transform="translate(7649,0)"><g transform="translate(397,0)"><rect stroke="none" width="2737" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-31" x="1685" y="572"></use><g transform="translate(60,-608)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-54" x="469" y="319"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E18-MJMATHI-78" x="2052" y="0"></use></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-17">h_{\theta}(x)=g(\theta^Tx) =\frac{1}{1+e^{-\theta^Tx}}</script></p><p>逻辑回归模型中，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-18-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.868ex" height="2.577ex" viewBox="0 -806.1 2526.7 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E19-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E19-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E19-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E19-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E19-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E19-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E19-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E19-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E19-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E19-MJMAIN-29" x="962" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-18">h_\theta \left( x \right)</script> 的作用是，根据输入 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-19-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E20-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E20-MJMATHI-78" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-19">x</script> 以及参数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-90-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E91-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E91-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-90">\theta</script>，计算得出”输出 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-53-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E54-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E54-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E54-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-53">y=1</script>“的可能性(estimated probability)，概率学中表示为：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-22-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="42.566ex" height="5.846ex" viewBox="0 -1509.8 18327.1 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E23-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E23-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E23-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E23-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E23-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E23-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E23-MJMATHI-50" d="M287 628Q287 635 230 637Q206 637 199 638T192 648Q192 649 194 659Q200 679 203 681T397 683Q587 682 600 680Q664 669 707 631T751 530Q751 453 685 389Q616 321 507 303Q500 302 402 301H307L277 182Q247 66 247 59Q247 55 248 54T255 50T272 48T305 46H336Q342 37 342 35Q342 19 335 5Q330 0 319 0Q316 0 282 1T182 2Q120 2 87 2T51 1Q33 1 33 11Q33 13 36 25Q40 41 44 43T67 46Q94 46 127 49Q141 52 146 61Q149 65 218 339T287 628ZM645 554Q645 567 643 575T634 597T609 619T560 635Q553 636 480 637Q463 637 445 637T416 636T404 636Q391 635 386 627Q384 621 367 550T332 412T314 344Q314 342 395 342H407H430Q542 342 590 392Q617 419 631 471T645 554Z"></path><path stroke-width="1" id="E23-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E23-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E23-MJMAIN-7C" d="M139 -249H137Q125 -249 119 -235V251L120 737Q130 750 139 750Q152 750 159 735V-235Q151 -249 141 -249H139Z"></path><path stroke-width="1" id="E23-MJMAIN-3B" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 85 94 103T137 121Q202 121 202 8Q202 -44 183 -94T144 -169T118 -194Q115 -194 106 -186T95 -174Q94 -171 107 -155T137 -107T160 -38Q161 -32 162 -22T165 -4T165 4Q165 5 161 4T142 0Q110 0 94 18T78 60Z"></path><path stroke-width="1" id="E23-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E23-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E23-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,651)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3D" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-50" x="3694" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-28" x="4445" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-79" x="4835" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3D" x="5610" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-31" x="6666" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-7C" x="7167" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-78" x="7445" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3B" x="8018" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-3B8" x="8463" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-29" x="8932" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3D" x="9600" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-31" x="10656" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-2212" x="11379" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-50" x="12379" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-28" x="13131" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-79" x="13520" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3D" x="14296" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-30" x="15352" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-7C" x="15852" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-78" x="16131" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3B" x="16703" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-3B8" x="17148" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-29" x="17618" y="0"></use></g><g transform="translate(0,-700)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-50" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-28" x="751" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-79" x="1141" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3D" x="1916" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-30" x="2972" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-7C" x="3473" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-78" x="3751" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3B" x="4324" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-3B8" x="4769" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-29" x="5238" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-2B" x="5850" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-50" x="6851" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-28" x="7602" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-79" x="7992" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3D" x="8767" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-31" x="9823" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-7C" x="10324" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-78" x="10602" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3B" x="11175" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMATHI-3B8" x="11620" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-29" x="12089" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-3D" x="12757" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E23-MJMAIN-31" x="13813" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-22">\begin{align*}& h_\theta(x) = P(y=1 | x ; \theta) = 1 - P(y=0 | x ; \theta) \newline & P(y = 0 | x;\theta) + P(y = 1 | x ; \theta) = 1\end{align*}</script></p><p>&nbsp;</p><p>以肿瘤诊断为例，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-23-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.939ex" height="2.577ex" viewBox="0 -806.1 5140.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E24-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E24-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E24-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E24-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E24-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E24-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E24-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E24-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E24-MJMAIN-37" d="M55 458Q56 460 72 567L88 674Q88 676 108 676H128V672Q128 662 143 655T195 646T364 644H485V605L417 512Q408 500 387 472T360 435T339 403T319 367T305 330T292 284T284 230T278 162T275 80Q275 66 275 52T274 28V19Q270 2 255 -10T221 -22Q210 -22 200 -19T179 0T168 40Q168 198 265 368Q285 400 349 489L395 552H302Q128 552 119 546Q113 543 108 522T98 479L95 458V455H55V458Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMAIN-3D" x="2804" y="0"></use><g transform="translate(3860,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E24-MJMAIN-37" x="779" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-23">h_\theta \left( x \right)=0.7</script> 表示病人有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-24-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.261ex" height="2.227ex" viewBox="0 -806.1 1834.5 958.9" role="img" focusable="false" style="vertical-align: -0.355ex;"><defs><path stroke-width="1" id="E25-MJMAIN-37" d="M55 458Q56 460 72 567L88 674Q88 676 108 676H128V672Q128 662 143 655T195 646T364 644H485V605L417 512Q408 500 387 472T360 435T339 403T319 367T305 330T292 284T284 230T278 162T275 80Q275 66 275 52T274 28V19Q270 2 255 -10T221 -22Q210 -22 200 -19T179 0T168 40Q168 198 265 368Q285 400 349 489L395 552H302Q128 552 119 546Q113 543 108 522T98 479L95 458V455H55V458Z"></path><path stroke-width="1" id="E25-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E25-MJMAIN-25" d="M465 605Q428 605 394 614T340 632T319 641Q332 608 332 548Q332 458 293 403T202 347Q145 347 101 402T56 548Q56 637 101 693T202 750Q241 750 272 719Q359 642 464 642Q580 642 650 732Q662 748 668 749Q670 750 673 750Q682 750 688 743T693 726Q178 -47 170 -52Q166 -56 160 -56Q147 -56 142 -45Q137 -36 142 -27Q143 -24 363 304Q469 462 525 546T581 630Q528 605 465 605ZM207 385Q235 385 263 427T292 548Q292 617 267 664T200 712Q193 712 186 709T167 698T147 668T134 615Q132 595 132 548V527Q132 436 165 403Q183 385 203 385H207ZM500 146Q500 234 544 290T647 347Q699 347 737 292T776 146T737 0T646 -56Q590 -56 545 0T500 146ZM651 -18Q679 -18 707 24T736 146Q736 215 711 262T644 309Q637 309 630 306T611 295T591 265T578 212Q577 200 577 146V124Q577 -18 647 -18H651Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E25-MJMAIN-37"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E25-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E25-MJMAIN-25" x="1001" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-24">70\%</script> 的概率得了恶性肿瘤。</p><h2><a name='header-n1057' class='md-header-anchor '></a>6.3 决策边界(Decision Boundary)</h2><p>决策边界的概念，可帮助我们更好地理解逻辑回归模型的拟合原理。</p><p>在逻辑回归中，有假设函数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-25-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="23.521ex" height="3.044ex" viewBox="0 -906.7 10127.1 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E26-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E26-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E26-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E26-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E26-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E26-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E26-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E26-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E26-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E26-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E26-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-67" x="3860" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMAIN-28" x="4341" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-7A" x="4730" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMAIN-29" x="5199" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMAIN-3D" x="5866" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-67" x="6922" y="0"></use><g transform="translate(7569,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJMATHI-78" x="1526" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E26-MJSZ1-29" x="2098" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-25">h_\theta \left( x \right)=g(z)=g\left(\theta^{T}x \right)</script>。</p><p>为了得出分类的结果，这里和前面一样，规定以 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-26-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.972ex" height="1.994ex" viewBox="0 -755.9 1279.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E27-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E27-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E27-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E27-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E27-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E27-MJMAIN-35" x="779" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-26">0.5</script> 为阈值：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-27-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="21.323ex" height="5.846ex" viewBox="0 -1509.8 9180.7 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E28-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E28-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E28-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E28-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E28-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E28-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E28-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E28-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E28-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E28-MJMAIN-2192" d="M56 237T56 250T70 270H835Q719 357 692 493Q692 494 692 496T691 499Q691 511 708 511H711Q720 511 723 510T729 506T732 497T735 481T743 456Q765 389 816 336T935 261Q944 258 944 250Q944 244 939 241T915 231T877 212Q836 186 806 152T761 85T740 35T732 4Q730 -6 727 -8T711 -11Q691 -11 691 0Q691 7 696 25Q728 151 835 230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E28-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E28-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E28-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E28-MJMAIN-3C" d="M694 -11T694 -19T688 -33T678 -40Q671 -40 524 29T234 166L90 235Q83 240 83 250Q83 261 91 266Q664 540 678 540Q681 540 687 534T694 519T687 505Q686 504 417 376L151 250L417 124Q686 -4 687 -5Q694 -11 694 -19Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,651)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-2265" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-35" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-2192" x="5251" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMATHI-79" x="6529" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-3D" x="7304" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-31" x="8361" y="0"></use></g><g transform="translate(0,-700)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-3C" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-35" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-2192" x="5251" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMATHI-79" x="6529" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-3D" x="7304" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E28-MJMAIN-30" x="8361" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-27">\begin{align*}& h_\theta(x) \geq 0.5 \rightarrow y = 1 \newline& h_\theta(x) < 0.5 \rightarrow y = 0 \newline\end{align*}</script></p><p>回忆一下逻辑函数的图像：</p><p><img src='image/2413fbec8ff9fa1f19aaf78265b8a33b_Logistic_function.png' alt='sigmoid function' /></p><p>观察可得当 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-28-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="10.084ex" height="2.577ex" viewBox="0 -806.1 4341.6 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E29-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E29-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E29-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E29-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E29-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E29-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E29-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E29-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E29-MJMATHI-67" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E29-MJMAIN-28" x="480" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E29-MJMATHI-7A" x="870" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E29-MJMAIN-29" x="1338" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E29-MJMAIN-2265" x="2005" y="0"></use><g transform="translate(3062,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E29-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E29-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E29-MJMAIN-35" x="779" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-28">g(z) \geq 0.5</script> 时，有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-37-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.349ex" height="2.227ex" viewBox="0 -755.9 2303.1 958.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E38-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E38-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E38-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E38-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E38-MJMAIN-2265" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E38-MJMAIN-30" x="1802" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-37">z \geq 0</script>，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-30-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="8.07ex" height="2.577ex" viewBox="0 -906.7 3474.7 1109.7" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E31-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E31-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E31-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E31-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E31-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E31-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E31-MJMATHI-54" x="663" y="513"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E31-MJMATHI-78" x="1067" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E31-MJMAIN-2265" x="1917" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E31-MJMAIN-30" x="2974" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-30">\theta^Tx \geq 0</script>。</p><p>同线性回归模型的不同点在于： <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-31-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.512ex" height="5.846ex" viewBox="0 -1509.8 13567.4 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E32-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E32-MJMAIN-2192" d="M56 237T56 250T70 270H835Q719 357 692 493Q692 494 692 496T691 499Q691 511 708 511H711Q720 511 723 510T729 506T732 497T735 481T743 456Q765 389 816 336T935 261Q944 258 944 250Q944 244 939 241T915 231T877 212Q836 186 806 152T761 85T740 35T732 4Q730 -6 727 -8T711 -11Q691 -11 691 0Q691 7 696 25Q728 151 835 230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E32-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E32-MJMAIN-221E" d="M55 217Q55 305 111 373T254 442Q342 442 419 381Q457 350 493 303L507 284L514 294Q618 442 747 442Q833 442 888 374T944 214Q944 128 889 59T743 -11Q657 -11 580 50Q542 81 506 128L492 147L485 137Q381 -11 252 -11Q166 -11 111 57T55 217ZM907 217Q907 285 869 341T761 397Q740 397 720 392T682 378T648 359T619 335T594 310T574 285T559 263T548 246L543 238L574 198Q605 158 622 138T664 94T714 61T765 51Q827 51 867 100T907 217ZM92 214Q92 145 131 89T239 33Q357 33 456 193L425 233Q364 312 334 337Q285 380 233 380Q171 380 132 331T92 214Z"></path><path stroke-width="1" id="E32-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E32-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E32-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E32-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E32-MJMAIN-21D2" d="M580 514Q580 525 596 525Q601 525 604 525T609 525T613 524T615 523T617 520T619 517T622 512Q659 438 720 381T831 300T927 263Q944 258 944 250T935 239T898 228T840 204Q696 134 622 -12Q618 -21 615 -22T600 -24Q580 -24 580 -17Q580 -13 585 0Q620 69 671 123L681 133H70Q56 140 56 153Q56 168 72 173H725L735 181Q774 211 852 250Q851 251 834 259T789 283T735 319L725 327H72Q56 332 56 347Q56 360 70 367H681L671 377Q638 412 609 458T580 514Z"></path><path stroke-width="1" id="E32-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E32-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E32-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E32-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E32-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,651)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2192" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2B" x="2024" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-221E" x="2803" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2C" x="3803" y="0"></use><g transform="translate(4248,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2212" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-221E" x="778" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2192" x="6350" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-30" x="7629" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-21D2" x="8407" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMATHI-67" x="9685" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-28" x="10166" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMATHI-7A" x="10555" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-29" x="11024" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-3D" x="11691" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-31" x="12747" y="0"></use></g><g transform="translate(50,-700)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2192" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2212" x="2024" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-221E" x="2803" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2C" x="3803" y="0"></use><g transform="translate(4248,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMATHI-65" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-221E" x="659" y="583"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-2192" x="5800" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-221E" x="7078" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-21D2" x="8357" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMATHI-67" x="9635" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-28" x="10115" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMATHI-7A" x="10505" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-29" x="10973" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-3D" x="11641" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E32-MJMAIN-30" x="12697" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-31">\begin{align*}z \to +\infty, e^{-\infty} \to 0 \Rightarrow g(z)=1 \newline z \to -\infty, e^{\infty}\to \infty \Rightarrow g(z)=0 \end{align*}</script></p><p>直观一点来个例子，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-32-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="29.162ex" height="2.577ex" viewBox="0 -806.1 12555.8 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E33-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E33-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E33-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E33-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E33-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E33-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E33-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E33-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E33-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E33-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E33-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-67" x="3860" y="0"></use><g transform="translate(4507,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-2B" x="1535" y="0"></use><g transform="translate(2535,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(3459,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-2B" x="4707" y="0"></use><g transform="translate(5708,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(6632,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E33-MJMAIN-29" x="7658" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-32">{h_\theta}\left( x \right)=g\left( {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}\right)</script> 是下图模型的假设函数：</p><p><img src='image/20180111_000814.png' alt='' /></p><p>根据上面的讨论，要进行分类，那么只要 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-33-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="21.144ex" height="2.461ex" viewBox="0 -806.1 9103.5 1059.4" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E34-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E34-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E34-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E34-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E34-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E34-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E34-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-30" x="663" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-2B" x="1145" y="0"></use><g transform="translate(2146,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(3069,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-2B" x="4318" y="0"></use><g transform="translate(5319,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(6242,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-2265" x="7546" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E34-MJMAIN-30" x="8602" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-33"> {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}\geq0</script> 时，就预测 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-62-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E63-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E63-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E63-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-62">y = 1</script>，即预测为正向类。</p><p>如果取 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-35-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.001ex" height="9.114ex" viewBox="0 -2213.4 4736.6 3924.2" role="img" focusable="false" style="vertical-align: -3.974ex;"><defs><path stroke-width="1" id="E36-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E36-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E36-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E36-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E36-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E36-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E36-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E36-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E36-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E36-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E36-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E36-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E36-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMATHI-3B8" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMAIN-3D" x="747" y="0"></use><g transform="translate(1803,0)"><g transform="translate(0,2150)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-2048.5066225165565) scale(1,0.49337748344370863)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJSZ4-23A3" x="0" y="-3155"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,1350)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMAIN-2212" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMAIN-33" x="778" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMAIN-31" x="389" y="-50"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMAIN-31" x="389" y="-1450"></use></g></g><g transform="translate(2265,2150)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-2048.5066225165565) scale(1,0.49337748344370863)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJSZ4-23A6" x="0" y="-3155"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-35">\theta = \begin{bmatrix} -3\\1\\1\end{bmatrix}</script>，则有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-36-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.606ex" height="2.227ex" viewBox="0 -755.9 7580.3 958.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E37-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E37-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E37-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E37-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E37-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E37-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E37-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E37-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMAIN-3D" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMAIN-2212" x="1802" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMAIN-33" x="2581" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMAIN-2B" x="3303" y="0"></use><g transform="translate(4304,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMAIN-2B" x="5553" y="0"></use><g transform="translate(6553,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E37-MJMAIN-32" x="809" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-36">z = -3+{x_1}+{x_2}</script>，当 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-37-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.349ex" height="2.227ex" viewBox="0 -755.9 2303.1 958.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E38-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E38-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E38-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E38-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E38-MJMAIN-2265" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E38-MJMAIN-30" x="1802" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-37">z \geq 0</script> 即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-38-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.869ex" height="2.227ex" viewBox="0 -755.9 5110.3 958.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E39-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E39-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E39-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E39-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E39-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E39-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E39-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E39-MJMAIN-31" x="809" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E39-MJMAIN-2B" x="1248" y="0"></use><g transform="translate(2249,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E39-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E39-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E39-MJMAIN-2265" x="3553" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E39-MJMAIN-33" x="4609" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-38">{x_1}+{x_2} \geq 3</script> 时，易绘制图中的品红色直线即<strong>决策边界</strong>，为正向类（以红叉标注的数据）给出 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-53-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E54-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E54-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E54-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-53">y=1</script> 的分类预测结果。</p><p>&nbsp;</p><p>上面讨论了逻辑回归模型中线性拟合的例子，下面则是一个多项式拟合的例子，和线性回归中的情况也是类似的。</p><p>为了拟合下图数据，建模多项式假设函数：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-40-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="44.221ex" height="3.044ex" viewBox="0 -906.7 19039.3 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E41-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E41-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E41-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E41-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E41-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E41-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E41-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E41-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E41-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E41-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E41-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E41-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E41-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path><path stroke-width="1" id="E41-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E41-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-67" x="3860" y="0"></use><g transform="translate(4507,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-2B" x="1604" y="0"></use><g transform="translate(2604,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(3528,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-2B" x="4776" y="0"></use><g transform="translate(5777,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(6701,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-2B" x="7949" y="0"></use><g transform="translate(8950,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-33" x="663" y="-213"></use></g><g transform="translate(9873,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-32" x="809" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-31" x="809" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-2B" x="11122" y="0"></use><g transform="translate(12123,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-34" x="663" y="-213"></use></g><g transform="translate(13046,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-32" x="809" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJMAIN-32" x="809" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E41-MJSZ1-29" x="14072" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-40">{h_\theta}\left( x \right)=g\left( {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}+{\theta_{3}}x_{1}^{2}+{\theta_{4}}x_{2}^{2} \right)</script></p><p>这里取 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.001ex" height="15.651ex" viewBox="0 -3620.7 4736.6 6738.7" role="img" focusable="false" style="vertical-align: -7.242ex;"><defs><path stroke-width="1" id="E42-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E42-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E42-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E42-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E42-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E42-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E42-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E42-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E42-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E42-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E42-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E42-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E42-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJMATHI-3B8" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJMAIN-3D" x="747" y="0"></use><g transform="translate(1803,0)"><g transform="translate(0,3550)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-4843.8708609271525) scale(1,5.129139072847682)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJSZ4-23A3" x="0" y="-5955"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,2750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJMAIN-2212" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJMAIN-31" x="778" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJMAIN-30" x="389" y="1350"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJMAIN-30" x="389" y="-50"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJMAIN-31" x="389" y="-1450"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJMAIN-31" x="389" y="-2850"></use></g></g><g transform="translate(2265,3550)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-4843.8708609271525) scale(1,5.129139072847682)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E42-MJSZ4-23A6" x="0" y="-5955"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-41">\theta = \begin{bmatrix} -1\\0\\0\\1\\1\end{bmatrix}</script>，决策边界对应了一个在原点处的单位圆（<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-42-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.978ex" height="2.577ex" viewBox="0 -906.7 6018.1 1109.7" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E43-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E43-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E43-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E43-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E43-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMAIN-31" x="809" y="-213"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMAIN-32" x="1451" y="513"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMAIN-2B" x="1702" y="0"></use><g transform="translate(2703,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMAIN-32" x="809" y="-213"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMAIN-32" x="1451" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMAIN-3D" x="4461" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E43-MJMAIN-31" x="5517" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-42">{x_1}^2+{x_2}^2 = 1</script>），如此便可给出分类结果，如图中品红色曲线：</p><p>&nbsp;</p><p><img src='image/20180111_000653.png' alt='' /></p><p>当然，通过一些更为复杂的多项式，还能拟合那些图像显得非常怪异的数据，使得决策边界形似碗状、爱心状等等。</p><p>&nbsp;</p><p>简单来说，决策边界就是<strong>分类的分界线</strong>，分类现在实际就由 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-43-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.088ex" height="1.41ex" viewBox="0 -504.6 468.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E44-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E44-MJMATHI-7A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-43">z</script> (中的 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-90-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E91-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E91-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-90">\theta</script>)决定啦。</p><h2><a name='header-n1102' class='md-header-anchor '></a>6.4 损失函数(Cost Function)</h2><p>那我们怎么知道决策边界是啥样？<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-90-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E91-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E91-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-90">\theta</script> 多少时能很好的拟合数据？当然，见招拆招，总要来个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-92-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E93-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E93-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E93-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E93-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-92">J(\theta)</script>。</p><p>如果直接套用线性回归的损失函数： <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-47-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.932ex" height="5.846ex" viewBox="0 -1459.5 13748.3 2517" role="img" focusable="false" style="vertical-align: -2.456ex;"><defs><path stroke-width="1" id="E48-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E48-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E48-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E48-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E48-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E48-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E48-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E48-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E48-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E48-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E48-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E48-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E48-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E48-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E48-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E48-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-4A" x="0" y="0"></use><g transform="translate(800,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-3B8" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-29" x="859" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-3D" x="2326" y="0"></use><g transform="translate(3104,0)"><g transform="translate(397,0)"><rect stroke="none" width="1095" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-31" x="524" y="572"></use><g transform="translate(60,-376)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-32" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6D" x="500" y="0"></use></g></g></g><g transform="translate(4884,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJSZ1-2211" x="46" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6D" x="372" y="1344"></use></g><g transform="translate(6199,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1633,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-2212" x="4240" y="0"></use><g transform="translate(5241,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJSZ1-29" x="6636" y="-1"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMAIN-32" x="10033" y="878"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-47">J\left( {\theta} \right)=\frac{1}{2m}\sum\limits_{i=1}^{m}{{{\left( h_{\theta} \left({x}^{\left( i \right)} \right)-{y}^{\left( i \right)} \right)}^{2}}}</script></p><p>其中 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-70-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="16.022ex" height="3.044ex" viewBox="0 -906.7 6898.4 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E71-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E71-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E71-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E71-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E71-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E71-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E71-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E71-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E71-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E71-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMAIN-3D" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-67" x="3694" y="0"></use><g transform="translate(4341,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-78" x="1526" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJSZ1-29" x="2098" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-70">h_\theta(x) = g\left(\theta^{T}x \right)</script>，可绘制关于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-92-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E93-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E93-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E93-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E93-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-92">J(\theta)</script> 的图像，如下图</p><p><img src='image/20180111_080314.png' alt='' /></p><p>回忆线性回归中的损失函数，其是一个二次凸函数（碗状），二次凸函数的重要性质是只有一个局部最小点即全局最小点。上图中有许多局部最小点，这样将使得梯度下降算法无法确定收敛点是全局最优。</p><p><img src='image/20180111_080514.png' alt='' /></p><p>如果损失函数也是一个凸函数，是否也有同样的性质，从而最优化？这类讨论凸函数最优值的问题，被称为<strong>凸优化问题(Convex optimization)</strong>。</p><p>当然，损失函数不止平方损失函数一种。</p><p>对于逻辑回归，更换平方损失函数为<strong>对数损失函数</strong>，可由统计学中的最大似然估计方法可推出损失函数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-92-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E93-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E93-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E93-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E93-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-92">J(\theta)</script>：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-51-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="47.03ex" height="13.083ex" viewBox="0 -3067.8 20249.2 5633" role="img" focusable="false" style="vertical-align: -5.958ex;"><defs><path stroke-width="1" id="E52-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E52-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E52-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E52-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E52-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E52-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E52-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E52-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E52-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E52-MJMAIN-43" d="M56 342Q56 428 89 500T174 615T283 681T391 705Q394 705 400 705T408 704Q499 704 569 636L582 624L612 663Q639 700 643 704Q644 704 647 704T653 705H657Q660 705 666 699V419L660 413H626Q620 419 619 430Q610 512 571 572T476 651Q457 658 426 658Q322 658 252 588Q173 509 173 342Q173 221 211 151Q232 111 263 84T328 45T384 29T428 24Q517 24 571 93T626 244Q626 251 632 257H660L666 251V236Q661 133 590 56T403 -21Q262 -21 159 83T56 342Z"></path><path stroke-width="1" id="E52-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E52-MJMAIN-73" d="M295 316Q295 356 268 385T190 414Q154 414 128 401Q98 382 98 349Q97 344 98 336T114 312T157 287Q175 282 201 278T245 269T277 256Q294 248 310 236T342 195T359 133Q359 71 321 31T198 -10H190Q138 -10 94 26L86 19L77 10Q71 4 65 -1L54 -11H46H42Q39 -11 33 -5V74V132Q33 153 35 157T45 162H54Q66 162 70 158T75 146T82 119T101 77Q136 26 198 26Q295 26 295 104Q295 133 277 151Q257 175 194 187T111 210Q75 227 54 256T33 318Q33 357 50 384T93 424T143 442T187 447H198Q238 447 268 432L283 424L292 431Q302 440 314 448H322H326Q329 448 335 442V310L329 304H301Q295 310 295 316Z"></path><path stroke-width="1" id="E52-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E52-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E52-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E52-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E52-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E52-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E52-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E52-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E52-MJMAIN-69" d="M69 609Q69 637 87 653T131 669Q154 667 171 652T188 609Q188 579 171 564T129 549Q104 549 87 564T69 609ZM247 0Q232 3 143 3Q132 3 106 3T56 1L34 0H26V46H42Q70 46 91 49Q100 53 102 60T104 102V205V293Q104 345 102 359T88 378Q74 385 41 385H30V408Q30 431 32 431L42 432Q52 433 70 434T106 436Q123 437 142 438T171 441T182 442H185V62Q190 52 197 50T232 46H255V0H247Z"></path><path stroke-width="1" id="E52-MJMAIN-66" d="M273 0Q255 3 146 3Q43 3 34 0H26V46H42Q70 46 91 49Q99 52 103 60Q104 62 104 224V385H33V431H104V497L105 564L107 574Q126 639 171 668T266 704Q267 704 275 704T289 705Q330 702 351 679T372 627Q372 604 358 590T321 576T284 590T270 627Q270 647 288 667H284Q280 668 273 668Q245 668 223 647T189 592Q183 572 182 497V431H293V385H185V225Q185 63 186 61T189 57T194 54T199 51T206 49T213 48T222 47T231 47T241 46T251 46H282V0H273Z"></path><path stroke-width="1" id="E52-MJMAIN-79" d="M69 -66Q91 -66 104 -80T118 -116Q118 -134 109 -145T91 -160Q84 -163 97 -166Q104 -168 111 -168Q131 -168 148 -159T175 -138T197 -106T213 -75T225 -43L242 0L170 183Q150 233 125 297Q101 358 96 368T80 381Q79 382 78 382Q66 385 34 385H19V431H26L46 430Q65 430 88 429T122 428Q129 428 142 428T171 429T200 430T224 430L233 431H241V385H232Q183 385 185 366L286 112Q286 113 332 227L376 341V350Q376 365 366 373T348 383T334 385H331V431H337H344Q351 431 361 431T382 430T405 429T422 429Q477 429 503 431H508V385H497Q441 380 422 345Q420 343 378 235T289 9T227 -131Q180 -204 113 -204Q69 -204 44 -177T19 -116Q19 -89 35 -78T69 -66Z"></path><path stroke-width="1" id="E52-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,1417)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-3D" x="2159" y="0"></use><g transform="translate(3216,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(4621,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-6D" x="582" y="1627"></use></g><g transform="translate(6232,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-43" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-6F" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-73" x="1223" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-74" x="1617" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="8239" y="0"></use><g transform="translate(8628,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="9637" y="0"></use><g transform="translate(10026,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="11494" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-2C" x="11884" y="0"></use><g transform="translate(12329,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="13723" y="0"></use></g><g transform="translate(0,-881)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-43" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-6F" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-73" x="1223" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-74" x="1617" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="2007" y="0"></use><g transform="translate(2396,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="3404" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-78" x="3794" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="4366" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-2C" x="4756" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-79" x="5201" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="5699" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-3D" x="6366" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-2212" x="7422" y="0"></use><g transform="translate(8367,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="9647" y="0"></use><g transform="translate(10036,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="11045" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-78" x="11434" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="12007" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="12396" y="0"></use></g><g transform="translate(0,-2232)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-43" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-6F" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-73" x="1223" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-74" x="1617" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="2007" y="0"></use><g transform="translate(2396,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="3404" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-78" x="3794" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="4366" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-2C" x="4756" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-79" x="5201" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="5699" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-3D" x="6366" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-2212" x="7422" y="0"></use><g transform="translate(8367,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="9647" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-31" x="10036" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-2212" x="10759" y="0"></use><g transform="translate(11760,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-28" x="12768" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-78" x="13158" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="13730" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-29" x="14120" y="0"></use></g></g><g transform="translate(16772,0)"><g transform="translate(0,-881)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-69"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-66" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-79" x="835" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-3D" x="1613" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-31" x="2642" y="0"></use></g><g transform="translate(0,-2232)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-69"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-66" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-79" x="835" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-3D" x="1613" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-30" x="2642" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-51">\begin{align*}& J(\theta) = \dfrac{1}{m} \sum_{i=1}^m \mathrm{Cost}(h_\theta(x^{(i)}),y^{(i)}) \newline & \mathrm{Cost}(h_\theta(x),y) = -\log(h_\theta(x)) \; & \text{if y = 1} \newline & \mathrm{Cost}(h_\theta(x),y) = -\log(1-h_\theta(x)) \; & \text{if y = 0}\end{align*}</script></p><p>则有关于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-92-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E93-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E93-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E93-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E93-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-92">J(\theta)</script> 的图像如下：</p><p><img src='image/20180111_080614.png' alt='' /></p><p>如左图，当训练集的结果为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-53-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E54-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E54-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E54-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E54-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-53">y=1</script>（正样本）时，随着假设函数趋向于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-54-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E55-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E55-MJMAIN-31" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-54">1</script>，损失函数的值会趋于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-136-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E138-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E138-MJMAIN-30" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-136">0</script>，即意味着拟合程度很好。如果假设函数此时趋于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-136-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E138-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E138-MJMAIN-30" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-136">0</script>，则会给出一个<strong>很高的损失</strong>，拟合程度<strong>差</strong>，算法会根据其迅速纠正 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-90-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E91-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E91-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-90">\theta</script> 值，右图 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-58-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E59-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E59-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E59-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E59-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E59-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E59-MJMAIN-30" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-58">y=0</script> 同理。</p><p>区别于平方损失函数，对数损失函数也是一个凸函数，但没有局部最优值。</p><h2><a name='header-n1131' class='md-header-anchor '></a>6.5 简化的成本函数和梯度下降(Simplified Cost Function and Gradient Descent)</h2><p>由于懒得分类讨论，对于二元分类问题，我们可把损失函数<strong>简化</strong>为一个函数： 
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-59-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="63.022ex" height="2.577ex" viewBox="0 -806.1 27134.6 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E60-MJMATHI-43" d="M50 252Q50 367 117 473T286 641T490 704Q580 704 633 653Q642 643 648 636T656 626L657 623Q660 623 684 649Q691 655 699 663T715 679T725 690L740 705H746Q760 705 760 698Q760 694 728 561Q692 422 692 421Q690 416 687 415T669 413H653Q647 419 647 422Q647 423 648 429T650 449T651 481Q651 552 619 605T510 659Q484 659 454 652T382 628T299 572T226 479Q194 422 175 346T156 222Q156 108 232 58Q280 24 350 24Q441 24 512 92T606 240Q610 253 612 255T628 257Q648 257 648 248Q648 243 647 239Q618 132 523 55T319 -22Q206 -22 128 53T50 252Z"></path><path stroke-width="1" id="E60-MJMATHI-6F" d="M201 -11Q126 -11 80 38T34 156Q34 221 64 279T146 380Q222 441 301 441Q333 441 341 440Q354 437 367 433T402 417T438 387T464 338T476 268Q476 161 390 75T201 -11ZM121 120Q121 70 147 48T206 26Q250 26 289 58T351 142Q360 163 374 216T388 308Q388 352 370 375Q346 405 306 405Q243 405 195 347Q158 303 140 230T121 120Z"></path><path stroke-width="1" id="E60-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E60-MJMATHI-74" d="M26 385Q19 392 19 395Q19 399 22 411T27 425Q29 430 36 430T87 431H140L159 511Q162 522 166 540T173 566T179 586T187 603T197 615T211 624T229 626Q247 625 254 615T261 596Q261 589 252 549T232 470L222 433Q222 431 272 431H323Q330 424 330 420Q330 398 317 385H210L174 240Q135 80 135 68Q135 26 162 26Q197 26 230 60T283 144Q285 150 288 151T303 153H307Q322 153 322 145Q322 142 319 133Q314 117 301 95T267 48T216 6T155 -11Q125 -11 98 4T59 56Q57 64 57 83V101L92 241Q127 382 128 383Q128 385 77 385H26Z"></path><path stroke-width="1" id="E60-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E60-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E60-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E60-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E60-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E60-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E60-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E60-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E60-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E60-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E60-MJMATHI-6C" d="M117 59Q117 26 142 26Q179 26 205 131Q211 151 215 152Q217 153 225 153H229Q238 153 241 153T246 151T248 144Q247 138 245 128T234 90T214 43T183 6T137 -11Q101 -11 70 11T38 85Q38 97 39 102L104 360Q167 615 167 623Q167 626 166 628T162 632T157 634T149 635T141 636T132 637T122 637Q112 637 109 637T101 638T95 641T94 647Q94 649 96 661Q101 680 107 682T179 688Q194 689 213 690T243 693T254 694Q266 694 266 686Q266 675 193 386T118 83Q118 81 118 75T117 65V59Z"></path><path stroke-width="1" id="E60-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E60-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-43" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-6F" x="760" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-73" x="1246" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-74" x="1715" y="0"></use><g transform="translate(2243,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1564,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-2C" x="3082" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-79" x="3527" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-29" x="4025" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-3D" x="6936" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-2212" x="7992" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-79" x="8771" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-D7" x="9490" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-6C" x="10491" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-6F" x="10790" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-67" x="11275" y="0"></use><g transform="translate(11922,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1564,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-29" x="2916" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-2212" x="15450" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-28" x="16451" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-31" x="16840" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-2212" x="17563" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-79" x="18564" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-29" x="19061" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-D7" x="19673" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-6C" x="20674" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-6F" x="20972" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-67" x="21458" y="0"></use><g transform="translate(22105,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-31" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-2212" x="1112" y="0"></use><g transform="translate(2112,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(3288,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E60-MJMAIN-29" x="4639" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-59">Cost\left( {h_\theta}\left( x \right),y \right)=-y\times log\left( {h_\theta}\left( x \right) \right)-(1-y)\times log\left( 1-{h_\theta}\left( x \right) \right)</script></p><p>当 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-60-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E61-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E61-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E61-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E61-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E61-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E61-MJMAIN-30" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-60">y = 0</script>，左边式子整体为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-136-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E138-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E138-MJMAIN-30" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-136">0</script>，当 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-62-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E63-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E63-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E63-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E63-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-62">y = 1</script>，则 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-63-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.419ex" height="2.461ex" viewBox="0 -755.9 4055.5 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E64-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E64-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E64-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E64-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E64-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-31" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-2212" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-79" x="1723" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-3D" x="2498" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-30" x="3555" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-63">1-y=0</script>，右边式子整体为0，也就和上面的分段函数一样了，而一个式子计算起来更方便。</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-72-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="61.184ex" height="6.78ex" viewBox="0 -1660.6 26342.9 2919" role="img" focusable="false" style="vertical-align: -2.923ex;"><defs><path stroke-width="1" id="E73-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E73-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E73-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E73-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E73-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E73-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E73-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E73-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E73-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E73-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E73-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E73-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E73-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E73-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E73-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E73-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E73-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E73-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E73-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-3D" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-2212" x="3216" y="0"></use><g transform="translate(3994,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(5142,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-6D" x="582" y="1627"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-5B" x="1444" y="0"></use><g transform="translate(1723,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(3284,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="4563" y="0"></use><g transform="translate(4953,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="5961" y="0"></use><g transform="translate(6351,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="7819" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="8208" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-2B" x="8820" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="9821" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-31" x="10210" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-2212" x="10933" y="0"></use><g transform="translate(11933,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="13328" y="0"></use><g transform="translate(13884,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="15164" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-31" x="15553" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-2212" x="16276" y="0"></use><g transform="translate(17277,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="18285" y="0"></use><g transform="translate(18675,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="20143" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="20532" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-5D" x="20922" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-72">J(\theta) = - \frac{1}{m} \displaystyle \sum_{i=1}^m [y^{(i)}\log (h_\theta (x^{(i)})) + (1 - y^{(i)})\log (1 - h_\theta(x^{(i)}))]</script></p><p>向量化实现：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-65-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="10.433ex" height="2.577ex" viewBox="0 -806.1 4492.1 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E66-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E66-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E66-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E66-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E66-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E66-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E66-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E66-MJMATHI-68" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E66-MJMAIN-3D" x="854" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E66-MJMATHI-67" x="1910" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E66-MJMAIN-28" x="2391" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E66-MJMATHI-58" x="2780" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E66-MJMATHI-3B8" x="3633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E66-MJMAIN-29" x="4102" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-65">h = g(X\theta)</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-66-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="46.13ex" height="3.278ex" viewBox="0 -956.9 19861.3 1411.3" role="img" focusable="false" style="vertical-align: -1.055ex;"><defs><path stroke-width="1" id="E67-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E67-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E67-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E67-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E67-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E67-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E67-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E67-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E67-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E67-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E67-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E67-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E67-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E67-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E67-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E67-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E67-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-3D" x="2159" y="0"></use><g transform="translate(2938,0)"><g transform="translate(397,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-6D" x="84" y="-488"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-22C5" x="4419" y="0"></use><g transform="translate(4920,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-2212" x="458" y="0"></use><g transform="translate(1237,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-79" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-54" x="706" y="513"></use></g><g transform="translate(2501,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-28" x="3780" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-68" x="4170" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-29" x="4746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-2212" x="5358" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-28" x="6359" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-31" x="6748" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-2212" x="7471" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-79" x="8472" y="0"></use><g transform="translate(8969,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-54" x="550" y="513"></use></g><g transform="translate(10124,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-28" x="11403" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-31" x="11793" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-2212" x="12515" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMATHI-68" x="13516" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJMAIN-29" x="14093" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E67-MJSZ1-29" x="14482" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-66">J(\theta) = \frac{1}{m} \cdot \left(-y^{T}\log(h)-(1-y)^{T}\log(1-h)\right)</script></p><p>&nbsp;</p><p>为了最优化 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-90-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E91-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E91-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-90">\theta</script>，仍使用梯度下降法，算法同线性回归中一致：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-68-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="28.85ex" height="12.149ex" viewBox="0 -2866.8 12421.4 5231" role="img" focusable="false" style="vertical-align: -5.491ex;"><defs><path stroke-width="1" id="E69-MJMAIN-72" d="M36 46H50Q89 46 97 60V68Q97 77 97 91T98 122T98 161T98 203Q98 234 98 269T98 328L97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 60 434T96 436Q112 437 131 438T160 441T171 442H174V373Q213 441 271 441H277Q322 441 343 419T364 373Q364 352 351 337T313 322Q288 322 276 338T263 372Q263 381 265 388T270 400T273 405Q271 407 250 401Q234 393 226 386Q179 341 179 207V154Q179 141 179 127T179 101T180 81T180 66V61Q181 59 183 57T188 54T193 51T200 49T207 48T216 47T225 47T235 46T245 46H276V0H267Q249 3 140 3Q37 3 28 0H20V46H36Z"></path><path stroke-width="1" id="E69-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E69-MJMAIN-70" d="M36 -148H50Q89 -148 97 -134V-126Q97 -119 97 -107T97 -77T98 -38T98 6T98 55T98 106Q98 140 98 177T98 243T98 296T97 335T97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 61 434T98 436Q115 437 135 438T165 441T176 442H179V416L180 390L188 397Q247 441 326 441Q407 441 464 377T522 216Q522 115 457 52T310 -11Q242 -11 190 33L182 40V-45V-101Q182 -128 184 -134T195 -145Q216 -148 244 -148H260V-194H252L228 -193Q205 -192 178 -192T140 -191Q37 -191 28 -194H20V-148H36ZM424 218Q424 292 390 347T305 402Q234 402 182 337V98Q222 26 294 26Q345 26 384 80T424 218Z"></path><path stroke-width="1" id="E69-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E69-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E69-MJMAIN-75" d="M383 58Q327 -10 256 -10H249Q124 -10 105 89Q104 96 103 226Q102 335 102 348T96 369Q86 385 36 385H25V408Q25 431 27 431L38 432Q48 433 67 434T105 436Q122 437 142 438T172 441T184 442H187V261Q188 77 190 64Q193 49 204 40Q224 26 264 26Q290 26 311 35T343 58T363 90T375 120T379 144Q379 145 379 161T380 201T380 248V315Q380 361 370 372T320 385H302V431Q304 431 378 436T457 442H464V264Q464 84 465 81Q468 61 479 55T524 46H542V0Q540 0 467 -5T390 -11H383V58Z"></path><path stroke-width="1" id="E69-MJMAIN-6E" d="M41 46H55Q94 46 102 60V68Q102 77 102 91T102 122T103 161T103 203Q103 234 103 269T102 328V351Q99 370 88 376T43 385H25V408Q25 431 27 431L37 432Q47 433 65 434T102 436Q119 437 138 438T167 441T178 442H181V402Q181 364 182 364T187 369T199 384T218 402T247 421T285 437Q305 442 336 442Q450 438 463 329Q464 322 464 190V104Q464 66 466 59T477 49Q498 46 526 46H542V0H534L510 1Q487 2 460 2T422 3Q319 3 310 0H302V46H318Q379 46 379 62Q380 64 380 200Q379 335 378 343Q372 371 358 385T334 402T308 404Q263 404 229 370Q202 343 195 315T187 232V168V108Q187 78 188 68T191 55T200 49Q221 46 249 46H265V0H257L234 1Q210 2 183 2T145 3Q42 3 33 0H25V46H41Z"></path><path stroke-width="1" id="E69-MJMAIN-69" d="M69 609Q69 637 87 653T131 669Q154 667 171 652T188 609Q188 579 171 564T129 549Q104 549 87 564T69 609ZM247 0Q232 3 143 3Q132 3 106 3T56 1L34 0H26V46H42Q70 46 91 49Q100 53 102 60T104 102V205V293Q104 345 102 359T88 378Q74 385 41 385H30V408Q30 431 32 431L42 432Q52 433 70 434T106 436Q123 437 142 438T171 441T182 442H185V62Q190 52 197 50T232 46H255V0H247Z"></path><path stroke-width="1" id="E69-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E69-MJMAIN-63" d="M370 305T349 305T313 320T297 358Q297 381 312 396Q317 401 317 402T307 404Q281 408 258 408Q209 408 178 376Q131 329 131 219Q131 137 162 90Q203 29 272 29Q313 29 338 55T374 117Q376 125 379 127T395 129H409Q415 123 415 120Q415 116 411 104T395 71T366 33T318 2T249 -11Q163 -11 99 53T34 214Q34 318 99 383T250 448T370 421T404 357Q404 334 387 320Z"></path><path stroke-width="1" id="E69-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E69-MJMAIN-76" d="M338 431Q344 429 422 429Q479 429 503 431H508V385H497Q439 381 423 345Q421 341 356 172T288 -2Q283 -11 263 -11Q244 -11 239 -2Q99 359 98 364Q93 378 82 381T43 385H19V431H25L33 430Q41 430 53 430T79 430T104 429T122 428Q217 428 232 431H240V385H226Q187 384 184 370Q184 366 235 234L286 102L377 341V349Q377 363 367 372T349 383T335 385H331V431H338Z"></path><path stroke-width="1" id="E69-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E69-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E69-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E69-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E69-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E69-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E69-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E69-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E69-MJMAIN-2202" d="M202 508Q179 508 169 520T158 547Q158 557 164 577T185 624T230 675T301 710L333 715H345Q378 715 384 714Q447 703 489 661T549 568T566 457Q566 362 519 240T402 53Q321 -22 223 -22Q123 -22 73 56Q42 102 42 148V159Q42 276 129 370T322 465Q383 465 414 434T455 367L458 378Q478 461 478 515Q478 603 437 639T344 676Q266 676 223 612Q264 606 264 572Q264 547 246 528T202 508ZM430 306Q430 372 401 400T333 428Q270 428 222 382Q197 354 183 323T150 221Q132 149 132 116Q132 21 232 21Q244 21 250 22Q327 35 374 112Q389 137 409 196T430 306Z"></path><path stroke-width="1" id="E69-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E69-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E69-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E69-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-7D" x="0" y="-2037"></use></g><g transform="translate(485,0)"><g transform="translate(0,1987)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-72"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-65" x="392" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-70" x="837" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-65" x="1393" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-61" x="1838" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-74" x="2338" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-75" x="2978" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-6E" x="3534" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-74" x="4091" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-69" x="4480" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-6C" x="4759" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-63" x="5287" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-6F" x="5732" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-6E" x="6232" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-76" x="6789" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-65" x="7317" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-72" x="7762" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-67" x="8154" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-65" x="8655" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-6E" x="9099" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-63" x="9656" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-65" x="10100" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-3A" x="10545" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-7B" x="11101" y="0"></use></g><g transform="translate(0,44)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-6A" x="663" y="-213"></use><g transform="translate(1138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(2473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-2212" x="3557" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-3B1" x="4557" y="0"></use><g transform="translate(5198,0)"><g transform="translate(120,0)"><rect stroke="none" width="1548" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-2202" x="490" y="676"></use><g transform="translate(60,-686)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-2202" x="0" y="0"></use><g transform="translate(567,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-6A" x="663" y="-213"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-4A" x="6987" y="0"></use><g transform="translate(7787,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMATHI-3B8" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E69-MJMAIN-29" x="859" y="0"></use></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-68">\begin{align*} & \text{repeat until convergence:} \; \lbrace \newline \; &{{\theta }_{j}}:={{\theta }_{j}}-\alpha \frac{\partial }{\partial {{\theta }_{j}}}J\left( {\theta}  \right) \newline \rbrace \end{align*}</script></p><p>解出偏导得：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-69-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="60.323ex" height="13.083ex" viewBox="0 -3067.8 25972.3 5633" role="img" focusable="false" style="vertical-align: -5.958ex;"><defs><path stroke-width="1" id="E70-MJMAIN-72" d="M36 46H50Q89 46 97 60V68Q97 77 97 91T98 122T98 161T98 203Q98 234 98 269T98 328L97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 60 434T96 436Q112 437 131 438T160 441T171 442H174V373Q213 441 271 441H277Q322 441 343 419T364 373Q364 352 351 337T313 322Q288 322 276 338T263 372Q263 381 265 388T270 400T273 405Q271 407 250 401Q234 393 226 386Q179 341 179 207V154Q179 141 179 127T179 101T180 81T180 66V61Q181 59 183 57T188 54T193 51T200 49T207 48T216 47T225 47T235 46T245 46H276V0H267Q249 3 140 3Q37 3 28 0H20V46H36Z"></path><path stroke-width="1" id="E70-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E70-MJMAIN-70" d="M36 -148H50Q89 -148 97 -134V-126Q97 -119 97 -107T97 -77T98 -38T98 6T98 55T98 106Q98 140 98 177T98 243T98 296T97 335T97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 61 434T98 436Q115 437 135 438T165 441T176 442H179V416L180 390L188 397Q247 441 326 441Q407 441 464 377T522 216Q522 115 457 52T310 -11Q242 -11 190 33L182 40V-45V-101Q182 -128 184 -134T195 -145Q216 -148 244 -148H260V-194H252L228 -193Q205 -192 178 -192T140 -191Q37 -191 28 -194H20V-148H36ZM424 218Q424 292 390 347T305 402Q234 402 182 337V98Q222 26 294 26Q345 26 384 80T424 218Z"></path><path stroke-width="1" id="E70-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E70-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E70-MJMAIN-75" d="M383 58Q327 -10 256 -10H249Q124 -10 105 89Q104 96 103 226Q102 335 102 348T96 369Q86 385 36 385H25V408Q25 431 27 431L38 432Q48 433 67 434T105 436Q122 437 142 438T172 441T184 442H187V261Q188 77 190 64Q193 49 204 40Q224 26 264 26Q290 26 311 35T343 58T363 90T375 120T379 144Q379 145 379 161T380 201T380 248V315Q380 361 370 372T320 385H302V431Q304 431 378 436T457 442H464V264Q464 84 465 81Q468 61 479 55T524 46H542V0Q540 0 467 -5T390 -11H383V58Z"></path><path stroke-width="1" id="E70-MJMAIN-6E" d="M41 46H55Q94 46 102 60V68Q102 77 102 91T102 122T103 161T103 203Q103 234 103 269T102 328V351Q99 370 88 376T43 385H25V408Q25 431 27 431L37 432Q47 433 65 434T102 436Q119 437 138 438T167 441T178 442H181V402Q181 364 182 364T187 369T199 384T218 402T247 421T285 437Q305 442 336 442Q450 438 463 329Q464 322 464 190V104Q464 66 466 59T477 49Q498 46 526 46H542V0H534L510 1Q487 2 460 2T422 3Q319 3 310 0H302V46H318Q379 46 379 62Q380 64 380 200Q379 335 378 343Q372 371 358 385T334 402T308 404Q263 404 229 370Q202 343 195 315T187 232V168V108Q187 78 188 68T191 55T200 49Q221 46 249 46H265V0H257L234 1Q210 2 183 2T145 3Q42 3 33 0H25V46H41Z"></path><path stroke-width="1" id="E70-MJMAIN-69" d="M69 609Q69 637 87 653T131 669Q154 667 171 652T188 609Q188 579 171 564T129 549Q104 549 87 564T69 609ZM247 0Q232 3 143 3Q132 3 106 3T56 1L34 0H26V46H42Q70 46 91 49Q100 53 102 60T104 102V205V293Q104 345 102 359T88 378Q74 385 41 385H30V408Q30 431 32 431L42 432Q52 433 70 434T106 436Q123 437 142 438T171 441T182 442H185V62Q190 52 197 50T232 46H255V0H247Z"></path><path stroke-width="1" id="E70-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E70-MJMAIN-63" d="M370 305T349 305T313 320T297 358Q297 381 312 396Q317 401 317 402T307 404Q281 408 258 408Q209 408 178 376Q131 329 131 219Q131 137 162 90Q203 29 272 29Q313 29 338 55T374 117Q376 125 379 127T395 129H409Q415 123 415 120Q415 116 411 104T395 71T366 33T318 2T249 -11Q163 -11 99 53T34 214Q34 318 99 383T250 448T370 421T404 357Q404 334 387 320Z"></path><path stroke-width="1" id="E70-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E70-MJMAIN-76" d="M338 431Q344 429 422 429Q479 429 503 431H508V385H497Q439 381 423 345Q421 341 356 172T288 -2Q283 -11 263 -11Q244 -11 239 -2Q99 359 98 364Q93 378 82 381T43 385H19V431H25L33 430Q41 430 53 430T79 430T104 429T122 428Q217 428 232 431H240V385H226Q187 384 184 370Q184 366 235 234L286 102L377 341V349Q377 363 367 372T349 383T335 385H331V431H338Z"></path><path stroke-width="1" id="E70-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E70-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E70-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E70-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E70-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E70-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E70-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E70-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E70-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E70-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E70-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E70-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E70-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E70-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E70-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E70-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E70-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E70-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E70-MJMAIN-66" d="M273 0Q255 3 146 3Q43 3 34 0H26V46H42Q70 46 91 49Q99 52 103 60Q104 62 104 224V385H33V431H104V497L105 564L107 574Q126 639 171 668T266 704Q267 704 275 704T289 705Q330 702 351 679T372 627Q372 604 358 590T321 576T284 590T270 627Q270 647 288 667H284Q280 668 273 668Q245 668 223 647T189 592Q183 572 182 497V431H293V385H185V225Q185 63 186 61T189 57T194 54T199 51T206 49T213 48T222 47T231 47T241 46T251 46H282V0H273Z"></path><path stroke-width="1" id="E70-MJMAIN-6A" d="M98 609Q98 637 116 653T160 669Q183 667 200 652T217 609Q217 579 200 564T158 549Q133 549 116 564T98 609ZM28 -163Q58 -168 64 -168Q124 -168 135 -77Q137 -65 137 141T136 353Q132 371 120 377T72 385H52V408Q52 431 54 431L58 432Q62 432 70 432T87 433T108 434T133 436Q151 437 171 438T202 441T214 442H218V184Q217 -36 217 -59T211 -98Q195 -145 153 -175T58 -205Q9 -205 -23 -179T-55 -117Q-55 -94 -40 -79T-2 -64T36 -79T52 -118Q52 -143 28 -163Z"></path><path stroke-width="1" id="E70-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E70-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E70-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E70-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-7D" x="0" y="-2232"></use></g><g transform="translate(485,0)"><g transform="translate(0,2182)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-72"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-65" x="392" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-70" x="837" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-65" x="1393" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-61" x="1838" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-74" x="2338" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-75" x="2978" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-6E" x="3534" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-74" x="4091" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-69" x="4480" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-6C" x="4759" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-63" x="5287" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-6F" x="5732" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-6E" x="6232" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-76" x="6789" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-65" x="7317" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-72" x="7762" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-67" x="8154" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-65" x="8655" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-6E" x="9099" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-63" x="9656" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-65" x="10100" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-3A" x="10545" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-7B" x="11101" y="0"></use></g><g transform="translate(0,66)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-6A" x="663" y="-213"></use><g transform="translate(1138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(2473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-2212" x="3557" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-3B1" x="4557" y="0"></use><g transform="translate(5198,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(6603,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-28" x="8048" y="0"></use><g transform="translate(8437,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-28" x="9446" y="0"></use><g transform="translate(9835,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-29" x="11303" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-2212" x="11914" y="0"></use><g transform="translate(12915,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-29" x="14310" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-22C5" x="14922" y="0"></use><g transform="translate(15422,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMATHI-6A" x="809" y="-430"></use></g></g></g><g transform="translate(19653,0)"><g transform="translate(0,66)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-66"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-6F" x="306" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-72" x="807" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-6A" x="1449" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-3A" x="2006" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-3D" x="2284" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-30" x="3313" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-2C" x="3813" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-31" x="4092" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-2E" x="4592" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-2E" x="4871" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-2E" x="5149" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E70-MJMAIN-6E" x="5428" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-69">\begin{align*}& \text{repeat until convergence:} \; \lbrace \newline \; & \theta_j := \theta_j - \alpha \frac{1}{m} \sum\limits_{i=1}^{m} (h_\theta(x^{(i)}) - y^{(i)}) \cdot x_j^{(i)} \; & \text{for j := 0,1...n}\newline \rbrace\end{align*}</script></p><p>注意，虽然形式上梯度下降算法同线性回归一样，但其中的假设函不同，即<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-70-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="16.022ex" height="3.044ex" viewBox="0 -906.7 6898.4 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E71-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E71-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E71-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E71-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E71-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E71-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E71-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E71-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E71-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E71-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMAIN-3D" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-67" x="3694" y="0"></use><g transform="translate(4341,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJMATHI-78" x="1526" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E71-MJSZ1-29" x="2098" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-70">h_\theta(x) = g\left(\theta^{T}x \right)</script>，不过求导后的结果也相同。</p><p>向量化实现：<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-71-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="26.233ex" height="3.161ex" viewBox="0 -906.7 11294.5 1361" role="img" focusable="false" style="vertical-align: -1.055ex;"><defs><path stroke-width="1" id="E72-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E72-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E72-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E72-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E72-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E72-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E72-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E72-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E72-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E72-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E72-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E72-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-3B8" x="0" y="0"></use><g transform="translate(747,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMAIN-3D" x="278" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-3B8" x="2082" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMAIN-2212" x="2773" y="0"></use><g transform="translate(3552,0)"><g transform="translate(342,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-3B1" x="203" y="583"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(4755,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-54" x="1215" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMAIN-28" x="6213" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-67" x="6603" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMAIN-28" x="7083" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-58" x="7473" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-3B8" x="8325" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMAIN-29" x="8795" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMAIN-2212" x="9406" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMATHI-79" x="10407" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E72-MJMAIN-29" x="10905" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-71">\theta := \theta - \frac{\alpha}{m} X^{T} (g(X \theta ) - y)</script></p><p>&nbsp;</p><p><strong>对数损失函数求导的推导过程：</strong></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-72-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="61.184ex" height="6.78ex" viewBox="0 -1660.6 26342.9 2919" role="img" focusable="false" style="vertical-align: -2.923ex;"><defs><path stroke-width="1" id="E73-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E73-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E73-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E73-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E73-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E73-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E73-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E73-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E73-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E73-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E73-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E73-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E73-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E73-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E73-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E73-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E73-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E73-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E73-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-3D" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-2212" x="3216" y="0"></use><g transform="translate(3994,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(5142,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-6D" x="582" y="1627"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-5B" x="1444" y="0"></use><g transform="translate(1723,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(3284,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="4563" y="0"></use><g transform="translate(4953,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="5961" y="0"></use><g transform="translate(6351,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="7819" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="8208" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-2B" x="8820" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="9821" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-31" x="10210" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-2212" x="10933" y="0"></use><g transform="translate(11933,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="13328" y="0"></use><g transform="translate(13884,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="15164" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-31" x="15553" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-2212" x="16276" y="0"></use><g transform="translate(17277,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="18285" y="0"></use><g transform="translate(18675,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="20143" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-29" x="20532" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E73-MJMAIN-5D" x="20922" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-72">J(\theta) = - \frac{1}{m} \displaystyle \sum_{i=1}^m [y^{(i)}\log (h_\theta (x^{(i)})) + (1 - y^{(i)})\log (1 - h_\theta(x^{(i)}))]</script></p><p>令 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-73-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="54.245ex" height="3.161ex" viewBox="0 -956.9 23355.4 1361" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E74-MJMATHI-66" d="M118 -162Q120 -162 124 -164T135 -167T147 -168Q160 -168 171 -155T187 -126Q197 -99 221 27T267 267T289 382V385H242Q195 385 192 387Q188 390 188 397L195 425Q197 430 203 430T250 431Q298 431 298 432Q298 434 307 482T319 540Q356 705 465 705Q502 703 526 683T550 630Q550 594 529 578T487 561Q443 561 443 603Q443 622 454 636T478 657L487 662Q471 668 457 668Q445 668 434 658T419 630Q412 601 403 552T387 469T380 433Q380 431 435 431Q480 431 487 430T498 424Q499 420 496 407T491 391Q489 386 482 386T428 385H372L349 263Q301 15 282 -47Q255 -132 212 -173Q175 -205 139 -205Q107 -205 81 -186T55 -132Q55 -95 76 -78T118 -61Q162 -61 162 -103Q162 -122 151 -136T127 -157L118 -162Z"></path><path stroke-width="1" id="E74-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E74-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E74-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E74-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E74-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E74-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E74-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E74-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E74-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E74-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E74-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E74-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E74-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E74-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E74-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E74-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-66" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-28" x="550" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-3B8" x="940" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-29" x="1409" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-3D" x="2076" y="0"></use><g transform="translate(3133,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(4694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(5974,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1633,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-29" x="4018" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-2B" x="10673" y="0"></use><g transform="translate(11673,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(15875,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(17155,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(3357,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E74-MJSZ1-29" x="5741" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-73">f(\theta) = {{y}^{(i)}}\log \left( {h_\theta}\left( {{x}^{(i)}} \right) \right)+\left( 1-{{y}^{(i)}} \right)\log \left( 1-{h_\theta}\left( {{x}^{(i)}} \right) \right)</script></p><p>将 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-74-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.616ex" height="4.095ex" viewBox="0 -956.9 13612.4 1763.1" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E75-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E75-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E75-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E75-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E75-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E75-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E75-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E75-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E75-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E75-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E75-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E75-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E75-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E75-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E75-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-28" x="1008" y="0"></use><g transform="translate(1397,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-29" x="2865" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-3D" x="3532" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-67" x="4589" y="0"></use><g transform="translate(5236,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-54" x="663" y="513"></use></g><g transform="translate(1526,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJSZ1-29" x="2993" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-3D" x="8966" y="0"></use><g transform="translate(9744,0)"><g transform="translate(397,0)"><rect stroke="none" width="3349" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-31" x="2118" y="572"></use><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E75-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-74">h_\theta(x^{(i)}) = g\left(\theta^{T}x^{(i)} \right)=\frac{1}{1+{{e}^{-{\theta^T}{{x}^{(i)}}}}} </script> 带入得</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-75-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="55.675ex" height="4.679ex" viewBox="0 -1208.2 23971.2 2014.4" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E76-MJMATHI-66" d="M118 -162Q120 -162 124 -164T135 -167T147 -168Q160 -168 171 -155T187 -126Q197 -99 221 27T267 267T289 382V385H242Q195 385 192 387Q188 390 188 397L195 425Q197 430 203 430T250 431Q298 431 298 432Q298 434 307 482T319 540Q356 705 465 705Q502 703 526 683T550 630Q550 594 529 578T487 561Q443 561 443 603Q443 622 454 636T478 657L487 662Q471 668 457 668Q445 668 434 658T419 630Q412 601 403 552T387 469T380 433Q380 431 435 431Q480 431 487 430T498 424Q499 420 496 407T491 391Q489 386 482 386T428 385H372L349 263Q301 15 282 -47Q255 -132 212 -173Q175 -205 139 -205Q107 -205 81 -186T55 -132Q55 -95 76 -78T118 -61Q162 -61 162 -103Q162 -122 151 -136T127 -157L118 -162Z"></path><path stroke-width="1" id="E76-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E76-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E76-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E76-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E76-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E76-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E76-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E76-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E76-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E76-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E76-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E76-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E76-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E76-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E76-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E76-MJSZ2-28" d="M180 96T180 250T205 541T266 770T353 944T444 1069T527 1150H555Q561 1144 561 1141Q561 1137 545 1120T504 1072T447 995T386 878T330 721T288 513T272 251Q272 133 280 56Q293 -87 326 -209T399 -405T475 -531T536 -609T561 -640Q561 -643 555 -649H527Q483 -612 443 -568T353 -443T266 -270T205 -41Z"></path><path stroke-width="1" id="E76-MJSZ2-29" d="M35 1138Q35 1150 51 1150H56H69Q113 1113 153 1069T243 944T330 771T391 541T416 250T391 -40T330 -270T243 -443T152 -568T69 -649H56Q43 -649 39 -647T35 -637Q65 -607 110 -548Q283 -316 316 56Q324 133 324 251Q324 368 316 445Q278 877 48 1123Q36 1137 35 1138Z"></path><path stroke-width="1" id="E76-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E76-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-66" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-28" x="550" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-3B8" x="940" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-29" x="1409" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-3D" x="2076" y="0"></use><g transform="translate(3133,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(4694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(5974,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJSZ2-28"></use><g transform="translate(597,0)"><g transform="translate(120,0)"><rect stroke="none" width="3349" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-31" x="2118" y="572"></use><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJSZ2-29" x="4187" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-2B" x="10980" y="0"></use><g transform="translate(11981,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(16183,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(17463,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-2212" x="1320" y="0"></use><g transform="translate(2098,0)"><g transform="translate(342,0)"><rect stroke="none" width="3349" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-31" x="2118" y="572"></use><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E76-MJSZ2-29" x="5910" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-75">f(\theta)={{y}^{(i)}}\log \left( \frac{1}{1+{{e}^{-{\theta^T}{{x}^{(i)}}}}} \right)+\left( 1-{{y}^{(i)}} \right)\log \left( 1-\frac{1}{1+{{e}^{-{\theta^T}{{x}^{(i)}}}}} \right)</script>
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-76-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="52.226ex" height="4.445ex" viewBox="0 -1208.2 22485.9 1913.9" role="img" focusable="false" style="vertical-align: -1.639ex;"><defs><path stroke-width="1" id="E77-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E77-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E77-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E77-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E77-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E77-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E77-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E77-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E77-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E77-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E77-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E77-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E77-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E77-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E77-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E77-MJSZ2-28" d="M180 96T180 250T205 541T266 770T353 944T444 1069T527 1150H555Q561 1144 561 1141Q561 1137 545 1120T504 1072T447 995T386 878T330 721T288 513T272 251Q272 133 280 56Q293 -87 326 -209T399 -405T475 -531T536 -609T561 -640Q561 -643 555 -649H527Q483 -612 443 -568T353 -443T266 -270T205 -41Z"></path><path stroke-width="1" id="E77-MJSZ2-29" d="M35 1138Q35 1150 51 1150H56H69Q113 1113 153 1069T243 944T330 771T391 541T416 250T391 -40T330 -270T243 -443T152 -568T69 -649H56Q43 -649 39 -647T35 -637Q65 -607 110 -548Q283 -316 316 56Q324 133 324 251Q324 368 316 445Q278 877 48 1123Q36 1137 35 1138Z"></path><path stroke-width="1" id="E77-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E77-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-3D" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-2212" x="1056" y="0"></use><g transform="translate(1834,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(3396,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(4675,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-2B" x="1320" y="0"></use><g transform="translate(2320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-2212" x="0" y="0"></use><g transform="translate(550,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-54" x="663" y="612"></use></g><g transform="translate(1305,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJSZ2-29" x="5230" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-2212" x="10726" y="0"></use><g transform="translate(11726,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(15928,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(17208,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-2B" x="1320" y="0"></use><g transform="translate(2320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-54" x="663" y="612"></use><g transform="translate(754,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E77-MJSZ2-29" x="4680" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-76">=-{{y}^{(i)}}\log \left( 1+{{e}^{-{\theta^T}{{x}^{(i)}}}} \right)-\left( 1-{{y}^{(i)}} \right)\log \left( 1+{{e}^{{\theta^T}{{x}^{(i)}}}} \right)</script></p><p>根据求偏导的性质，没有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-77-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2ex" height="2.694ex" viewBox="0 -806.1 861.2 1160" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E78-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E78-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E78-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E78-MJMATHI-6A" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-77">\theta_j</script> 的项都消去，则得：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-78-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.708ex" height="4.212ex" viewBox="0 -1107.7 7624.2 1813.3" role="img" focusable="false" style="vertical-align: -1.639ex;"><defs><path stroke-width="1" id="E79-MJMAIN-2202" d="M202 508Q179 508 169 520T158 547Q158 557 164 577T185 624T230 675T301 710L333 715H345Q378 715 384 714Q447 703 489 661T549 568T566 457Q566 362 519 240T402 53Q321 -22 223 -22Q123 -22 73 56Q42 102 42 148V159Q42 276 129 370T322 465Q383 465 414 434T455 367L458 378Q478 461 478 515Q478 603 437 639T344 676Q266 676 223 612Q264 606 264 572Q264 547 246 528T202 508ZM430 306Q430 372 401 400T333 428Q270 428 222 382Q197 354 183 323T150 221Q132 149 132 116Q132 21 232 21Q244 21 250 22Q327 35 374 112Q389 137 409 196T430 306Z"></path><path stroke-width="1" id="E79-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E79-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E79-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E79-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E79-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E79-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E79-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E79-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E79-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E79-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-6A" x="663" y="-213"></use></g></g></g><g transform="translate(1370,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-54" x="663" y="513"></use></g><g transform="translate(1526,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJSZ1-29" x="2993" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMAIN-3D" x="5100" y="0"></use><g transform="translate(6156,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E79-MJMATHI-6A" x="809" y="-430"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-78">\frac{\partial }{\partial {\theta_{j}}}\left( \theta^Tx^{(i)}  \right)=x^{(i)}_j</script></p><p>所以有：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-79-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="65.095ex" height="4.445ex" viewBox="0 -1208.2 28026.8 1913.9" role="img" focusable="false" style="vertical-align: -1.639ex;"><defs><path stroke-width="1" id="E80-MJMAIN-2202" d="M202 508Q179 508 169 520T158 547Q158 557 164 577T185 624T230 675T301 710L333 715H345Q378 715 384 714Q447 703 489 661T549 568T566 457Q566 362 519 240T402 53Q321 -22 223 -22Q123 -22 73 56Q42 102 42 148V159Q42 276 129 370T322 465Q383 465 414 434T455 367L458 378Q478 461 478 515Q478 603 437 639T344 676Q266 676 223 612Q264 606 264 572Q264 547 246 528T202 508ZM430 306Q430 372 401 400T333 428Q270 428 222 382Q197 354 183 323T150 221Q132 149 132 116Q132 21 232 21Q244 21 250 22Q327 35 374 112Q389 137 409 196T430 306Z"></path><path stroke-width="1" id="E80-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E80-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E80-MJMATHI-66" d="M118 -162Q120 -162 124 -164T135 -167T147 -168Q160 -168 171 -155T187 -126Q197 -99 221 27T267 267T289 382V385H242Q195 385 192 387Q188 390 188 397L195 425Q197 430 203 430T250 431Q298 431 298 432Q298 434 307 482T319 540Q356 705 465 705Q502 703 526 683T550 630Q550 594 529 578T487 561Q443 561 443 603Q443 622 454 636T478 657L487 662Q471 668 457 668Q445 668 434 658T419 630Q412 601 403 552T387 469T380 433Q380 431 435 431Q480 431 487 430T498 424Q499 420 496 407T491 391Q489 386 482 386T428 385H372L349 263Q301 15 282 -47Q255 -132 212 -173Q175 -205 139 -205Q107 -205 81 -186T55 -132Q55 -95 76 -78T118 -61Q162 -61 162 -103Q162 -122 151 -136T127 -157L118 -162Z"></path><path stroke-width="1" id="E80-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E80-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E80-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E80-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E80-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E80-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E80-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E80-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E80-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E80-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E80-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E80-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E80-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E80-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E80-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E80-MJSZ2-28" d="M180 96T180 250T205 541T266 770T353 944T444 1069T527 1150H555Q561 1144 561 1141Q561 1137 545 1120T504 1072T447 995T386 878T330 721T288 513T272 251Q272 133 280 56Q293 -87 326 -209T399 -405T475 -531T536 -609T561 -640Q561 -643 555 -649H527Q483 -612 443 -568T353 -443T266 -270T205 -41Z"></path><path stroke-width="1" id="E80-MJSZ2-29" d="M35 1138Q35 1150 51 1150H56H69Q113 1113 153 1069T243 944T330 771T391 541T416 250T391 -40T330 -270T243 -443T152 -568T69 -649H56Q43 -649 39 -647T35 -637Q65 -607 110 -548Q283 -316 316 56Q324 133 324 251Q324 368 316 445Q278 877 48 1123Q36 1137 35 1138Z"></path><path stroke-width="1" id="E80-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E80-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E80-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-6A" x="663" y="-213"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-66" x="1370" y="0"></use><g transform="translate(2087,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-3B8" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-29" x="859" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-3D" x="3613" y="0"></use><g transform="translate(4392,0)"><g transform="translate(397,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-6A" x="663" y="-213"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-5B" x="6040" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2212" x="6318" y="0"></use><g transform="translate(7097,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(8658,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(9938,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2B" x="1320" y="0"></use><g transform="translate(2320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2212" x="0" y="0"></use><g transform="translate(550,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-54" x="663" y="612"></use></g><g transform="translate(1305,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJSZ2-29" x="5230" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2212" x="15988" y="0"></use><g transform="translate(16989,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(21191,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(22470,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-2B" x="1320" y="0"></use><g transform="translate(2320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-54" x="663" y="612"></use><g transform="translate(754,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJSZ2-29" x="4680" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E80-MJMAIN-5D" x="27748" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-79">\frac{\partial }{\partial {\theta_{j}}}f\left( \theta  \right)=\frac{\partial }{\partial {\theta_{j}}}[-{{y}^{(i)}}\log \left( 1+{{e}^{-{\theta^{T}}{{x}^{(i)}}}} \right)-\left( 1-{{y}^{(i)}} \right)\log \left( 1+{{e}^{{\theta^{T}}{{x}^{(i)}}}} \right)]</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-80-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="37.77ex" height="5.612ex" viewBox="0 -1610.3 16261.9 2416.4" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E81-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E81-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E81-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E81-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E81-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E81-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E81-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E81-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E81-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E81-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E81-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E81-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E81-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E81-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E81-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-3D" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-2212" x="1056" y="0"></use><g transform="translate(1834,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(3229,0)"><g transform="translate(120,0)"><rect stroke="none" width="4033" height="60" x="0" y="220"></rect><g transform="translate(60,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-2212" x="0" y="0"></use><g transform="translate(550,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-6A" x="809" y="-430"></use></g><g transform="translate(1588,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-54" x="469" y="362"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(401,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-2212" x="7725" y="0"></use><g transform="translate(8726,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(12761,0)"><g transform="translate(286,0)"><rect stroke="none" width="3093" height="60" x="0" y="220"></rect><g transform="translate(60,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-6A" x="809" y="-430"></use><g transform="translate(1037,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(126,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E81-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-80">=-{{y}^{(i)}}\frac{-x_{j}^{(i)}{{e}^{-{\theta^{T}}{{x}^{(i)}}}}}{1+{{e}^{-{\theta^{T}}{{x}^{(i)}}}}}-\left( 1-{{y}^{(i)}} \right)\frac{x_j^{(i)}{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}</script>
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-81-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="33.469ex" height="5.612ex" viewBox="0 -1610.3 14410.2 2416.4" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E82-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E82-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E82-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E82-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E82-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E82-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E82-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E82-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E82-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E82-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E82-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E82-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E82-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E82-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E82-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(2451,0)"><g transform="translate(120,0)"><rect stroke="none" width="2960" height="60" x="0" y="220"></rect><g transform="translate(961,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-6A" x="809" y="-430"></use></g><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-2212" x="5873" y="0"></use><g transform="translate(6874,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(10909,0)"><g transform="translate(286,0)"><rect stroke="none" width="3093" height="60" x="0" y="220"></rect><g transform="translate(60,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-6A" x="809" y="-430"></use><g transform="translate(1037,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(126,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E82-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-81">={{y}^{(i)}}\frac{x_j^{(i)}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}-\left( 1-{{y}^{(i)}} \right)\frac{x_j^{(i)}{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}</script> 
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-82-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="26.652ex" height="5.612ex" viewBox="0 -1610.3 11475.3 2416.4" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E83-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E83-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E83-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E83-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E83-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E83-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E83-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E83-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E83-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E83-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E83-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E83-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E83-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><g transform="translate(120,0)"><rect stroke="none" width="10179" height="60" x="0" y="220"></rect><g transform="translate(60,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-79" x="0" y="0"></use><g transform="translate(353,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-29" x="735" y="0"></use></g><g transform="translate(986,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-6A" x="809" y="-430"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-2212" x="2862" y="0"></use><g transform="translate(2574,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-6A" x="809" y="-430"></use></g><g transform="translate(3612,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-2B" x="7846" y="0"></use><g transform="translate(6098,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-79" x="0" y="0"></use><g transform="translate(353,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-29" x="735" y="0"></use></g></g><g transform="translate(7085,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-6A" x="809" y="-430"></use></g><g transform="translate(8122,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(3669,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E83-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-82">={\frac{{{y}^{(i)}}x_j^{(i)}-x_j^{(i)}{{e}^{{\theta^T}{{x}^{(i)}}}}+{{y}^{(i)}}x_j^{(i)}{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}}</script>
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-83-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="23.324ex" height="5.963ex" viewBox="0 -1761.1 10042.2 2567.2" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E84-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E84-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E84-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E84-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E84-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E84-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E84-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E84-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E84-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E84-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E84-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E84-MJSZ2-28" d="M180 96T180 250T205 541T266 770T353 944T444 1069T527 1150H555Q561 1144 561 1141Q561 1137 545 1120T504 1072T447 995T386 878T330 721T288 513T272 251Q272 133 280 56Q293 -87 326 -209T399 -405T475 -531T536 -609T561 -640Q561 -643 555 -649H527Q483 -612 443 -568T353 -443T266 -270T205 -41Z"></path><path stroke-width="1" id="E84-MJSZ2-29" d="M35 1138Q35 1150 51 1150H56H69Q113 1113 153 1069T243 944T330 771T391 541T416 250T391 -40T330 -270T243 -443T152 -568T69 -649H56Q43 -649 39 -647T35 -637Q65 -607 110 -548Q283 -316 316 56Q324 133 324 251Q324 368 316 445Q278 877 48 1123Q36 1137 35 1138Z"></path><path stroke-width="1" id="E84-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E84-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><g transform="translate(120,0)"><rect stroke="none" width="7278" height="60" x="0" y="220"></rect><g transform="translate(60,864)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-79" x="0" y="0"></use><g transform="translate(353,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-29" x="735" y="0"></use></g><g transform="translate(986,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJSZ2-28"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-31" x="597" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-2B" x="1098" y="0"></use><g transform="translate(1326,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJSZ2-29" x="4614" y="-1"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-2212" x="6606" y="0"></use><g transform="translate(5222,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(2218,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g><g transform="translate(7518,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E84-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-83">={\frac{{{y}^{(i)}}\left( 1\text{+}{{e}^{{\theta^T}{{x}^{(i)}}}} \right)-{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}x_j^{(i)}}</script>
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-84-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="21.185ex" height="4.912ex" viewBox="0 -1308.7 9121.1 2114.9" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E85-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E85-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E85-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E85-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E85-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E85-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E85-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E85-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E85-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E85-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E85-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E85-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E85-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-2212" x="2006" y="0"></use><g transform="translate(2785,0)"><g transform="translate(342,0)"><rect stroke="none" width="2960" height="60" x="0" y="220"></rect><g transform="translate(512,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-29" x="735" y="0"></use></g></g></g></g><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-29" x="6207" y="0"></use><g transform="translate(6597,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E85-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-84">={({{y}^{(i)}}-\frac{{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}})x_j^{(i)}}</script>
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-85-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="22.089ex" height="4.445ex" viewBox="0 -1107.7 9510.4 1913.9" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E86-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E86-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E86-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E86-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E86-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E86-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E86-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E86-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E86-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E86-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E86-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E86-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E86-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-2212" x="2006" y="0"></use><g transform="translate(2785,0)"><g transform="translate(342,0)"><rect stroke="none" width="3349" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-31" x="2118" y="572"></use><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-29" x="6596" y="0"></use><g transform="translate(6986,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E86-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-85">={({{y}^{(i)}}-\frac{1}{1+{{e}^{-{\theta^T}{{x}^{(i)}}}}})x_j^{(i)}}</script>
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-86-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="22.727ex" height="3.745ex" viewBox="0 -1107.7 9785.1 1612.3" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E87-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E87-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E87-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E87-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E87-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E87-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E87-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E87-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E87-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E87-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E87-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E87-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMAIN-2212" x="2075" y="0"></use><g transform="translate(3076,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(4251,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJSZ1-29" x="6636" y="-1"></use><g transform="translate(7261,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E87-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-86">={\left({{y}^{(i)}}-{h_\theta}\left( {{x}^{(i)}} \right)\right)x_j^{(i)}}</script>
-<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-87-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="22.727ex" height="3.745ex" viewBox="0 -1107.7 9785.1 1612.3" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E88-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E88-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E88-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E88-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E88-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E88-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E88-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E88-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E88-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E88-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E88-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E88-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1633,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMAIN-2212" x="4240" y="0"></use><g transform="translate(5241,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJSZ1-29" x="6636" y="-1"></use><g transform="translate(7261,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E88-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-87">={\left({h_\theta}\left( {{x}^{(i)}} \right)-{{y}^{(i)}}\right)x_j^{(i)}}</script></p><p>则可得对数损失函数的导数：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-88-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="54.512ex" height="5.846ex" viewBox="0 -1459.5 23470.3 2517" role="img" focusable="false" style="vertical-align: -2.456ex;"><defs><path stroke-width="1" id="E89-MJMAIN-2202" d="M202 508Q179 508 169 520T158 547Q158 557 164 577T185 624T230 675T301 710L333 715H345Q378 715 384 714Q447 703 489 661T549 568T566 457Q566 362 519 240T402 53Q321 -22 223 -22Q123 -22 73 56Q42 102 42 148V159Q42 276 129 370T322 465Q383 465 414 434T455 367L458 378Q478 461 478 515Q478 603 437 639T344 676Q266 676 223 612Q264 606 264 572Q264 547 246 528T202 508ZM430 306Q430 372 401 400T333 428Q270 428 222 382Q197 354 183 323T150 221Q132 149 132 116Q132 21 232 21Q244 21 250 22Q327 35 374 112Q389 137 409 196T430 306Z"></path><path stroke-width="1" id="E89-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E89-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E89-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E89-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E89-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E89-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E89-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E89-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E89-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E89-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E89-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E89-MJMATHI-66" d="M118 -162Q120 -162 124 -164T135 -167T147 -168Q160 -168 171 -155T187 -126Q197 -99 221 27T267 267T289 382V385H242Q195 385 192 387Q188 390 188 397L195 425Q197 430 203 430T250 431Q298 431 298 432Q298 434 307 482T319 540Q356 705 465 705Q502 703 526 683T550 630Q550 594 529 578T487 561Q443 561 443 603Q443 622 454 636T478 657L487 662Q471 668 457 668Q445 668 434 658T419 630Q412 601 403 552T387 469T380 433Q380 431 435 431Q480 431 487 430T498 424Q499 420 496 407T491 391Q489 386 482 386T428 385H372L349 263Q301 15 282 -47Q255 -132 212 -173Q175 -205 139 -205Q107 -205 81 -186T55 -132Q55 -95 76 -78T118 -61Q162 -61 162 -103Q162 -122 151 -136T127 -157L118 -162Z"></path><path stroke-width="1" id="E89-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E89-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E89-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E89-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-6A" x="663" y="-213"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-4A" x="1370" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-28" x="2003" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-3B8" x="2393" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-29" x="2862" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-3D" x="3530" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-2212" x="4586" y="0"></use><g transform="translate(5364,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(6512,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJSZ1-2211" x="46" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-6D" x="372" y="1344"></use></g><g transform="translate(7828,0)"><g transform="translate(120,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-6A" x="663" y="-213"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-66" x="1370" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-28" x="1920" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-3B8" x="2310" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-29" x="2779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-3D" x="11275" y="0"></use><g transform="translate(12053,0)"><g transform="translate(397,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(13479,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJSZ1-2211" x="46" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-6D" x="372" y="1344"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-28" x="14627" y="0"></use><g transform="translate(15017,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-28" x="16025" y="0"></use><g transform="translate(16415,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-29" x="17882" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-2212" x="18494" y="0"></use><g transform="translate(19495,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-29" x="20890" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-22C5" x="21501" y="0"></use><g transform="translate(22002,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E89-MJMATHI-6A" x="809" y="-430"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-88">\frac{\partial }{\partial {\theta_{j}}}J(\theta) = -\frac{1}{m}\sum\limits_{i=1}^{m}{\frac{\partial }{\partial {\theta_{j}}}f(\theta)}=\frac{1}{m} \sum\limits_{i=1}^{m} (h_\theta(x^{(i)}) - y^{(i)}) \cdot x_j^{(i)} </script></p><h2><a name='header-n1191' class='md-header-anchor '></a>6.6 进阶优化(Advanced Optimization)</h2><p>运行梯度下降算法，其能最小化损失函数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-92-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E93-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E93-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E93-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E93-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-92">J(\theta)</script> 并得出 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-90-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E91-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E91-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-90">\theta</script> 的最优值，在使用梯度下降算法时，如果不需要观察损失函数的收敛情况，则直接计算 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-92-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E93-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E93-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E93-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E93-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-92">J(\theta)</script> 的导数项即可，而不需要计算 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-92-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E93-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E93-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E93-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E93-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E93-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-92">J(\theta)</script> 值。</p><p>我们编写代码给出损失函数及其偏导数然后传入梯度下降算法中，接下来算法则会为我们最小化损失函数给出参数的最优解。这类算法被称为<strong>最优化算法(Optimization Algorithms)</strong>，梯度下降算法不是唯一的最小化算法<sup><a href='#dfref-footnote-1' name='ref-footnote-1'>1</a></sup>。</p><p>一些最优化算法：</p><ul><li><p>梯度下降法(Gradient Descent)</p></li><li><p>共轭梯度算法(Conjugate gradient)</p></li><li><p>牛顿法和拟牛顿法(Newton&#39;s method &amp; Quasi-Newton Methods)</p><ul><li>DFP算法</li><li>局部优化法(BFGS)</li><li>有限内存局部优化法(L-BFGS)</li></ul></li><li><p>拉格朗日乘数法(Lagrange multiplier)</p></li></ul><p>比较梯度下降算法：一些最优化算法虽然会更为复杂，难以调试，自行实现又困难重重，开源库又效率也不一，哎，做个调包侠还得碰运气。不过这些算法通常效率更高，并无需选择学习速率 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-93-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.488ex" height="1.41ex" viewBox="0 -504.6 640.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E94-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E94-MJMATHI-3B1" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-93">\alpha</script>（少一个参数少一份痛苦啊！）。</p><p>Octave/Matlab 中对这类高级算法做了封装，易于调用。</p><p>&nbsp;</p><p>假设有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-94-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="28.332ex" height="2.811ex" viewBox="0 -906.7 12198.5 1210.2" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E95-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E95-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E95-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E95-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E95-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E95-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E95-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E95-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E95-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E95-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-3D" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-28" x="3216" y="0"></use><g transform="translate(3605,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-31" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-2212" x="4751" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-35" x="5751" y="0"></use><g transform="translate(6252,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-32" x="550" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-2B" x="7318" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-28" x="8318" y="0"></use><g transform="translate(8708,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-32" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-2212" x="9853" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-35" x="10854" y="0"></use><g transform="translate(11355,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E95-MJMAIN-32" x="550" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-94">J(\theta) = (\theta_1-5)^2 + (\theta_2-5)^2</script>，要求参数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-95-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.53ex" height="5.846ex" viewBox="0 -1509.8 4103 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E96-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E96-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E96-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E96-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E96-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E96-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E96-MJSZ3-5B" d="M247 -949V1450H516V1388H309V-887H516V-949H247Z"></path><path stroke-width="1" id="E96-MJSZ3-5D" d="M11 1388V1450H280V-949H11V-887H218V1388H11Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E96-MJMATHI-3B8" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E96-MJMAIN-3D" x="747" y="0"></use><g transform="translate(1803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E96-MJSZ3-5B"></use><g transform="translate(695,0)"><g transform="translate(-15,0)"><g transform="translate(0,650)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E96-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E96-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(0,-750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E96-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E96-MJMAIN-32" x="663" y="-213"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E96-MJSZ3-5D" x="1770" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-95">\theta=\begin{bmatrix} \theta_1\\\theta_2\end{bmatrix}</script>的最优值。</p><p>下面为 Octave/Matlab 求解最优化问题的代码实例：</p><ol start='' ><li>创建一个函数以返回损失函数及其偏导数：</li></ol><pre class="md-fences md-end-block md-fences-with-lineno" lang="matlab"> <div class="CodeMirror cm-s-inner CodeMirror-wrap"><div style="overflow: hidden; position: relative; width: 3px; height: 0px; top: 0px; left: 39px;"></div><div class="CodeMirror-scrollbar-filler" cm-not-content="true"></div><div class="CodeMirror-gutter-filler" cm-not-content="true"></div><div class="CodeMirror-scroll" tabindex="-1"><div class="CodeMirror-sizer" style="margin-left: 35px; margin-bottom: 0px; border-right-width: 30px; padding-right: 0px; padding-bottom: 0px;"><div style="position: relative; top: 0px;"><div class="CodeMirror-lines" role="presentation"><div role="presentation" style="position: relative; outline: none;"><div class="CodeMirror-measure"><pre><span>xxxxxxxxxx</span></pre><div class="CodeMirror-linenumber CodeMirror-gutter-elt"><div>10</div></div></div><div class="CodeMirror-measure"></div><div style="position: relative; z-index: 1;"></div><div class="CodeMirror-code" role="presentation"><div class="CodeMirror-activeline" style="position: relative;"><div class="CodeMirror-activeline-background CodeMirror-linebackground"></div><div class="CodeMirror-gutter-background CodeMirror-activeline-gutter" style="left: -35px; width: 35px;"></div><div class="CodeMirror-gutter-wrapper CodeMirror-activeline-gutter" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 26px;">1</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span class="cm-builtin">function</span> [<span class="cm-variable">jVal</span>, <span class="cm-variable">gradient</span>] = <span class="cm-variable">costFunction</span>(<span class="cm-variable">theta</span>)</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">2</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-comment">% code to compute J(theta)</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">3</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-variable">jVal</span>=(<span class="cm-variable">theta</span>(<span class="cm-number">1</span>)<span class="cm-number">-5</span>)<span class="cm-operator">^</span><span class="cm-number">2</span><span class="cm-operator">+</span>(<span class="cm-variable">theta</span>(<span class="cm-number">2</span>)<span class="cm-number">-5</span>)<span class="cm-operator">^</span><span class="cm-number">2</span>;</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">4</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">5</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-comment">% code to compute derivative of J(theta)</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">6</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-variable">gradient</span>=<span class="cm-builtin">zeros</span>(<span class="cm-number">2</span>,<span class="cm-number">1</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">7</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">8</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-variable">gradient</span>(<span class="cm-number">1</span>)=<span class="cm-number">2</span><span class="cm-operator">*</span>(<span class="cm-variable">theta</span>(<span class="cm-number">1</span>)<span class="cm-number">-5</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">9</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-variable">gradient</span>(<span class="cm-number">2</span>)=<span class="cm-number">2</span><span class="cm-operator">*</span>(<span class="cm-variable">theta</span>(<span class="cm-number">2</span>)<span class="cm-number">-5</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 26px;">10</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span class="cm-keyword">end</span></span></pre></div></div></div></div></div></div><div style="position: absolute; height: 30px; width: 1px; border-bottom: 0px solid transparent; top: 224px;"></div><div class="CodeMirror-gutters" style="height: 254px;"><div class="CodeMirror-gutter CodeMirror-linenumbers" style="width: 34px;"></div></div></div></div></pre><ol start='2' ><li>将 <code>costFunction</code> 函数及所需参数传入最优化函数 <code>fminunc</code>，以求解最优化问题：</li></ol><pre class="md-fences md-end-block md-fences-with-lineno" lang="matlab"> <div class="CodeMirror cm-s-inner CodeMirror-wrap"><div style="overflow: hidden; position: relative; width: 3px; height: 0px; top: 0px; left: 31px;"></div><div class="CodeMirror-scrollbar-filler" cm-not-content="true"></div><div class="CodeMirror-gutter-filler" cm-not-content="true"></div><div class="CodeMirror-scroll" tabindex="-1"><div class="CodeMirror-sizer" style="margin-left: 27px; margin-bottom: 0px; border-right-width: 30px; padding-right: 0px; padding-bottom: 0px;"><div style="position: relative; top: 0px;"><div class="CodeMirror-lines" role="presentation"><div role="presentation" style="position: relative; outline: none;"><div class="CodeMirror-measure"><pre><span>xxxxxxxxxx</span></pre><div class="CodeMirror-linenumber CodeMirror-gutter-elt"><div>3</div></div></div><div class="CodeMirror-measure"></div><div style="position: relative; z-index: 1;"></div><div class="CodeMirror-code" role="presentation"><div class="CodeMirror-activeline" style="position: relative;"><div class="CodeMirror-activeline-background CodeMirror-linebackground"></div><div class="CodeMirror-gutter-background CodeMirror-activeline-gutter" style="left: -27px; width: 27px;"></div><div class="CodeMirror-gutter-wrapper CodeMirror-activeline-gutter" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 18px;">1</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span class="cm-variable">options</span> = <span class="cm-variable">optimset</span>(<span class="cm-string">'GradObj'</span>, <span class="cm-string">'on'</span>, <span class="cm-string">'MaxIter'</span>, <span class="cm-number">100</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">2</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span class="cm-variable">initialTheta</span> = <span class="cm-builtin">zeros</span>(<span class="cm-number">2</span>,<span class="cm-number">1</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 18px;">3</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; [<span class="cm-variable">optTheta</span>, <span class="cm-variable">functionVal</span>, <span class="cm-variable">exitFlag</span>] = <span class="cm-variable">fminunc</span>(<span class="cm-operator">@</span><span class="cm-variable">costFunction</span>, <span class="cm-variable">initialTheta</span>, <span class="cm-variable">options</span>);</span></pre></div></div></div></div></div></div><div style="position: absolute; height: 30px; width: 1px; border-bottom: 0px solid transparent; top: 67px;"></div><div class="CodeMirror-gutters" style="height: 97px;"><div class="CodeMirror-gutter CodeMirror-linenumbers" style="width: 26px;"></div></div></div></div></pre><blockquote><p><code>&#39;GradObj&#39;, &#39;on&#39;</code>: 启用梯度目标参数（则需要将梯度传入算法）</p><p><code>&#39;MaxIter&#39;, 100</code>: 最大迭代次数为 100 次</p><p><code>@xxx</code>: Octave/Matlab 中的函数指针</p><p><code>optTheta</code>: 最优化得到的参数向量</p><p><code>functionVal</code>: 引用函数最后一次的返回值</p><p><code>exitFlag</code>: 标记损失函数是否收敛</p></blockquote><p>注：Octave/Matlab 中可以使用 <code>help fminunc</code> 命令随时查看函数的帮助文档。</p><ol start='3' ><li>返回结果</li></ol><pre class="md-fences md-end-block md-fences-with-lineno" lang=""> <div class="CodeMirror cm-s-inner CodeMirror-wrap"><div style="overflow: hidden; position: relative; width: 3px; height: 0px; top: 0px; left: 31px;"></div><div class="CodeMirror-scrollbar-filler" cm-not-content="true"></div><div class="CodeMirror-gutter-filler" cm-not-content="true"></div><div class="CodeMirror-scroll" tabindex="-1"><div class="CodeMirror-sizer" style="margin-left: 27px; margin-bottom: 0px; border-right-width: 30px; padding-right: 0px; padding-bottom: 0px;"><div style="position: relative; top: 0px;"><div class="CodeMirror-lines" role="presentation"><div role="presentation" style="position: relative; outline: none;"><div class="CodeMirror-measure"><pre><span>xxxxxxxxxx</span></pre><div class="CodeMirror-linenumber CodeMirror-gutter-elt"><div>8</div></div></div><div class="CodeMirror-measure"></div><div style="position: relative; z-index: 1;"></div><div class="CodeMirror-code" role="presentation"><div class="CodeMirror-activeline" style="position: relative;"><div class="CodeMirror-activeline-background CodeMirror-linebackground"></div><div class="CodeMirror-gutter-background CodeMirror-activeline-gutter" style="left: -27px; width: 27px;"></div><div class="CodeMirror-gutter-wrapper CodeMirror-activeline-gutter" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 18px;">1</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">optTheta =</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">2</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">3</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 5</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">4</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 5</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">5</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">6</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">functionVal = 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">7</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 18px;">8</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">exitFlag = 1</span></pre></div></div></div></div></div></div><div style="position: absolute; height: 30px; width: 1px; border-bottom: 0px solid transparent; top: 179px;"></div><div class="CodeMirror-gutters" style="height: 209px;"><div class="CodeMirror-gutter CodeMirror-linenumbers" style="width: 26px;"></div></div></div></div></pre><h2><a name='header-n1261' class='md-header-anchor '></a>6.7 多类别分类: 一对多(Multiclass Classification: One-vs-all)</h2><p>一直在讨论二元分类问题，这里谈谈多类别分类问题（比如天气预报）。</p><p><img src='image/20180112_001720.png' alt='' /></p><p>原理是，转化多类别分类问题为<strong>多个二元分类问题</strong>，这种方法被称为 One-vs-all。</p><p>正式定义：<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-96-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="39.051ex" height="3.511ex" viewBox="0 -1107.7 16813.5 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E97-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E97-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E97-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E97-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E97-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E97-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E97-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E97-MJMATHI-70" d="M23 287Q24 290 25 295T30 317T40 348T55 381T75 411T101 433T134 442Q209 442 230 378L240 387Q302 442 358 442Q423 442 460 395T497 281Q497 173 421 82T249 -10Q227 -10 210 -4Q199 1 187 11T168 28L161 36Q160 35 139 -51T118 -138Q118 -144 126 -145T163 -148H188Q194 -155 194 -157T191 -175Q188 -187 185 -190T172 -194Q170 -194 161 -194T127 -193T65 -192Q-5 -192 -24 -194H-32Q-39 -187 -39 -183Q-37 -156 -26 -148H-6Q28 -147 33 -136Q36 -130 94 103T155 350Q156 355 156 364Q156 405 131 405Q109 405 94 377T71 316T59 280Q57 278 43 278H29Q23 284 23 287ZM178 102Q200 26 252 26Q282 26 310 49T356 107Q374 141 392 215T411 325V331Q411 405 350 405Q339 405 328 402T306 393T286 380T269 365T254 350T243 336T235 326L232 322Q232 321 229 308T218 264T204 212Q178 106 178 102Z"></path><path stroke-width="1" id="E97-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E97-MJMAIN-7C" d="M139 -249H137Q125 -249 119 -235V251L120 737Q130 750 139 750Q152 750 159 735V-235Q151 -249 141 -249H139Z"></path><path stroke-width="1" id="E97-MJMAIN-3B" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 85 94 103T137 121Q202 121 202 8Q202 -44 183 -94T144 -169T118 -194Q115 -194 106 -186T95 -174Q94 -171 107 -155T137 -107T160 -38Q161 -32 162 -22T165 -4T165 4Q165 5 161 4T142 0Q110 0 94 18T78 60Z"></path><path stroke-width="1" id="E97-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E97-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E97-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E97-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E97-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E97-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-68" x="0" y="0"></use><g transform="translate(576,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-3B8" x="815" y="-474"></use><g transform="translate(1638,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-3D" x="3267" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-70" x="4323" y="0"></use><g transform="translate(4994,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-79" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-3D" x="1164" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-69" x="2221" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-7C" x="2566" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-78" x="2845" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-3B" x="3417" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-3B8" x="3862" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-29" x="4332" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-2C" x="9882" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-69" x="10327" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-3D" x="10950" y="0"></use><g transform="translate(12007,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-31" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-2C" x="890" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-32" x="1335" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-2C" x="1835" y="0"></use><g transform="translate(2280,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-33"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-2E" x="779" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-2E" x="1057" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-2E" x="1336" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMATHI-6B" x="3895" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E97-MJMAIN-29" x="4416" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-96">h_\theta^{\left( i \right)}\left( x \right)=p\left( y=i|x;\theta  \right), i=\left( 1,2,3....k \right)</script></p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-97-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.944ex" height="3.511ex" viewBox="0 -1107.7 2989.8 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E98-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E98-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E98-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E98-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E98-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E98-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E98-MJMATHI-68" x="0" y="0"></use><g transform="translate(576,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E98-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E98-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E98-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E98-MJMATHI-3B8" x="815" y="-474"></use><g transform="translate(1638,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E98-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E98-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E98-MJMAIN-29" x="962" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-97">h_\theta^{\left( i \right)}\left( x \right)</script>: 输出 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-98-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.056ex" height="2.461ex" viewBox="0 -755.9 2177.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E99-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E99-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E99-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E99-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E99-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E99-MJMATHI-69" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-98">y=i</script>（属于第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-99-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.802ex" height="1.994ex" viewBox="0 -755.9 345.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E100-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E100-MJMATHI-69" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-99">i</script> 个分类）的可能性</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-106-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E107-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E107-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-106">k</script>: 类别总数，如上图 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-101-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.472ex" height="1.994ex" viewBox="0 -755.9 2356.1 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E102-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path><path stroke-width="1" id="E102-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E102-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E102-MJMATHI-6B" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E102-MJMAIN-3D" x="799" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E102-MJMAIN-33" x="1855" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-101">k=3</script>。</p></blockquote><p>注意多类别分类问题中 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-107-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.481ex" height="2.577ex" viewBox="0 -806.1 2360 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E108-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E108-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E108-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E108-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E108-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMAIN-29" x="1970" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-107">h_\theta(x)</script> 的结果不再只是一个实数而是一个向量，如果类别总数为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-106-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E107-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E107-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-106">k</script>，现在 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-107-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.481ex" height="2.577ex" viewBox="0 -806.1 2360 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E108-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E108-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E108-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E108-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E108-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMAIN-29" x="1970" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-107">h_\theta(x)</script> 就是一个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-106-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E107-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E107-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-106">k</script> 维向量。</p><p>对于某个样本实例，需计算所有的 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-106-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E107-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E107-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-106">k</script> 种分类情况得到 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-107-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.481ex" height="2.577ex" viewBox="0 -806.1 2360 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E108-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E108-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E108-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E108-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E108-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E108-MJMAIN-29" x="1970" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-107">h_\theta(x)</script>，然后看分为哪个类别时预测输出的值最大，就说它输出属于哪个类别，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-108-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="16.298ex" height="4.562ex" viewBox="0 -1107.7 7017.2 1964.1" role="img" focusable="false" style="vertical-align: -1.989ex;"><defs><path stroke-width="1" id="E110-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E110-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E110-MJMAIN-6D" d="M41 46H55Q94 46 102 60V68Q102 77 102 91T102 122T103 161T103 203Q103 234 103 269T102 328V351Q99 370 88 376T43 385H25V408Q25 431 27 431L37 432Q47 433 65 434T102 436Q119 437 138 438T167 441T178 442H181V402Q181 364 182 364T187 369T199 384T218 402T247 421T285 437Q305 442 336 442Q351 442 364 440T387 434T406 426T421 417T432 406T441 395T448 384T452 374T455 366L457 361L460 365Q463 369 466 373T475 384T488 397T503 410T523 422T546 432T572 439T603 442Q729 442 740 329Q741 322 741 190V104Q741 66 743 59T754 49Q775 46 803 46H819V0H811L788 1Q764 2 737 2T699 3Q596 3 587 0H579V46H595Q656 46 656 62Q657 64 657 200Q656 335 655 343Q649 371 635 385T611 402T585 404Q540 404 506 370Q479 343 472 315T464 232V168V108Q464 78 465 68T468 55T477 49Q498 46 526 46H542V0H534L510 1Q487 2 460 2T422 3Q319 3 310 0H302V46H318Q379 46 379 62Q380 64 380 200Q379 335 378 343Q372 371 358 385T334 402T308 404Q263 404 229 370Q202 343 195 315T187 232V168V108Q187 78 188 68T191 55T200 49Q221 46 249 46H265V0H257L234 1Q210 2 183 2T145 3Q42 3 33 0H25V46H41Z"></path><path stroke-width="1" id="E110-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E110-MJMAIN-78" d="M201 0Q189 3 102 3Q26 3 17 0H11V46H25Q48 47 67 52T96 61T121 78T139 96T160 122T180 150L226 210L168 288Q159 301 149 315T133 336T122 351T113 363T107 370T100 376T94 379T88 381T80 383Q74 383 44 385H16V431H23Q59 429 126 429Q219 429 229 431H237V385Q201 381 201 369Q201 367 211 353T239 315T268 274L272 270L297 304Q329 345 329 358Q329 364 327 369T322 376T317 380T310 384L307 385H302V431H309Q324 428 408 428Q487 428 493 431H499V385H492Q443 385 411 368Q394 360 377 341T312 257L296 236L358 151Q424 61 429 57T446 50Q464 46 499 46H516V0H510H502Q494 1 482 1T457 2T432 2T414 3Q403 3 377 3T327 1L304 0H295V46H298Q309 46 320 51T331 63Q331 65 291 120L250 175Q249 174 219 133T185 88Q181 83 181 74Q181 63 188 55T206 46Q208 46 208 23V0H201Z"></path><path stroke-width="1" id="E110-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E110-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E110-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E110-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E110-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E110-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMAIN-3D" x="775" y="0"></use><g transform="translate(1831,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMAIN-6D"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMAIN-61" x="833" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMAIN-78" x="1334" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMATHI-69" x="1144" y="-915"></use></g><g transform="translate(4027,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMATHI-68" x="0" y="0"></use><g transform="translate(576,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMATHI-3B8" x="815" y="-474"></use></g><g transform="translate(5665,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E110-MJMAIN-29" x="962" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-108">y = \mathop{\max}\limits_i\,h_\theta^{\left( i \right)}\left( x \right)</script>。</p><h1><a name='header-n1279' class='md-header-anchor '></a>7 正则化(Regularization)</h1><h2><a name='header-n1280' class='md-header-anchor '></a>7.1 过拟合问题(The Problem of Overfitting)</h2><p>对于拟合的表现，可以分为三类情况：</p><ul><li><p><strong>欠拟合(Underfitting)</strong></p><p>无法很好的拟合训练集中的数据，预测值和实际值的误差很大，这类情况被称为欠拟合。拟合模型比较简单（特征选少了）时易出现这类情况。类似于，你上课不好好听，啥都不会，下课也差不多啥都不会。</p></li><li><p><strong>优良的拟合(Just right)</strong></p><p>不论是训练集数据还是不在训练集中的预测数据，都能给出较为正确的结果。类似于，学霸学神！</p></li><li><p><strong>过拟合(Overfitting)</strong></p><p>能很好甚至完美拟合训练集中的数据，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-109-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.148ex" height="2.577ex" viewBox="0 -806.1 3938.6 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E111-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E111-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E111-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E111-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E111-MJMAIN-2192" d="M56 237T56 250T70 270H835Q719 357 692 493Q692 494 692 496T691 499Q691 511 708 511H711Q720 511 723 510T729 506T732 497T735 481T743 456Q765 389 816 336T935 261Q944 258 944 250Q944 244 939 241T915 231T877 212Q836 186 806 152T761 85T740 35T732 4Q730 -6 727 -8T711 -11Q691 -11 691 0Q691 7 696 25Q728 151 835 230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E111-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E111-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E111-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E111-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E111-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E111-MJMAIN-2192" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E111-MJMAIN-30" x="3438" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-109">J(\theta) \to 0</script>，但是对于不在训练集中的<strong>新数据</strong>，预测值和实际值的误差会很大，<strong>泛化能力弱</strong>，这类情况被称为过拟合。拟合模型过于复杂（特征选多了）时易出现这类情况。类似于，你上课跟着老师做题都会都听懂了，下课遇到新题就懵了不会拓展。</p></li></ul><p>线性模型中的拟合情况(左图欠拟合，右图过拟合)：
+<div  id='write'  class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n2">6 逻辑回归(Logistic Regression)</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n3">6.1 分类(Classification)</a></span><span class="md-toc-item md-toc-h2" data-ref="n40"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n40">6.2 假设函数表示(Hypothesis Representation)</a></span><span class="md-toc-item md-toc-h2" data-ref="n64"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n64">6.3 决策边界(Decision Boundary)</a></span><span class="md-toc-item md-toc-h2" data-ref="n109"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n109">6.4 损失函数(Cost Function)</a></span><span class="md-toc-item md-toc-h2" data-ref="n138"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n138">6.5 简化的成本函数和梯度下降(Simplified Cost Function and Gradient Descent)</a></span><span class="md-toc-item md-toc-h2" data-ref="n198"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n198">6.6 进阶优化(Advanced Optimization)</a></span><span class="md-toc-item md-toc-h2" data-ref="n268"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n268">6.7 多类别分类: 一对多(Multiclass Classification: One-vs-all)</a></span><span class="md-toc-item md-toc-h1" data-ref="n286"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n286">7 正则化(Regularization)</a></span><span class="md-toc-item md-toc-h2" data-ref="n287"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n287">7.1 过拟合问题(The Problem of Overfitting)</a></span><span class="md-toc-item md-toc-h2" data-ref="n363"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n363">7.2 损失函数(Cost Function)</a></span><span class="md-toc-item md-toc-h2" data-ref="n420"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n420">7.3 线性回归正则化(Regularized Linear Regression)</a></span><span class="md-toc-item md-toc-h2" data-ref="n450"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n450">7.4 逻辑回归正则化(Regularized Logistic Regression)</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>6 逻辑回归(Logistic Regression)</h1><h2><a name='header-n3' class='md-header-anchor '></a>6.1 分类(Classification)</h2><p>在分类问题中，预测的结果是离散值（结果是否属于某一类），逻辑回归算法(Logistic Regression)被用于解决这类分类问题。</p><ul><li>垃圾邮件判断</li><li>金融欺诈判断</li><li>肿瘤诊断</li></ul><p>讨论肿瘤诊断问题：</p><p><img src='image/20180109_144040.png' alt='' /></p><p>肿瘤诊断问题的目的是告诉病人<strong>是否</strong>为恶性肿瘤，是一个<strong>二元分类问题(binary class problems)</strong>，则定义 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-169-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.68ex" height="2.577ex" viewBox="0 -806.1 4167.7 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E177-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E177-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E177-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E177-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E177-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E177-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E177-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E177-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E177-MJMAIN-2208" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E177-MJMAIN-7B" x="1720" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E177-MJMAIN-30" x="2221" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E177-MJMAIN-2C" x="2721" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E177-MJMAIN-31" x="3166" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E177-MJMAIN-7D" x="3667" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-169"> y \in\lbrace 0, 1\rbrace</script>，其中 0 表示<strong>负向类(negative class)</strong>，代表恶性肿瘤(&quot;-&quot;)，1 为<strong>正向类(positive class)</strong>，代表良性肿瘤(&quot;+&quot;)。如图，定义最右边的样本为<strong>偏差项</strong>。</p><p>在未加入偏差项时，线性回归算法给出了品红色的拟合直线，若规定</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-170-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.551ex" height="2.577ex" viewBox="0 -806.1 4973.5 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E178-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E178-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E178-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E178-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E178-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E178-MJAMS-2A7E" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM674 172Q692 172 694 154Q694 142 687 137Q685 135 395 -2L107 -138H101Q83 -136 83 -118Q83 -106 96 -100Q100 -98 380 35T665 170T674 172Z"></path><path stroke-width="1" id="E178-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E178-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E178-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJAMS-2A7E" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E178-MJMAIN-35" x="779" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-170">h_\theta(x) \geqslant 0.5</script> ，预测为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-219-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E227-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E227-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E227-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-219">y = 1</script>，即正向类；</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-172-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.551ex" height="2.577ex" viewBox="0 -806.1 4973.5 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E180-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E180-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E180-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E180-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E180-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E180-MJMAIN-3C" d="M694 -11T694 -19T688 -33T678 -40Q671 -40 524 29T234 166L90 235Q83 240 83 250Q83 261 91 266Q664 540 678 540Q681 540 687 534T694 519T687 505Q686 504 417 376L151 250L417 124Q686 -4 687 -5Q694 -11 694 -19Z"></path><path stroke-width="1" id="E180-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E180-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E180-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMAIN-3C" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E180-MJMAIN-35" x="779" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-172">h_\theta(x) \lt 0.5</script> ，预测为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-218-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E226-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E226-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E226-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E226-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E226-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E226-MJMAIN-30" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-218">y = 0</script>，即负向类。</p><p>即以 0.5 为<strong>阈值</strong>(threshold)，则我们就可以根据线性回归结果，得到相对正确的分类结果 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-29-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.155ex" height="1.877ex" viewBox="0 -504.6 497.5 808.1" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E36-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMATHI-79" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-29">y</script>。</p><p>&nbsp;</p><p>接下来加入偏差项，线性回归算法给出了靛青色的拟合直线，如果阈值仍然为 0.5，可以看到算法在某些情况下会给出完全错误的结果，对于癌症、肿瘤诊断这类要求预测极其精确的问题，这种情况是无法容忍的。</p><p>不仅如此，线性回归算法的值域为全体实数集（<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-174-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="10.086ex" height="2.577ex" viewBox="0 -806.1 4342.5 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E182-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E182-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E182-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E182-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E182-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E182-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E182-MJMATHI-52" d="M230 637Q203 637 198 638T193 649Q193 676 204 682Q206 683 378 683Q550 682 564 680Q620 672 658 652T712 606T733 563T739 529Q739 484 710 445T643 385T576 351T538 338L545 333Q612 295 612 223Q612 212 607 162T602 80V71Q602 53 603 43T614 25T640 16Q668 16 686 38T712 85Q717 99 720 102T735 105Q755 105 755 93Q755 75 731 36Q693 -21 641 -21H632Q571 -21 531 4T487 82Q487 109 502 166T517 239Q517 290 474 313Q459 320 449 321T378 323H309L277 193Q244 61 244 59Q244 55 245 54T252 50T269 48T302 46H333Q339 38 339 37T336 19Q332 6 326 0H311Q275 2 180 2Q146 2 117 2T71 2T50 1Q33 1 33 10Q33 12 36 24Q41 43 46 45Q50 46 61 46H67Q94 46 127 49Q141 52 146 61Q149 65 218 339T287 628Q287 635 230 637ZM630 554Q630 586 609 608T523 636Q521 636 500 636T462 637H440Q393 637 386 627Q385 624 352 494T319 361Q319 360 388 360Q466 361 492 367Q556 377 592 426Q608 449 619 486T630 554Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E182-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E182-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E182-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E182-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E182-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E182-MJMAIN-2208" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E182-MJMATHI-52" x="3583" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-174">h_\theta(x) \in R</script>），则当线性回归函数给出诸如 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-175-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.626ex" height="2.577ex" viewBox="0 -806.1 13616.8 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E183-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E183-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E183-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E183-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E183-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E183-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E183-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E183-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E183-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E183-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-3D" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-30" x="1501" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-30" x="2002" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-2C" x="6196" y="0"></use><g transform="translate(6641,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-28" x="7650" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMATHI-78" x="8039" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-29" x="8612" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-3D" x="9279" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-2212" x="10335" y="0"></use><g transform="translate(11114,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-30" x="1501" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E183-MJMAIN-30" x="2002" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-175">h_\theta(x) = 10000, h_\theta(x) = -10000</script> 等很大/很小(负数)的数值时，结果 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-176-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.68ex" height="2.577ex" viewBox="0 -806.1 4167.7 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E184-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E184-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E184-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E184-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E184-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E184-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E184-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E184-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E184-MJMAIN-2208" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E184-MJMAIN-7B" x="1720" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E184-MJMAIN-30" x="2221" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E184-MJMAIN-2C" x="2721" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E184-MJMAIN-31" x="3166" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E184-MJMAIN-7D" x="3667" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-176">y \in \lbrace 0, 1\rbrace</script>，这显得非常怪异。</p><p>&nbsp;</p><p>区别于线性回归算法，逻辑回归算法是一个分类算法，<strong>其输出值永远在 0 到 1 之间</strong>，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-177-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.49ex" height="2.577ex" viewBox="0 -806.1 5808.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E185-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E185-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E185-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E185-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E185-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E185-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E185-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E185-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E185-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMAIN-2208" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMAIN-28" x="3583" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMAIN-30" x="3972" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMAIN-2C" x="4473" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMAIN-31" x="4918" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E185-MJMAIN-29" x="5418" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-177">h_\theta(x) \in (0,1)</script>。</p><h2><a name='header-n40' class='md-header-anchor '></a>6.2 假设函数表示(Hypothesis Representation)</h2><p>为了使 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-178-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.49ex" height="2.577ex" viewBox="0 -806.1 5808.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E186-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E186-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E186-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E186-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E186-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E186-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E186-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E186-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E186-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMAIN-2208" x="2637" y="0"></use><g transform="translate(3583,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMAIN-30" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMAIN-2C" x="890" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMAIN-31" x="1335" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E186-MJMAIN-29" x="1835" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-178">h_\theta(x) \in \left(0, 1\right)</script>，引入逻辑回归模型，定义假设函数</p><div contenteditable="false" class="mathjax-block md-end-block" id="mathjax-n42" cid="n42" mdtype="math_block"><span class="MathJax_Preview"></span><span class="MathJax_SVG_Display" style="text-align: center;"><span class="MathJax_SVG" id="MathJax-Element-994-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="23.521ex" height="3.161ex" viewBox="0 -956.9 10127.1 1361" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E1330-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1330-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E1330-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1330-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1330-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1330-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1330-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E1330-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1330-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E1330-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E1330-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-67" x="3860" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMAIN-28" x="4341" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-7A" x="4730" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMAIN-29" x="5199" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMAIN-3D" x="5866" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-67" x="6922" y="0"></use><g transform="translate(7569,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-54" x="663" y="583"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJMATHI-78" x="1526" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1330-MJSZ1-29" x="2098" y="-1"></use></g></g></svg></span></span><script type="math/tex; mode=display" id="MathJax-Element-994">h_\theta \left( x \right)=g(z)=g\left(\theta^{T}x \right)</script></div><p>对比线性回归函数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-179-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.776ex" height="2.811ex" viewBox="0 -906.7 5500.9 1210.2" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E187-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E187-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E187-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E187-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E187-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E187-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E187-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMAIN-3D" x="2804" y="0"></use><g transform="translate(3860,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E187-MJMATHI-78" x="4928" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-179">h_\theta \left( x \right)=\theta^{T}x</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-18-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.116ex" height="1.877ex" viewBox="0 -504.6 480.5 808.1" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E25-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E25-MJMATHI-67" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-18">g</script> 表示逻辑函数(<a href='https://en.wikipedia.org/wiki/Logistic_function' target='_blank'>logistic function</a>)，复合起来，则称为逻辑回归函数。</p><p>逻辑函数是 S 形函数，会将所有实数映射到 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-180-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.168ex" height="2.577ex" viewBox="0 -806.1 2225.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E188-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E188-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E188-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E188-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E188-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E188-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E188-MJMAIN-30" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E188-MJMAIN-2C" x="890" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E188-MJMAIN-31" x="1335" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E188-MJMAIN-29" x="1835" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-180">(0, 1)</script> 范围。</p><p><a href='https://en.wikipedia.org/wiki/Sigmoid_function' target='_blank'>sigmoid 函数</a>（如下图）是逻辑函数的特殊情况，其公式为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-181-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.814ex" height="3.395ex" viewBox="0 -956.9 5517.2 1461.5" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E189-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E189-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E189-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E189-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E189-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E189-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E189-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E189-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E189-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMATHI-67" x="0" y="0"></use><g transform="translate(647,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMATHI-7A" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMAIN-29" x="858" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMAIN-3D" x="2172" y="0"></use><g transform="translate(2950,0)"><g transform="translate(397,0)"><rect stroke="none" width="2048" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMAIN-31" x="1198" y="572"></use><g transform="translate(59,-376)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMAIN-2212" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E189-MJMATHI-7A" x="778" y="0"></use></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-181">g\left( z \right)=\frac{1}{1+{{e}^{-z}}}</script>。 </p><p><img src='image/2413fbec8ff9fa1f19aaf78265b8a33b_Logistic_function.png' alt='sigmoid function' /></p><p>应用 sigmoid 函数，则逻辑回归模型：<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-182-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="25.328ex" height="3.978ex" viewBox="0 -956.9 10905.2 1712.8" role="img" focusable="false" style="vertical-align: -1.756ex;"><defs><path stroke-width="1" id="E190-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E190-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E190-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E190-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E190-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E190-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E190-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E190-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E190-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E190-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E190-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E190-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-3D" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-67" x="3694" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-28" x="4174" y="0"></use><g transform="translate(4564,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-78" x="5631" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-29" x="6204" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-3D" x="6871" y="0"></use><g transform="translate(7649,0)"><g transform="translate(397,0)"><rect stroke="none" width="2737" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-31" x="1685" y="572"></use><g transform="translate(60,-608)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-54" x="469" y="319"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E190-MJMATHI-78" x="2052" y="0"></use></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-182">h_{\theta}(x)=g(\theta^Tx) =\frac{1}{1+e^{-\theta^Tx}}</script></p><p>逻辑回归模型中，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-183-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.868ex" height="2.577ex" viewBox="0 -806.1 2526.7 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E191-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E191-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E191-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E191-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E191-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E191-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E191-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E191-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E191-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E191-MJMAIN-29" x="962" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-183">h_\theta \left( x \right)</script> 的作用是，根据输入 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-5-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E5-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E5-MJMATHI-78" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-5">x</script> 以及参数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E22-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E22-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-16">\theta</script>，计算得出”输出 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-214-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E222-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E222-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E222-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-214">y=1</script>“的可能性(estimated probability)，概率学中表示为：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-185-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="42.566ex" height="5.846ex" viewBox="0 -1509.8 18327.1 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E193-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E193-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E193-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E193-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E193-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E193-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E193-MJMATHI-50" d="M287 628Q287 635 230 637Q206 637 199 638T192 648Q192 649 194 659Q200 679 203 681T397 683Q587 682 600 680Q664 669 707 631T751 530Q751 453 685 389Q616 321 507 303Q500 302 402 301H307L277 182Q247 66 247 59Q247 55 248 54T255 50T272 48T305 46H336Q342 37 342 35Q342 19 335 5Q330 0 319 0Q316 0 282 1T182 2Q120 2 87 2T51 1Q33 1 33 11Q33 13 36 25Q40 41 44 43T67 46Q94 46 127 49Q141 52 146 61Q149 65 218 339T287 628ZM645 554Q645 567 643 575T634 597T609 619T560 635Q553 636 480 637Q463 637 445 637T416 636T404 636Q391 635 386 627Q384 621 367 550T332 412T314 344Q314 342 395 342H407H430Q542 342 590 392Q617 419 631 471T645 554Z"></path><path stroke-width="1" id="E193-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E193-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E193-MJMAIN-7C" d="M139 -249H137Q125 -249 119 -235V251L120 737Q130 750 139 750Q152 750 159 735V-235Q151 -249 141 -249H139Z"></path><path stroke-width="1" id="E193-MJMAIN-3B" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 85 94 103T137 121Q202 121 202 8Q202 -44 183 -94T144 -169T118 -194Q115 -194 106 -186T95 -174Q94 -171 107 -155T137 -107T160 -38Q161 -32 162 -22T165 -4T165 4Q165 5 161 4T142 0Q110 0 94 18T78 60Z"></path><path stroke-width="1" id="E193-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E193-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E193-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,651)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3D" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-50" x="3694" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-28" x="4445" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-79" x="4835" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3D" x="5610" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-31" x="6666" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-7C" x="7167" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-78" x="7445" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3B" x="8018" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-3B8" x="8463" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-29" x="8932" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3D" x="9600" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-31" x="10656" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-2212" x="11379" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-50" x="12379" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-28" x="13131" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-79" x="13520" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3D" x="14296" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-30" x="15352" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-7C" x="15852" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-78" x="16131" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3B" x="16703" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-3B8" x="17148" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-29" x="17618" y="0"></use></g><g transform="translate(0,-700)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-50" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-28" x="751" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-79" x="1141" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3D" x="1916" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-30" x="2972" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-7C" x="3473" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-78" x="3751" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3B" x="4324" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-3B8" x="4769" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-29" x="5238" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-2B" x="5850" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-50" x="6851" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-28" x="7602" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-79" x="7992" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3D" x="8767" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-31" x="9823" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-7C" x="10324" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-78" x="10602" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3B" x="11175" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMATHI-3B8" x="11620" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-29" x="12089" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-3D" x="12757" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E193-MJMAIN-31" x="13813" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-185">\begin{align*}& h_\theta(x) = P(y=1 | x ; \theta) = 1 - P(y=0 | x ; \theta) \newline & P(y = 0 | x;\theta) + P(y = 1 | x ; \theta) = 1\end{align*}</script></p><p>&nbsp;</p><p>以肿瘤诊断为例，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-186-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.939ex" height="2.577ex" viewBox="0 -806.1 5140.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E194-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E194-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E194-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E194-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E194-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E194-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E194-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E194-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E194-MJMAIN-37" d="M55 458Q56 460 72 567L88 674Q88 676 108 676H128V672Q128 662 143 655T195 646T364 644H485V605L417 512Q408 500 387 472T360 435T339 403T319 367T305 330T292 284T284 230T278 162T275 80Q275 66 275 52T274 28V19Q270 2 255 -10T221 -22Q210 -22 200 -19T179 0T168 40Q168 198 265 368Q285 400 349 489L395 552H302Q128 552 119 546Q113 543 108 522T98 479L95 458V455H55V458Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMAIN-3D" x="2804" y="0"></use><g transform="translate(3860,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E194-MJMAIN-37" x="779" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-186">h_\theta \left( x \right)=0.7</script> 表示病人有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-187-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.261ex" height="2.227ex" viewBox="0 -806.1 1834.5 958.9" role="img" focusable="false" style="vertical-align: -0.355ex;"><defs><path stroke-width="1" id="E195-MJMAIN-37" d="M55 458Q56 460 72 567L88 674Q88 676 108 676H128V672Q128 662 143 655T195 646T364 644H485V605L417 512Q408 500 387 472T360 435T339 403T319 367T305 330T292 284T284 230T278 162T275 80Q275 66 275 52T274 28V19Q270 2 255 -10T221 -22Q210 -22 200 -19T179 0T168 40Q168 198 265 368Q285 400 349 489L395 552H302Q128 552 119 546Q113 543 108 522T98 479L95 458V455H55V458Z"></path><path stroke-width="1" id="E195-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E195-MJMAIN-25" d="M465 605Q428 605 394 614T340 632T319 641Q332 608 332 548Q332 458 293 403T202 347Q145 347 101 402T56 548Q56 637 101 693T202 750Q241 750 272 719Q359 642 464 642Q580 642 650 732Q662 748 668 749Q670 750 673 750Q682 750 688 743T693 726Q178 -47 170 -52Q166 -56 160 -56Q147 -56 142 -45Q137 -36 142 -27Q143 -24 363 304Q469 462 525 546T581 630Q528 605 465 605ZM207 385Q235 385 263 427T292 548Q292 617 267 664T200 712Q193 712 186 709T167 698T147 668T134 615Q132 595 132 548V527Q132 436 165 403Q183 385 203 385H207ZM500 146Q500 234 544 290T647 347Q699 347 737 292T776 146T737 0T646 -56Q590 -56 545 0T500 146ZM651 -18Q679 -18 707 24T736 146Q736 215 711 262T644 309Q637 309 630 306T611 295T591 265T578 212Q577 200 577 146V124Q577 -18 647 -18H651Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E195-MJMAIN-37"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E195-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E195-MJMAIN-25" x="1001" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-187">70\%</script> 的概率得了恶性肿瘤。</p><h2><a name='header-n64' class='md-header-anchor '></a>6.3 决策边界(Decision Boundary)</h2><p>决策边界的概念，可帮助我们更好地理解逻辑回归模型的拟合原理。</p><p>在逻辑回归中，有假设函数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-188-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="23.521ex" height="3.044ex" viewBox="0 -906.7 10127.1 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E196-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E196-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E196-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E196-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E196-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E196-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E196-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E196-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E196-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E196-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E196-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-67" x="3860" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMAIN-28" x="4341" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-7A" x="4730" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMAIN-29" x="5199" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMAIN-3D" x="5866" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-67" x="6922" y="0"></use><g transform="translate(7569,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJMATHI-78" x="1526" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E196-MJSZ1-29" x="2098" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-188">h_\theta \left( x \right)=g(z)=g\left(\theta^{T}x \right)</script>。</p><p>为了得出分类的结果，这里和前面一样，规定以 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-189-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.972ex" height="1.994ex" viewBox="0 -755.9 1279.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E197-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E197-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E197-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E197-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E197-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E197-MJMAIN-35" x="779" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-189">0.5</script> 为阈值：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-190-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="21.323ex" height="5.846ex" viewBox="0 -1509.8 9180.7 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E198-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E198-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E198-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E198-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E198-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E198-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E198-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E198-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E198-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E198-MJMAIN-2192" d="M56 237T56 250T70 270H835Q719 357 692 493Q692 494 692 496T691 499Q691 511 708 511H711Q720 511 723 510T729 506T732 497T735 481T743 456Q765 389 816 336T935 261Q944 258 944 250Q944 244 939 241T915 231T877 212Q836 186 806 152T761 85T740 35T732 4Q730 -6 727 -8T711 -11Q691 -11 691 0Q691 7 696 25Q728 151 835 230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E198-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E198-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E198-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E198-MJMAIN-3C" d="M694 -11T694 -19T688 -33T678 -40Q671 -40 524 29T234 166L90 235Q83 240 83 250Q83 261 91 266Q664 540 678 540Q681 540 687 534T694 519T687 505Q686 504 417 376L151 250L417 124Q686 -4 687 -5Q694 -11 694 -19Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,651)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-2265" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-35" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-2192" x="5251" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMATHI-79" x="6529" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-3D" x="7304" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-31" x="8361" y="0"></use></g><g transform="translate(0,-700)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-3C" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-35" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-2192" x="5251" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMATHI-79" x="6529" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-3D" x="7304" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E198-MJMAIN-30" x="8361" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-190">\begin{align*}& h_\theta(x) \geq 0.5 \rightarrow y = 1 \newline& h_\theta(x) < 0.5 \rightarrow y = 0 \newline\end{align*}</script></p><p>回忆一下 sigmoid 函数的图像：</p><p><img src='image/2413fbec8ff9fa1f19aaf78265b8a33b_Logistic_function.png' alt='sigmoid function' /></p><p>观察可得当 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-191-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="10.084ex" height="2.577ex" viewBox="0 -806.1 4341.6 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E199-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E199-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E199-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E199-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E199-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E199-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E199-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E199-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E199-MJMATHI-67" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E199-MJMAIN-28" x="480" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E199-MJMATHI-7A" x="870" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E199-MJMAIN-29" x="1338" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E199-MJMAIN-2265" x="2005" y="0"></use><g transform="translate(3062,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E199-MJMAIN-30"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E199-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E199-MJMAIN-35" x="779" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-191">g(z) \geq 0.5</script> 时，有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-200-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.349ex" height="2.227ex" viewBox="0 -755.9 2303.1 958.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E208-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E208-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E208-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E208-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E208-MJMAIN-2265" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E208-MJMAIN-30" x="1802" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-200">z \geq 0</script>，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-193-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="8.07ex" height="2.577ex" viewBox="0 -906.7 3474.7 1109.7" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E201-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E201-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E201-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E201-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E201-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E201-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E201-MJMATHI-54" x="663" y="513"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E201-MJMATHI-78" x="1067" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E201-MJMAIN-2265" x="1917" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E201-MJMAIN-30" x="2974" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-193">\theta^Tx \geq 0</script>。</p><p>同线性回归模型的不同点在于： <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-194-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.512ex" height="5.846ex" viewBox="0 -1509.8 13567.4 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E202-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E202-MJMAIN-2192" d="M56 237T56 250T70 270H835Q719 357 692 493Q692 494 692 496T691 499Q691 511 708 511H711Q720 511 723 510T729 506T732 497T735 481T743 456Q765 389 816 336T935 261Q944 258 944 250Q944 244 939 241T915 231T877 212Q836 186 806 152T761 85T740 35T732 4Q730 -6 727 -8T711 -11Q691 -11 691 0Q691 7 696 25Q728 151 835 230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E202-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E202-MJMAIN-221E" d="M55 217Q55 305 111 373T254 442Q342 442 419 381Q457 350 493 303L507 284L514 294Q618 442 747 442Q833 442 888 374T944 214Q944 128 889 59T743 -11Q657 -11 580 50Q542 81 506 128L492 147L485 137Q381 -11 252 -11Q166 -11 111 57T55 217ZM907 217Q907 285 869 341T761 397Q740 397 720 392T682 378T648 359T619 335T594 310T574 285T559 263T548 246L543 238L574 198Q605 158 622 138T664 94T714 61T765 51Q827 51 867 100T907 217ZM92 214Q92 145 131 89T239 33Q357 33 456 193L425 233Q364 312 334 337Q285 380 233 380Q171 380 132 331T92 214Z"></path><path stroke-width="1" id="E202-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E202-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E202-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E202-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E202-MJMAIN-21D2" d="M580 514Q580 525 596 525Q601 525 604 525T609 525T613 524T615 523T617 520T619 517T622 512Q659 438 720 381T831 300T927 263Q944 258 944 250T935 239T898 228T840 204Q696 134 622 -12Q618 -21 615 -22T600 -24Q580 -24 580 -17Q580 -13 585 0Q620 69 671 123L681 133H70Q56 140 56 153Q56 168 72 173H725L735 181Q774 211 852 250Q851 251 834 259T789 283T735 319L725 327H72Q56 332 56 347Q56 360 70 367H681L671 377Q638 412 609 458T580 514Z"></path><path stroke-width="1" id="E202-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E202-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E202-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E202-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E202-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,651)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2192" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2B" x="2024" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-221E" x="2803" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2C" x="3803" y="0"></use><g transform="translate(4248,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2212" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-221E" x="778" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2192" x="6350" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-30" x="7629" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-21D2" x="8407" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMATHI-67" x="9685" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-28" x="10166" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMATHI-7A" x="10555" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-29" x="11024" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-3D" x="11691" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-31" x="12747" y="0"></use></g><g transform="translate(50,-700)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2192" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2212" x="2024" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-221E" x="2803" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2C" x="3803" y="0"></use><g transform="translate(4248,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMATHI-65" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-221E" x="659" y="583"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-2192" x="5800" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-221E" x="7078" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-21D2" x="8357" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMATHI-67" x="9635" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-28" x="10115" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMATHI-7A" x="10505" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-29" x="10973" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-3D" x="11641" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E202-MJMAIN-30" x="12697" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-194">\begin{align*}z \to +\infty, e^{-\infty} \to 0 \Rightarrow g(z)=1 \newline z \to -\infty, e^{\infty}\to \infty \Rightarrow g(z)=0 \end{align*}</script></p><p>直观一点来个例子，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-195-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="29.162ex" height="2.577ex" viewBox="0 -806.1 12555.8 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E203-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E203-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E203-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E203-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E203-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E203-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E203-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E203-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E203-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E203-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E203-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-67" x="3860" y="0"></use><g transform="translate(4507,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-2B" x="1535" y="0"></use><g transform="translate(2535,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(3459,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-2B" x="4707" y="0"></use><g transform="translate(5708,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(6632,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E203-MJMAIN-29" x="7658" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-195">{h_\theta}\left( x \right)=g\left( {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}\right)</script> 是下图模型的假设函数：</p><p><img src='image/20180111_000814.png' alt='' /></p><p>根据上面的讨论，要进行分类，那么只要 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-196-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="21.144ex" height="2.461ex" viewBox="0 -806.1 9103.5 1059.4" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E204-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E204-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E204-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E204-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E204-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E204-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E204-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-30" x="663" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-2B" x="1145" y="0"></use><g transform="translate(2146,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(3069,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-2B" x="4318" y="0"></use><g transform="translate(5319,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(6242,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-2265" x="7546" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E204-MJMAIN-30" x="8602" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-196"> {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}\geq0</script> 时，就预测 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-219-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E227-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E227-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E227-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-219">y = 1</script>，即预测为正向类。</p><p>如果取 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-198-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.001ex" height="9.114ex" viewBox="0 -2213.4 4736.6 3924.2" role="img" focusable="false" style="vertical-align: -3.974ex;"><defs><path stroke-width="1" id="E206-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E206-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E206-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E206-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E206-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E206-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E206-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E206-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E206-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E206-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E206-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E206-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E206-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJMATHI-3B8" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJMAIN-3D" x="747" y="0"></use><g transform="translate(1803,0)"><g transform="translate(0,2150)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-2048.5066225165565) scale(1,0.49337748344370863)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJSZ4-23A3" x="0" y="-3155"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,1350)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJMAIN-2212" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJMAIN-33" x="778" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJMAIN-31" x="389" y="-50"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJMAIN-31" x="389" y="-1450"></use></g></g><g transform="translate(2265,2150)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-2048.5066225165565) scale(1,0.49337748344370863)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E206-MJSZ4-23A6" x="0" y="-3155"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-198">\theta = \begin{bmatrix} -3\\1\\1\end{bmatrix}</script>，则有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-199-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.606ex" height="2.227ex" viewBox="0 -755.9 7580.3 958.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E207-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E207-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E207-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E207-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E207-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E207-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E207-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E207-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMAIN-3D" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMAIN-2212" x="1802" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMAIN-33" x="2581" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMAIN-2B" x="3303" y="0"></use><g transform="translate(4304,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMAIN-2B" x="5553" y="0"></use><g transform="translate(6553,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E207-MJMAIN-32" x="809" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-199">z = -3+{x_1}+{x_2}</script>，当 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-200-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.349ex" height="2.227ex" viewBox="0 -755.9 2303.1 958.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E208-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E208-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E208-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E208-MJMATHI-7A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E208-MJMAIN-2265" x="746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E208-MJMAIN-30" x="1802" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-200">z \geq 0</script> 即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-201-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.869ex" height="2.227ex" viewBox="0 -755.9 5110.3 958.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E209-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E209-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E209-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E209-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E209-MJMAIN-2265" d="M83 616Q83 624 89 630T99 636Q107 636 253 568T543 431T687 361Q694 356 694 346T687 331Q685 329 395 192L107 56H101Q83 58 83 76Q83 77 83 79Q82 86 98 95Q117 105 248 167Q326 204 378 228L626 346L360 472Q291 505 200 548Q112 589 98 597T83 616ZM84 -118Q84 -108 99 -98H678Q694 -104 694 -118Q694 -130 679 -138H98Q84 -131 84 -118Z"></path><path stroke-width="1" id="E209-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E209-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E209-MJMAIN-31" x="809" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E209-MJMAIN-2B" x="1248" y="0"></use><g transform="translate(2249,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E209-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E209-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E209-MJMAIN-2265" x="3553" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E209-MJMAIN-33" x="4609" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-201">{x_1}+{x_2} \geq 3</script> 时，易绘制图中的品红色直线即<strong>决策边界</strong>，为正向类（以红叉标注的数据）给出 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-214-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E222-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E222-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E222-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-214">y=1</script> 的分类预测结果。</p><p>&nbsp;</p><p>上面讨论了逻辑回归模型中线性拟合的例子，下面则是一个多项式拟合的例子，和线性回归中的情况也是类似的。</p><p>为了拟合下图数据，建模多项式假设函数：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-203-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="44.221ex" height="3.044ex" viewBox="0 -906.7 19039.3 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E211-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E211-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E211-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E211-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E211-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E211-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E211-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E211-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E211-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E211-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E211-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E211-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E211-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path><path stroke-width="1" id="E211-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E211-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-67" x="3860" y="0"></use><g transform="translate(4507,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-2B" x="1604" y="0"></use><g transform="translate(2604,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(3528,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-2B" x="4776" y="0"></use><g transform="translate(5777,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(6701,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-2B" x="7949" y="0"></use><g transform="translate(8950,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-33" x="663" y="-213"></use></g><g transform="translate(9873,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-32" x="809" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-31" x="809" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-2B" x="11122" y="0"></use><g transform="translate(12123,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-34" x="663" y="-213"></use></g><g transform="translate(13046,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-32" x="809" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJMAIN-32" x="809" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E211-MJSZ1-29" x="14072" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-203">{h_\theta}\left( x \right)=g\left( {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}+{\theta_{3}}x_{1}^{2}+{\theta_{4}}x_{2}^{2} \right)</script></p><p>这里取 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-204-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="11.001ex" height="15.651ex" viewBox="0 -3620.7 4736.6 6738.7" role="img" focusable="false" style="vertical-align: -7.242ex;"><defs><path stroke-width="1" id="E212-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E212-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E212-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E212-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E212-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E212-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E212-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E212-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E212-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E212-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E212-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E212-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E212-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJMATHI-3B8" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJMAIN-3D" x="747" y="0"></use><g transform="translate(1803,0)"><g transform="translate(0,3550)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-4843.8708609271525) scale(1,5.129139072847682)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJSZ4-23A3" x="0" y="-5955"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,2750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJMAIN-2212" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJMAIN-31" x="778" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJMAIN-30" x="389" y="1350"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJMAIN-30" x="389" y="-50"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJMAIN-31" x="389" y="-1450"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJMAIN-31" x="389" y="-2850"></use></g></g><g transform="translate(2265,3550)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-4843.8708609271525) scale(1,5.129139072847682)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E212-MJSZ4-23A6" x="0" y="-5955"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-204">\theta = \begin{bmatrix} -1\\0\\0\\1\\1\end{bmatrix}</script>，决策边界对应了一个在原点处的单位圆（<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-205-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.978ex" height="2.577ex" viewBox="0 -906.7 6018.1 1109.7" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E213-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E213-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E213-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E213-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E213-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMAIN-31" x="809" y="-213"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMAIN-32" x="1451" y="513"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMAIN-2B" x="1702" y="0"></use><g transform="translate(2703,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMAIN-32" x="809" y="-213"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMAIN-32" x="1451" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMAIN-3D" x="4461" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E213-MJMAIN-31" x="5517" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-205">{x_1}^2+{x_2}^2 = 1</script>），如此便可给出分类结果，如图中品红色曲线：</p><p>&nbsp;</p><p><img src='image/20180111_000653.png' alt='' /></p><p>当然，通过一些更为复杂的多项式，还能拟合那些图像显得非常怪异的数据，使得决策边界形似碗状、爱心状等等。</p><p>&nbsp;</p><p>简单来说，决策边界就是<strong>分类的分界线</strong>，分类现在实际就由 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-206-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.088ex" height="1.41ex" viewBox="0 -504.6 468.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E214-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E214-MJMATHI-7A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-206">z</script> (中的 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E22-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E22-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-16">\theta</script>)决定啦。</p><h2><a name='header-n109' class='md-header-anchor '></a>6.4 损失函数(Cost Function)</h2><p>那我们怎么知道决策边界是啥样？<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E22-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E22-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-16">\theta</script> 多少时能很好的拟合数据？当然，见招拆招，总要来个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-246-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E254-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E254-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E254-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E254-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-246">J(\theta)</script>。</p><p>如果直接套用线性回归的损失函数： <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-208-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.932ex" height="5.846ex" viewBox="0 -1459.5 13748.3 2517" role="img" focusable="false" style="vertical-align: -2.456ex;"><defs><path stroke-width="1" id="E216-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E216-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E216-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E216-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E216-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E216-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E216-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E216-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E216-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E216-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E216-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E216-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E216-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E216-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E216-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E216-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-4A" x="0" y="0"></use><g transform="translate(800,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-3B8" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-29" x="859" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-3D" x="2326" y="0"></use><g transform="translate(3104,0)"><g transform="translate(397,0)"><rect stroke="none" width="1095" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-31" x="524" y="572"></use><g transform="translate(60,-376)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-32" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-6D" x="500" y="0"></use></g></g></g><g transform="translate(4884,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJSZ1-2211" x="46" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-6D" x="372" y="1344"></use></g><g transform="translate(6199,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1633,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-2212" x="4240" y="0"></use><g transform="translate(5241,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJSZ1-29" x="6636" y="-1"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E216-MJMAIN-32" x="10033" y="878"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-208">J\left( {\theta} \right)=\frac{1}{2m}\sum\limits_{i=1}^{m}{{{\left( h_{\theta} \left({x}^{\left( i \right)} \right)-{y}^{\left( i \right)} \right)}^{2}}}</script></p><p>其中 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-225-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="16.022ex" height="3.044ex" viewBox="0 -906.7 6898.4 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E233-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E233-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E233-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E233-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E233-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E233-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E233-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E233-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E233-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E233-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMAIN-3D" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-67" x="3694" y="0"></use><g transform="translate(4341,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-78" x="1526" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJSZ1-29" x="2098" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-225">h_\theta(x) = g\left(\theta^{T}x \right)</script>，可绘制关于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-246-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E254-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E254-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E254-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E254-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-246">J(\theta)</script> 的图像，如下图</p><p><img src='image/20180111_080314.png' alt='' /></p><p>回忆线性回归中的损失函数，其是一个二次凸函数（碗状），二次凸函数的重要性质是只有一个局部最小点即全局最小点。上图中有许多局部最小点，这样将使得梯度下降算法无法确定收敛点是全局最优。</p><p><img src='image/20180111_080514.png' alt='' /></p><p>如果损失函数也是一个凸函数，是否也有同样的性质，从而最优化？这类讨论凸函数最优值的问题，被称为<strong>凸优化问题(Convex optimization)</strong>。</p><p>当然，损失函数不止平方损失函数一种。</p><p>对于逻辑回归，更换平方损失函数为<strong>对数损失函数</strong>，可由统计学中的最大似然估计方法可推出损失函数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-246-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E254-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E254-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E254-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E254-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-246">J(\theta)</script>：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-212-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="47.03ex" height="13.083ex" viewBox="0 -3067.8 20249.2 5633" role="img" focusable="false" style="vertical-align: -5.958ex;"><defs><path stroke-width="1" id="E220-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E220-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E220-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E220-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E220-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E220-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E220-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E220-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E220-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E220-MJMAIN-43" d="M56 342Q56 428 89 500T174 615T283 681T391 705Q394 705 400 705T408 704Q499 704 569 636L582 624L612 663Q639 700 643 704Q644 704 647 704T653 705H657Q660 705 666 699V419L660 413H626Q620 419 619 430Q610 512 571 572T476 651Q457 658 426 658Q322 658 252 588Q173 509 173 342Q173 221 211 151Q232 111 263 84T328 45T384 29T428 24Q517 24 571 93T626 244Q626 251 632 257H660L666 251V236Q661 133 590 56T403 -21Q262 -21 159 83T56 342Z"></path><path stroke-width="1" id="E220-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E220-MJMAIN-73" d="M295 316Q295 356 268 385T190 414Q154 414 128 401Q98 382 98 349Q97 344 98 336T114 312T157 287Q175 282 201 278T245 269T277 256Q294 248 310 236T342 195T359 133Q359 71 321 31T198 -10H190Q138 -10 94 26L86 19L77 10Q71 4 65 -1L54 -11H46H42Q39 -11 33 -5V74V132Q33 153 35 157T45 162H54Q66 162 70 158T75 146T82 119T101 77Q136 26 198 26Q295 26 295 104Q295 133 277 151Q257 175 194 187T111 210Q75 227 54 256T33 318Q33 357 50 384T93 424T143 442T187 447H198Q238 447 268 432L283 424L292 431Q302 440 314 448H322H326Q329 448 335 442V310L329 304H301Q295 310 295 316Z"></path><path stroke-width="1" id="E220-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E220-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E220-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E220-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E220-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E220-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E220-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E220-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E220-MJMAIN-69" d="M69 609Q69 637 87 653T131 669Q154 667 171 652T188 609Q188 579 171 564T129 549Q104 549 87 564T69 609ZM247 0Q232 3 143 3Q132 3 106 3T56 1L34 0H26V46H42Q70 46 91 49Q100 53 102 60T104 102V205V293Q104 345 102 359T88 378Q74 385 41 385H30V408Q30 431 32 431L42 432Q52 433 70 434T106 436Q123 437 142 438T171 441T182 442H185V62Q190 52 197 50T232 46H255V0H247Z"></path><path stroke-width="1" id="E220-MJMAIN-66" d="M273 0Q255 3 146 3Q43 3 34 0H26V46H42Q70 46 91 49Q99 52 103 60Q104 62 104 224V385H33V431H104V497L105 564L107 574Q126 639 171 668T266 704Q267 704 275 704T289 705Q330 702 351 679T372 627Q372 604 358 590T321 576T284 590T270 627Q270 647 288 667H284Q280 668 273 668Q245 668 223 647T189 592Q183 572 182 497V431H293V385H185V225Q185 63 186 61T189 57T194 54T199 51T206 49T213 48T222 47T231 47T241 46T251 46H282V0H273Z"></path><path stroke-width="1" id="E220-MJMAIN-79" d="M69 -66Q91 -66 104 -80T118 -116Q118 -134 109 -145T91 -160Q84 -163 97 -166Q104 -168 111 -168Q131 -168 148 -159T175 -138T197 -106T213 -75T225 -43L242 0L170 183Q150 233 125 297Q101 358 96 368T80 381Q79 382 78 382Q66 385 34 385H19V431H26L46 430Q65 430 88 429T122 428Q129 428 142 428T171 429T200 430T224 430L233 431H241V385H232Q183 385 185 366L286 112Q286 113 332 227L376 341V350Q376 365 366 373T348 383T334 385H331V431H337H344Q351 431 361 431T382 430T405 429T422 429Q477 429 503 431H508V385H497Q441 380 422 345Q420 343 378 235T289 9T227 -131Q180 -204 113 -204Q69 -204 44 -177T19 -116Q19 -89 35 -78T69 -66Z"></path><path stroke-width="1" id="E220-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,1417)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-3D" x="2159" y="0"></use><g transform="translate(3216,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(4621,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-6D" x="582" y="1627"></use></g><g transform="translate(6232,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-43" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-6F" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-73" x="1223" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-74" x="1617" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="8239" y="0"></use><g transform="translate(8628,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="9637" y="0"></use><g transform="translate(10026,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="11494" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-2C" x="11884" y="0"></use><g transform="translate(12329,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="13723" y="0"></use></g><g transform="translate(0,-881)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-43" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-6F" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-73" x="1223" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-74" x="1617" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="2007" y="0"></use><g transform="translate(2396,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="3404" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-78" x="3794" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="4366" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-2C" x="4756" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-79" x="5201" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="5699" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-3D" x="6366" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-2212" x="7422" y="0"></use><g transform="translate(8367,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="9647" y="0"></use><g transform="translate(10036,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="11045" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-78" x="11434" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="12007" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="12396" y="0"></use></g><g transform="translate(0,-2232)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-43" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-6F" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-73" x="1223" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-74" x="1617" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="2007" y="0"></use><g transform="translate(2396,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="3404" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-78" x="3794" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="4366" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-2C" x="4756" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-79" x="5201" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="5699" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-3D" x="6366" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-2212" x="7422" y="0"></use><g transform="translate(8367,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="9647" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-31" x="10036" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-2212" x="10759" y="0"></use><g transform="translate(11760,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-28" x="12768" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMATHI-78" x="13158" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="13730" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-29" x="14120" y="0"></use></g></g><g transform="translate(16772,0)"><g transform="translate(0,-881)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-69"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-66" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-79" x="835" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-3D" x="1613" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-31" x="2642" y="0"></use></g><g transform="translate(0,-2232)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-69"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-66" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-79" x="835" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-3D" x="1613" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E220-MJMAIN-30" x="2642" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-212">\begin{align*}& J(\theta) = \dfrac{1}{m} \sum_{i=1}^m \mathrm{Cost}(h_\theta(x^{(i)}),y^{(i)}) \newline & \mathrm{Cost}(h_\theta(x),y) = -\log(h_\theta(x)) \; & \text{if y = 1} \newline & \mathrm{Cost}(h_\theta(x),y) = -\log(1-h_\theta(x)) \; & \text{if y = 0}\end{align*}</script></p><p>则有关于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-246-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E254-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E254-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E254-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E254-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-246">J(\theta)</script> 的图像如下：</p><p><img src='image/20180111_080614.png' alt='' /></p><p>如左图，当训练集的结果为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-214-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E222-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E222-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E222-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E222-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-214">y=1</script>（正样本）时，随着假设函数趋向于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-215-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E223-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E223-MJMAIN-31" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-215">1</script>，损失函数的值会趋于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-131-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E139-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E139-MJMAIN-30" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-131">0</script>，即意味着拟合程度很好。如果假设函数此时趋于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-131-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E139-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E139-MJMAIN-30" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-131">0</script>，则会给出一个<strong>很高的损失</strong>，拟合程度<strong>差</strong>，算法会根据其迅速纠正 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E22-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E22-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-16">\theta</script> 值，右图 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-216-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E224-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E224-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E224-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E224-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E224-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E224-MJMAIN-30" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-216">y=0</script> 同理。</p><p>区别于平方损失函数，对数损失函数也是一个凸函数，但没有局部最优值。</p><h2><a name='header-n138' class='md-header-anchor '></a>6.5 简化的成本函数和梯度下降(Simplified Cost Function and Gradient Descent)</h2><p>由于懒得分类讨论，对于二元分类问题，我们可把损失函数<strong>简化</strong>为一个函数： 
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-217-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="63.022ex" height="2.577ex" viewBox="0 -806.1 27134.6 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E225-MJMATHI-43" d="M50 252Q50 367 117 473T286 641T490 704Q580 704 633 653Q642 643 648 636T656 626L657 623Q660 623 684 649Q691 655 699 663T715 679T725 690L740 705H746Q760 705 760 698Q760 694 728 561Q692 422 692 421Q690 416 687 415T669 413H653Q647 419 647 422Q647 423 648 429T650 449T651 481Q651 552 619 605T510 659Q484 659 454 652T382 628T299 572T226 479Q194 422 175 346T156 222Q156 108 232 58Q280 24 350 24Q441 24 512 92T606 240Q610 253 612 255T628 257Q648 257 648 248Q648 243 647 239Q618 132 523 55T319 -22Q206 -22 128 53T50 252Z"></path><path stroke-width="1" id="E225-MJMATHI-6F" d="M201 -11Q126 -11 80 38T34 156Q34 221 64 279T146 380Q222 441 301 441Q333 441 341 440Q354 437 367 433T402 417T438 387T464 338T476 268Q476 161 390 75T201 -11ZM121 120Q121 70 147 48T206 26Q250 26 289 58T351 142Q360 163 374 216T388 308Q388 352 370 375Q346 405 306 405Q243 405 195 347Q158 303 140 230T121 120Z"></path><path stroke-width="1" id="E225-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E225-MJMATHI-74" d="M26 385Q19 392 19 395Q19 399 22 411T27 425Q29 430 36 430T87 431H140L159 511Q162 522 166 540T173 566T179 586T187 603T197 615T211 624T229 626Q247 625 254 615T261 596Q261 589 252 549T232 470L222 433Q222 431 272 431H323Q330 424 330 420Q330 398 317 385H210L174 240Q135 80 135 68Q135 26 162 26Q197 26 230 60T283 144Q285 150 288 151T303 153H307Q322 153 322 145Q322 142 319 133Q314 117 301 95T267 48T216 6T155 -11Q125 -11 98 4T59 56Q57 64 57 83V101L92 241Q127 382 128 383Q128 385 77 385H26Z"></path><path stroke-width="1" id="E225-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E225-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E225-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E225-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E225-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E225-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E225-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E225-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E225-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E225-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E225-MJMATHI-6C" d="M117 59Q117 26 142 26Q179 26 205 131Q211 151 215 152Q217 153 225 153H229Q238 153 241 153T246 151T248 144Q247 138 245 128T234 90T214 43T183 6T137 -11Q101 -11 70 11T38 85Q38 97 39 102L104 360Q167 615 167 623Q167 626 166 628T162 632T157 634T149 635T141 636T132 637T122 637Q112 637 109 637T101 638T95 641T94 647Q94 649 96 661Q101 680 107 682T179 688Q194 689 213 690T243 693T254 694Q266 694 266 686Q266 675 193 386T118 83Q118 81 118 75T117 65V59Z"></path><path stroke-width="1" id="E225-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E225-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-43" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-6F" x="760" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-73" x="1246" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-74" x="1715" y="0"></use><g transform="translate(2243,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1564,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-2C" x="3082" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-79" x="3527" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-29" x="4025" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-3D" x="6936" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-2212" x="7992" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-79" x="8771" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-D7" x="9490" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-6C" x="10491" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-6F" x="10790" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-67" x="11275" y="0"></use><g transform="translate(11922,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1564,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-29" x="2916" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-2212" x="15450" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-28" x="16451" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-31" x="16840" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-2212" x="17563" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-79" x="18564" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-29" x="19061" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-D7" x="19673" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-6C" x="20674" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-6F" x="20972" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-67" x="21458" y="0"></use><g transform="translate(22105,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-31" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-2212" x="1112" y="0"></use><g transform="translate(2112,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(3288,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E225-MJMAIN-29" x="4639" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-217">Cost\left( {h_\theta}\left( x \right),y \right)=-y\times log\left( {h_\theta}\left( x \right) \right)-(1-y)\times log\left( 1-{h_\theta}\left( x \right) \right)</script></p><p>当 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-218-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E226-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E226-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E226-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E226-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E226-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E226-MJMAIN-30" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-218">y = 0</script>，左边式子整体为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-131-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E139-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E139-MJMAIN-30" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-131">0</script>，当 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-219-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.416ex" height="2.461ex" viewBox="0 -755.9 2332.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E227-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E227-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E227-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E227-MJMAIN-31" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-219">y = 1</script>，则 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-220-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.419ex" height="2.461ex" viewBox="0 -755.9 4055.5 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E228-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E228-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E228-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E228-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E228-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E228-MJMAIN-31" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E228-MJMAIN-2212" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E228-MJMATHI-79" x="1723" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E228-MJMAIN-3D" x="2498" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E228-MJMAIN-30" x="3555" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-220">1-y=0</script>，右边式子整体为0，也就和上面的分段函数一样了，而一个式子计算起来更方便。</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-227-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="61.184ex" height="6.78ex" viewBox="0 -1660.6 26342.9 2919" role="img" focusable="false" style="vertical-align: -2.923ex;"><defs><path stroke-width="1" id="E235-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E235-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E235-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E235-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E235-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E235-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E235-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E235-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E235-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E235-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E235-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E235-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E235-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E235-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E235-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E235-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E235-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E235-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E235-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-3D" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-2212" x="3216" y="0"></use><g transform="translate(3994,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(5142,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-6D" x="582" y="1627"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-5B" x="1444" y="0"></use><g transform="translate(1723,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(3284,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="4563" y="0"></use><g transform="translate(4953,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="5961" y="0"></use><g transform="translate(6351,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="7819" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="8208" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-2B" x="8820" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="9821" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-31" x="10210" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-2212" x="10933" y="0"></use><g transform="translate(11933,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="13328" y="0"></use><g transform="translate(13884,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="15164" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-31" x="15553" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-2212" x="16276" y="0"></use><g transform="translate(17277,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="18285" y="0"></use><g transform="translate(18675,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="20143" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="20532" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-5D" x="20922" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-227">J(\theta) = - \frac{1}{m} \displaystyle \sum_{i=1}^m [y^{(i)}\log (h_\theta (x^{(i)})) + (1 - y^{(i)})\log (1 - h_\theta(x^{(i)}))]</script></p><p>向量化实现：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-222-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="10.433ex" height="2.577ex" viewBox="0 -806.1 4492.1 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E230-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E230-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E230-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E230-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E230-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E230-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E230-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E230-MJMATHI-68" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E230-MJMAIN-3D" x="854" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E230-MJMATHI-67" x="1910" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E230-MJMAIN-28" x="2391" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E230-MJMATHI-58" x="2780" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E230-MJMATHI-3B8" x="3633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E230-MJMAIN-29" x="4102" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-222">h = g(X\theta)</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-223-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="46.13ex" height="3.278ex" viewBox="0 -956.9 19861.3 1411.3" role="img" focusable="false" style="vertical-align: -1.055ex;"><defs><path stroke-width="1" id="E231-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E231-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E231-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E231-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E231-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E231-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E231-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E231-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E231-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E231-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E231-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E231-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E231-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E231-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E231-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E231-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E231-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-3D" x="2159" y="0"></use><g transform="translate(2938,0)"><g transform="translate(397,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-6D" x="84" y="-488"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-22C5" x="4419" y="0"></use><g transform="translate(4920,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-2212" x="458" y="0"></use><g transform="translate(1237,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-79" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-54" x="706" y="513"></use></g><g transform="translate(2501,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-28" x="3780" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-68" x="4170" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-29" x="4746" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-2212" x="5358" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-28" x="6359" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-31" x="6748" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-2212" x="7471" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-79" x="8472" y="0"></use><g transform="translate(8969,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-54" x="550" y="513"></use></g><g transform="translate(10124,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-28" x="11403" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-31" x="11793" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-2212" x="12515" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMATHI-68" x="13516" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJMAIN-29" x="14093" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E231-MJSZ1-29" x="14482" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-223">J(\theta) = \frac{1}{m} \cdot \left(-y^{T}\log(h)-(1-y)^{T}\log(1-h)\right)</script></p><p>&nbsp;</p><p>为了最优化 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E22-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E22-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-16">\theta</script>，仍使用梯度下降法，算法同线性回归中一致：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-224-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="28.85ex" height="12.149ex" viewBox="0 -2866.8 12421.4 5231" role="img" focusable="false" style="vertical-align: -5.491ex;"><defs><path stroke-width="1" id="E232-MJMAIN-72" d="M36 46H50Q89 46 97 60V68Q97 77 97 91T98 122T98 161T98 203Q98 234 98 269T98 328L97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 60 434T96 436Q112 437 131 438T160 441T171 442H174V373Q213 441 271 441H277Q322 441 343 419T364 373Q364 352 351 337T313 322Q288 322 276 338T263 372Q263 381 265 388T270 400T273 405Q271 407 250 401Q234 393 226 386Q179 341 179 207V154Q179 141 179 127T179 101T180 81T180 66V61Q181 59 183 57T188 54T193 51T200 49T207 48T216 47T225 47T235 46T245 46H276V0H267Q249 3 140 3Q37 3 28 0H20V46H36Z"></path><path stroke-width="1" id="E232-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E232-MJMAIN-70" d="M36 -148H50Q89 -148 97 -134V-126Q97 -119 97 -107T97 -77T98 -38T98 6T98 55T98 106Q98 140 98 177T98 243T98 296T97 335T97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 61 434T98 436Q115 437 135 438T165 441T176 442H179V416L180 390L188 397Q247 441 326 441Q407 441 464 377T522 216Q522 115 457 52T310 -11Q242 -11 190 33L182 40V-45V-101Q182 -128 184 -134T195 -145Q216 -148 244 -148H260V-194H252L228 -193Q205 -192 178 -192T140 -191Q37 -191 28 -194H20V-148H36ZM424 218Q424 292 390 347T305 402Q234 402 182 337V98Q222 26 294 26Q345 26 384 80T424 218Z"></path><path stroke-width="1" id="E232-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E232-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E232-MJMAIN-75" d="M383 58Q327 -10 256 -10H249Q124 -10 105 89Q104 96 103 226Q102 335 102 348T96 369Q86 385 36 385H25V408Q25 431 27 431L38 432Q48 433 67 434T105 436Q122 437 142 438T172 441T184 442H187V261Q188 77 190 64Q193 49 204 40Q224 26 264 26Q290 26 311 35T343 58T363 90T375 120T379 144Q379 145 379 161T380 201T380 248V315Q380 361 370 372T320 385H302V431Q304 431 378 436T457 442H464V264Q464 84 465 81Q468 61 479 55T524 46H542V0Q540 0 467 -5T390 -11H383V58Z"></path><path stroke-width="1" id="E232-MJMAIN-6E" d="M41 46H55Q94 46 102 60V68Q102 77 102 91T102 122T103 161T103 203Q103 234 103 269T102 328V351Q99 370 88 376T43 385H25V408Q25 431 27 431L37 432Q47 433 65 434T102 436Q119 437 138 438T167 441T178 442H181V402Q181 364 182 364T187 369T199 384T218 402T247 421T285 437Q305 442 336 442Q450 438 463 329Q464 322 464 190V104Q464 66 466 59T477 49Q498 46 526 46H542V0H534L510 1Q487 2 460 2T422 3Q319 3 310 0H302V46H318Q379 46 379 62Q380 64 380 200Q379 335 378 343Q372 371 358 385T334 402T308 404Q263 404 229 370Q202 343 195 315T187 232V168V108Q187 78 188 68T191 55T200 49Q221 46 249 46H265V0H257L234 1Q210 2 183 2T145 3Q42 3 33 0H25V46H41Z"></path><path stroke-width="1" id="E232-MJMAIN-69" d="M69 609Q69 637 87 653T131 669Q154 667 171 652T188 609Q188 579 171 564T129 549Q104 549 87 564T69 609ZM247 0Q232 3 143 3Q132 3 106 3T56 1L34 0H26V46H42Q70 46 91 49Q100 53 102 60T104 102V205V293Q104 345 102 359T88 378Q74 385 41 385H30V408Q30 431 32 431L42 432Q52 433 70 434T106 436Q123 437 142 438T171 441T182 442H185V62Q190 52 197 50T232 46H255V0H247Z"></path><path stroke-width="1" id="E232-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E232-MJMAIN-63" d="M370 305T349 305T313 320T297 358Q297 381 312 396Q317 401 317 402T307 404Q281 408 258 408Q209 408 178 376Q131 329 131 219Q131 137 162 90Q203 29 272 29Q313 29 338 55T374 117Q376 125 379 127T395 129H409Q415 123 415 120Q415 116 411 104T395 71T366 33T318 2T249 -11Q163 -11 99 53T34 214Q34 318 99 383T250 448T370 421T404 357Q404 334 387 320Z"></path><path stroke-width="1" id="E232-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E232-MJMAIN-76" d="M338 431Q344 429 422 429Q479 429 503 431H508V385H497Q439 381 423 345Q421 341 356 172T288 -2Q283 -11 263 -11Q244 -11 239 -2Q99 359 98 364Q93 378 82 381T43 385H19V431H25L33 430Q41 430 53 430T79 430T104 429T122 428Q217 428 232 431H240V385H226Q187 384 184 370Q184 366 235 234L286 102L377 341V349Q377 363 367 372T349 383T335 385H331V431H338Z"></path><path stroke-width="1" id="E232-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E232-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E232-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E232-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E232-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E232-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E232-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E232-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E232-MJMAIN-2202" d="M202 508Q179 508 169 520T158 547Q158 557 164 577T185 624T230 675T301 710L333 715H345Q378 715 384 714Q447 703 489 661T549 568T566 457Q566 362 519 240T402 53Q321 -22 223 -22Q123 -22 73 56Q42 102 42 148V159Q42 276 129 370T322 465Q383 465 414 434T455 367L458 378Q478 461 478 515Q478 603 437 639T344 676Q266 676 223 612Q264 606 264 572Q264 547 246 528T202 508ZM430 306Q430 372 401 400T333 428Q270 428 222 382Q197 354 183 323T150 221Q132 149 132 116Q132 21 232 21Q244 21 250 22Q327 35 374 112Q389 137 409 196T430 306Z"></path><path stroke-width="1" id="E232-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E232-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E232-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E232-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-7D" x="0" y="-2037"></use></g><g transform="translate(485,0)"><g transform="translate(0,1987)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-72"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-65" x="392" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-70" x="837" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-65" x="1393" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-61" x="1838" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-74" x="2338" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-75" x="2978" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-6E" x="3534" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-74" x="4091" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-69" x="4480" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-6C" x="4759" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-63" x="5287" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-6F" x="5732" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-6E" x="6232" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-76" x="6789" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-65" x="7317" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-72" x="7762" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-67" x="8154" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-65" x="8655" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-6E" x="9099" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-63" x="9656" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-65" x="10100" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-3A" x="10545" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-7B" x="11101" y="0"></use></g><g transform="translate(0,44)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-6A" x="663" y="-213"></use><g transform="translate(1138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(2473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-2212" x="3557" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-3B1" x="4557" y="0"></use><g transform="translate(5198,0)"><g transform="translate(120,0)"><rect stroke="none" width="1548" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-2202" x="490" y="676"></use><g transform="translate(60,-686)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-2202" x="0" y="0"></use><g transform="translate(567,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-6A" x="663" y="-213"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-4A" x="6987" y="0"></use><g transform="translate(7787,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMATHI-3B8" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E232-MJMAIN-29" x="859" y="0"></use></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-224">\begin{align*} & \text{repeat until convergence:} \; \lbrace \newline \; &{{\theta }_{j}}:={{\theta }_{j}}-\alpha \frac{\partial }{\partial {{\theta }_{j}}}J\left( {\theta}  \right) \newline \rbrace \end{align*}</script></p><p>解出偏导得：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-57-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="60.323ex" height="13.083ex" viewBox="0 -3067.8 25972.3 5633" role="img" focusable="false" style="vertical-align: -5.958ex;"><defs><path stroke-width="1" id="E64-MJMAIN-72" d="M36 46H50Q89 46 97 60V68Q97 77 97 91T98 122T98 161T98 203Q98 234 98 269T98 328L97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 60 434T96 436Q112 437 131 438T160 441T171 442H174V373Q213 441 271 441H277Q322 441 343 419T364 373Q364 352 351 337T313 322Q288 322 276 338T263 372Q263 381 265 388T270 400T273 405Q271 407 250 401Q234 393 226 386Q179 341 179 207V154Q179 141 179 127T179 101T180 81T180 66V61Q181 59 183 57T188 54T193 51T200 49T207 48T216 47T225 47T235 46T245 46H276V0H267Q249 3 140 3Q37 3 28 0H20V46H36Z"></path><path stroke-width="1" id="E64-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E64-MJMAIN-70" d="M36 -148H50Q89 -148 97 -134V-126Q97 -119 97 -107T97 -77T98 -38T98 6T98 55T98 106Q98 140 98 177T98 243T98 296T97 335T97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 61 434T98 436Q115 437 135 438T165 441T176 442H179V416L180 390L188 397Q247 441 326 441Q407 441 464 377T522 216Q522 115 457 52T310 -11Q242 -11 190 33L182 40V-45V-101Q182 -128 184 -134T195 -145Q216 -148 244 -148H260V-194H252L228 -193Q205 -192 178 -192T140 -191Q37 -191 28 -194H20V-148H36ZM424 218Q424 292 390 347T305 402Q234 402 182 337V98Q222 26 294 26Q345 26 384 80T424 218Z"></path><path stroke-width="1" id="E64-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E64-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E64-MJMAIN-75" d="M383 58Q327 -10 256 -10H249Q124 -10 105 89Q104 96 103 226Q102 335 102 348T96 369Q86 385 36 385H25V408Q25 431 27 431L38 432Q48 433 67 434T105 436Q122 437 142 438T172 441T184 442H187V261Q188 77 190 64Q193 49 204 40Q224 26 264 26Q290 26 311 35T343 58T363 90T375 120T379 144Q379 145 379 161T380 201T380 248V315Q380 361 370 372T320 385H302V431Q304 431 378 436T457 442H464V264Q464 84 465 81Q468 61 479 55T524 46H542V0Q540 0 467 -5T390 -11H383V58Z"></path><path stroke-width="1" id="E64-MJMAIN-6E" d="M41 46H55Q94 46 102 60V68Q102 77 102 91T102 122T103 161T103 203Q103 234 103 269T102 328V351Q99 370 88 376T43 385H25V408Q25 431 27 431L37 432Q47 433 65 434T102 436Q119 437 138 438T167 441T178 442H181V402Q181 364 182 364T187 369T199 384T218 402T247 421T285 437Q305 442 336 442Q450 438 463 329Q464 322 464 190V104Q464 66 466 59T477 49Q498 46 526 46H542V0H534L510 1Q487 2 460 2T422 3Q319 3 310 0H302V46H318Q379 46 379 62Q380 64 380 200Q379 335 378 343Q372 371 358 385T334 402T308 404Q263 404 229 370Q202 343 195 315T187 232V168V108Q187 78 188 68T191 55T200 49Q221 46 249 46H265V0H257L234 1Q210 2 183 2T145 3Q42 3 33 0H25V46H41Z"></path><path stroke-width="1" id="E64-MJMAIN-69" d="M69 609Q69 637 87 653T131 669Q154 667 171 652T188 609Q188 579 171 564T129 549Q104 549 87 564T69 609ZM247 0Q232 3 143 3Q132 3 106 3T56 1L34 0H26V46H42Q70 46 91 49Q100 53 102 60T104 102V205V293Q104 345 102 359T88 378Q74 385 41 385H30V408Q30 431 32 431L42 432Q52 433 70 434T106 436Q123 437 142 438T171 441T182 442H185V62Q190 52 197 50T232 46H255V0H247Z"></path><path stroke-width="1" id="E64-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E64-MJMAIN-63" d="M370 305T349 305T313 320T297 358Q297 381 312 396Q317 401 317 402T307 404Q281 408 258 408Q209 408 178 376Q131 329 131 219Q131 137 162 90Q203 29 272 29Q313 29 338 55T374 117Q376 125 379 127T395 129H409Q415 123 415 120Q415 116 411 104T395 71T366 33T318 2T249 -11Q163 -11 99 53T34 214Q34 318 99 383T250 448T370 421T404 357Q404 334 387 320Z"></path><path stroke-width="1" id="E64-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E64-MJMAIN-76" d="M338 431Q344 429 422 429Q479 429 503 431H508V385H497Q439 381 423 345Q421 341 356 172T288 -2Q283 -11 263 -11Q244 -11 239 -2Q99 359 98 364Q93 378 82 381T43 385H19V431H25L33 430Q41 430 53 430T79 430T104 429T122 428Q217 428 232 431H240V385H226Q187 384 184 370Q184 366 235 234L286 102L377 341V349Q377 363 367 372T349 383T335 385H331V431H338Z"></path><path stroke-width="1" id="E64-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E64-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E64-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E64-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E64-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E64-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E64-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E64-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E64-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E64-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E64-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E64-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E64-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E64-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E64-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E64-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E64-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E64-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E64-MJMAIN-66" d="M273 0Q255 3 146 3Q43 3 34 0H26V46H42Q70 46 91 49Q99 52 103 60Q104 62 104 224V385H33V431H104V497L105 564L107 574Q126 639 171 668T266 704Q267 704 275 704T289 705Q330 702 351 679T372 627Q372 604 358 590T321 576T284 590T270 627Q270 647 288 667H284Q280 668 273 668Q245 668 223 647T189 592Q183 572 182 497V431H293V385H185V225Q185 63 186 61T189 57T194 54T199 51T206 49T213 48T222 47T231 47T241 46T251 46H282V0H273Z"></path><path stroke-width="1" id="E64-MJMAIN-6A" d="M98 609Q98 637 116 653T160 669Q183 667 200 652T217 609Q217 579 200 564T158 549Q133 549 116 564T98 609ZM28 -163Q58 -168 64 -168Q124 -168 135 -77Q137 -65 137 141T136 353Q132 371 120 377T72 385H52V408Q52 431 54 431L58 432Q62 432 70 432T87 433T108 434T133 436Q151 437 171 438T202 441T214 442H218V184Q217 -36 217 -59T211 -98Q195 -145 153 -175T58 -205Q9 -205 -23 -179T-55 -117Q-55 -94 -40 -79T-2 -64T36 -79T52 -118Q52 -143 28 -163Z"></path><path stroke-width="1" id="E64-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E64-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E64-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E64-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-7D" x="0" y="-2232"></use></g><g transform="translate(485,0)"><g transform="translate(0,2182)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-72"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-65" x="392" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-70" x="837" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-65" x="1393" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-61" x="1838" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-74" x="2338" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-75" x="2978" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-6E" x="3534" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-74" x="4091" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-69" x="4480" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-6C" x="4759" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-63" x="5287" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-6F" x="5732" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-6E" x="6232" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-76" x="6789" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-65" x="7317" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-72" x="7762" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-67" x="8154" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-65" x="8655" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-6E" x="9099" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-63" x="9656" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-65" x="10100" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-3A" x="10545" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-7B" x="11101" y="0"></use></g><g transform="translate(0,66)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-6A" x="663" y="-213"></use><g transform="translate(1138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(2473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-2212" x="3557" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-3B1" x="4557" y="0"></use><g transform="translate(5198,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(6603,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-28" x="8048" y="0"></use><g transform="translate(8437,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-28" x="9446" y="0"></use><g transform="translate(9835,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-29" x="11303" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-2212" x="11914" y="0"></use><g transform="translate(12915,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-29" x="14310" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-22C5" x="14922" y="0"></use><g transform="translate(15422,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMATHI-6A" x="809" y="-430"></use></g></g></g><g transform="translate(19653,0)"><g transform="translate(0,66)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-66"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-6F" x="306" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-72" x="807" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-6A" x="1449" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-3A" x="2006" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-3D" x="2284" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-30" x="3313" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-2C" x="3813" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-31" x="4092" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-2E" x="4592" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-2E" x="4871" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-2E" x="5149" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E64-MJMAIN-6E" x="5428" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-57">\begin{align*}& \text{repeat until convergence:} \; \lbrace \newline \; & \theta_j := \theta_j - \alpha \frac{1}{m} \sum\limits_{i=1}^{m} (h_\theta(x^{(i)}) - y^{(i)}) \cdot x_j^{(i)} \; & \text{for j := 0,1...n}\newline \rbrace\end{align*}</script></p><p>注意，虽然形式上梯度下降算法同线性回归一样，但其中的假设函不同，即<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-225-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="16.022ex" height="3.044ex" viewBox="0 -906.7 6898.4 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E233-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E233-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E233-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E233-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E233-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E233-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E233-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E233-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E233-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E233-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMAIN-3D" x="2637" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-67" x="3694" y="0"></use><g transform="translate(4341,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-54" x="663" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJMATHI-78" x="1526" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E233-MJSZ1-29" x="2098" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-225">h_\theta(x) = g\left(\theta^{T}x \right)</script>，不过求导后的结果也相同。</p><p>向量化实现：<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-226-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="26.233ex" height="3.161ex" viewBox="0 -906.7 11294.5 1361" role="img" focusable="false" style="vertical-align: -1.055ex;"><defs><path stroke-width="1" id="E234-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E234-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E234-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E234-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E234-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E234-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E234-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E234-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E234-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E234-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E234-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E234-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-3B8" x="0" y="0"></use><g transform="translate(747,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMAIN-3D" x="278" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-3B8" x="2082" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMAIN-2212" x="2773" y="0"></use><g transform="translate(3552,0)"><g transform="translate(342,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-3B1" x="203" y="583"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(4755,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-54" x="1215" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMAIN-28" x="6213" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-67" x="6603" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMAIN-28" x="7083" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-58" x="7473" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-3B8" x="8325" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMAIN-29" x="8795" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMAIN-2212" x="9406" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMATHI-79" x="10407" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E234-MJMAIN-29" x="10905" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-226">\theta := \theta - \frac{\alpha}{m} X^{T} (g(X \theta ) - y)</script></p><p>&nbsp;</p><p><strong>对数损失函数求导的推导过程：</strong></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-227-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="61.184ex" height="6.78ex" viewBox="0 -1660.6 26342.9 2919" role="img" focusable="false" style="vertical-align: -2.923ex;"><defs><path stroke-width="1" id="E235-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E235-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E235-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E235-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E235-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E235-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E235-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E235-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E235-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E235-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E235-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E235-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E235-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E235-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E235-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E235-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E235-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E235-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E235-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-3D" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-2212" x="3216" y="0"></use><g transform="translate(3994,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(5142,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-6D" x="582" y="1627"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-5B" x="1444" y="0"></use><g transform="translate(1723,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(3284,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="4563" y="0"></use><g transform="translate(4953,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="5961" y="0"></use><g transform="translate(6351,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="7819" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="8208" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-2B" x="8820" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="9821" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-31" x="10210" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-2212" x="10933" y="0"></use><g transform="translate(11933,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="13328" y="0"></use><g transform="translate(13884,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-67" x="779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="15164" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-31" x="15553" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-2212" x="16276" y="0"></use><g transform="translate(17277,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="18285" y="0"></use><g transform="translate(18675,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="20143" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-29" x="20532" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E235-MJMAIN-5D" x="20922" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-227">J(\theta) = - \frac{1}{m} \displaystyle \sum_{i=1}^m [y^{(i)}\log (h_\theta (x^{(i)})) + (1 - y^{(i)})\log (1 - h_\theta(x^{(i)}))]</script></p><p>令 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-228-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="54.245ex" height="3.161ex" viewBox="0 -956.9 23355.4 1361" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E236-MJMATHI-66" d="M118 -162Q120 -162 124 -164T135 -167T147 -168Q160 -168 171 -155T187 -126Q197 -99 221 27T267 267T289 382V385H242Q195 385 192 387Q188 390 188 397L195 425Q197 430 203 430T250 431Q298 431 298 432Q298 434 307 482T319 540Q356 705 465 705Q502 703 526 683T550 630Q550 594 529 578T487 561Q443 561 443 603Q443 622 454 636T478 657L487 662Q471 668 457 668Q445 668 434 658T419 630Q412 601 403 552T387 469T380 433Q380 431 435 431Q480 431 487 430T498 424Q499 420 496 407T491 391Q489 386 482 386T428 385H372L349 263Q301 15 282 -47Q255 -132 212 -173Q175 -205 139 -205Q107 -205 81 -186T55 -132Q55 -95 76 -78T118 -61Q162 -61 162 -103Q162 -122 151 -136T127 -157L118 -162Z"></path><path stroke-width="1" id="E236-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E236-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E236-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E236-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E236-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E236-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E236-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E236-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E236-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E236-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E236-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E236-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E236-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E236-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E236-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E236-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-66" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-28" x="550" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-3B8" x="940" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-29" x="1409" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-3D" x="2076" y="0"></use><g transform="translate(3133,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(4694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(5974,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1633,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-29" x="4018" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-2B" x="10673" y="0"></use><g transform="translate(11673,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(15875,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(17155,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(3357,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E236-MJSZ1-29" x="5741" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-228">f(\theta) = {{y}^{(i)}}\log \left( {h_\theta}\left( {{x}^{(i)}} \right) \right)+\left( 1-{{y}^{(i)}} \right)\log \left( 1-{h_\theta}\left( {{x}^{(i)}} \right) \right)</script></p><p>将 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-229-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.616ex" height="4.095ex" viewBox="0 -956.9 13612.4 1763.1" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E237-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E237-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E237-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E237-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E237-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E237-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E237-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E237-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E237-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E237-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E237-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E237-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E237-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E237-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E237-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-28" x="1008" y="0"></use><g transform="translate(1397,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-29" x="2865" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-3D" x="3532" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-67" x="4589" y="0"></use><g transform="translate(5236,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-54" x="663" y="513"></use></g><g transform="translate(1526,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJSZ1-29" x="2993" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-3D" x="8966" y="0"></use><g transform="translate(9744,0)"><g transform="translate(397,0)"><rect stroke="none" width="3349" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-31" x="2118" y="572"></use><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E237-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-229">h_\theta(x^{(i)}) = g\left(\theta^{T}x^{(i)} \right)=\frac{1}{1+{{e}^{-{\theta^T}{{x}^{(i)}}}}} </script> 带入得</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-230-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="55.675ex" height="4.679ex" viewBox="0 -1208.2 23971.2 2014.4" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E238-MJMATHI-66" d="M118 -162Q120 -162 124 -164T135 -167T147 -168Q160 -168 171 -155T187 -126Q197 -99 221 27T267 267T289 382V385H242Q195 385 192 387Q188 390 188 397L195 425Q197 430 203 430T250 431Q298 431 298 432Q298 434 307 482T319 540Q356 705 465 705Q502 703 526 683T550 630Q550 594 529 578T487 561Q443 561 443 603Q443 622 454 636T478 657L487 662Q471 668 457 668Q445 668 434 658T419 630Q412 601 403 552T387 469T380 433Q380 431 435 431Q480 431 487 430T498 424Q499 420 496 407T491 391Q489 386 482 386T428 385H372L349 263Q301 15 282 -47Q255 -132 212 -173Q175 -205 139 -205Q107 -205 81 -186T55 -132Q55 -95 76 -78T118 -61Q162 -61 162 -103Q162 -122 151 -136T127 -157L118 -162Z"></path><path stroke-width="1" id="E238-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E238-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E238-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E238-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E238-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E238-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E238-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E238-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E238-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E238-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E238-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E238-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E238-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E238-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E238-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E238-MJSZ2-28" d="M180 96T180 250T205 541T266 770T353 944T444 1069T527 1150H555Q561 1144 561 1141Q561 1137 545 1120T504 1072T447 995T386 878T330 721T288 513T272 251Q272 133 280 56Q293 -87 326 -209T399 -405T475 -531T536 -609T561 -640Q561 -643 555 -649H527Q483 -612 443 -568T353 -443T266 -270T205 -41Z"></path><path stroke-width="1" id="E238-MJSZ2-29" d="M35 1138Q35 1150 51 1150H56H69Q113 1113 153 1069T243 944T330 771T391 541T416 250T391 -40T330 -270T243 -443T152 -568T69 -649H56Q43 -649 39 -647T35 -637Q65 -607 110 -548Q283 -316 316 56Q324 133 324 251Q324 368 316 445Q278 877 48 1123Q36 1137 35 1138Z"></path><path stroke-width="1" id="E238-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E238-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-66" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-28" x="550" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-3B8" x="940" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-29" x="1409" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-3D" x="2076" y="0"></use><g transform="translate(3133,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(4694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(5974,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJSZ2-28"></use><g transform="translate(597,0)"><g transform="translate(120,0)"><rect stroke="none" width="3349" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-31" x="2118" y="572"></use><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJSZ2-29" x="4187" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-2B" x="10980" y="0"></use><g transform="translate(11981,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(16183,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(17463,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-2212" x="1320" y="0"></use><g transform="translate(2098,0)"><g transform="translate(342,0)"><rect stroke="none" width="3349" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-31" x="2118" y="572"></use><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E238-MJSZ2-29" x="5910" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-230">f(\theta)={{y}^{(i)}}\log \left( \frac{1}{1+{{e}^{-{\theta^T}{{x}^{(i)}}}}} \right)+\left( 1-{{y}^{(i)}} \right)\log \left( 1-\frac{1}{1+{{e}^{-{\theta^T}{{x}^{(i)}}}}} \right)</script>
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-231-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="52.226ex" height="4.445ex" viewBox="0 -1208.2 22485.9 1913.9" role="img" focusable="false" style="vertical-align: -1.639ex;"><defs><path stroke-width="1" id="E239-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E239-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E239-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E239-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E239-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E239-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E239-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E239-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E239-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E239-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E239-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E239-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E239-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E239-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E239-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E239-MJSZ2-28" d="M180 96T180 250T205 541T266 770T353 944T444 1069T527 1150H555Q561 1144 561 1141Q561 1137 545 1120T504 1072T447 995T386 878T330 721T288 513T272 251Q272 133 280 56Q293 -87 326 -209T399 -405T475 -531T536 -609T561 -640Q561 -643 555 -649H527Q483 -612 443 -568T353 -443T266 -270T205 -41Z"></path><path stroke-width="1" id="E239-MJSZ2-29" d="M35 1138Q35 1150 51 1150H56H69Q113 1113 153 1069T243 944T330 771T391 541T416 250T391 -40T330 -270T243 -443T152 -568T69 -649H56Q43 -649 39 -647T35 -637Q65 -607 110 -548Q283 -316 316 56Q324 133 324 251Q324 368 316 445Q278 877 48 1123Q36 1137 35 1138Z"></path><path stroke-width="1" id="E239-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E239-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-3D" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-2212" x="1056" y="0"></use><g transform="translate(1834,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(3396,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(4675,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-2B" x="1320" y="0"></use><g transform="translate(2320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-2212" x="0" y="0"></use><g transform="translate(550,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-54" x="663" y="612"></use></g><g transform="translate(1305,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJSZ2-29" x="5230" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-2212" x="10726" y="0"></use><g transform="translate(11726,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(15928,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(17208,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-2B" x="1320" y="0"></use><g transform="translate(2320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-54" x="663" y="612"></use><g transform="translate(754,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E239-MJSZ2-29" x="4680" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-231">=-{{y}^{(i)}}\log \left( 1+{{e}^{-{\theta^T}{{x}^{(i)}}}} \right)-\left( 1-{{y}^{(i)}} \right)\log \left( 1+{{e}^{{\theta^T}{{x}^{(i)}}}} \right)</script></p><p>根据求偏导的性质，没有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-232-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2ex" height="2.694ex" viewBox="0 -806.1 861.2 1160" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E240-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E240-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E240-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E240-MJMATHI-6A" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-232">\theta_j</script> 的项都消去，则得：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-233-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.708ex" height="4.212ex" viewBox="0 -1107.7 7624.2 1813.3" role="img" focusable="false" style="vertical-align: -1.639ex;"><defs><path stroke-width="1" id="E241-MJMAIN-2202" d="M202 508Q179 508 169 520T158 547Q158 557 164 577T185 624T230 675T301 710L333 715H345Q378 715 384 714Q447 703 489 661T549 568T566 457Q566 362 519 240T402 53Q321 -22 223 -22Q123 -22 73 56Q42 102 42 148V159Q42 276 129 370T322 465Q383 465 414 434T455 367L458 378Q478 461 478 515Q478 603 437 639T344 676Q266 676 223 612Q264 606 264 572Q264 547 246 528T202 508ZM430 306Q430 372 401 400T333 428Q270 428 222 382Q197 354 183 323T150 221Q132 149 132 116Q132 21 232 21Q244 21 250 22Q327 35 374 112Q389 137 409 196T430 306Z"></path><path stroke-width="1" id="E241-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E241-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E241-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E241-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E241-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E241-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E241-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E241-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E241-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E241-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-6A" x="663" y="-213"></use></g></g></g><g transform="translate(1370,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-54" x="663" y="513"></use></g><g transform="translate(1526,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJSZ1-29" x="2993" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMAIN-3D" x="5100" y="0"></use><g transform="translate(6156,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E241-MJMATHI-6A" x="809" y="-430"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-233">\frac{\partial }{\partial {\theta_{j}}}\left( \theta^Tx^{(i)}  \right)=x^{(i)}_j</script></p><p>所以有：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-234-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="65.095ex" height="4.445ex" viewBox="0 -1208.2 28026.8 1913.9" role="img" focusable="false" style="vertical-align: -1.639ex;"><defs><path stroke-width="1" id="E242-MJMAIN-2202" d="M202 508Q179 508 169 520T158 547Q158 557 164 577T185 624T230 675T301 710L333 715H345Q378 715 384 714Q447 703 489 661T549 568T566 457Q566 362 519 240T402 53Q321 -22 223 -22Q123 -22 73 56Q42 102 42 148V159Q42 276 129 370T322 465Q383 465 414 434T455 367L458 378Q478 461 478 515Q478 603 437 639T344 676Q266 676 223 612Q264 606 264 572Q264 547 246 528T202 508ZM430 306Q430 372 401 400T333 428Q270 428 222 382Q197 354 183 323T150 221Q132 149 132 116Q132 21 232 21Q244 21 250 22Q327 35 374 112Q389 137 409 196T430 306Z"></path><path stroke-width="1" id="E242-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E242-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E242-MJMATHI-66" d="M118 -162Q120 -162 124 -164T135 -167T147 -168Q160 -168 171 -155T187 -126Q197 -99 221 27T267 267T289 382V385H242Q195 385 192 387Q188 390 188 397L195 425Q197 430 203 430T250 431Q298 431 298 432Q298 434 307 482T319 540Q356 705 465 705Q502 703 526 683T550 630Q550 594 529 578T487 561Q443 561 443 603Q443 622 454 636T478 657L487 662Q471 668 457 668Q445 668 434 658T419 630Q412 601 403 552T387 469T380 433Q380 431 435 431Q480 431 487 430T498 424Q499 420 496 407T491 391Q489 386 482 386T428 385H372L349 263Q301 15 282 -47Q255 -132 212 -173Q175 -205 139 -205Q107 -205 81 -186T55 -132Q55 -95 76 -78T118 -61Q162 -61 162 -103Q162 -122 151 -136T127 -157L118 -162Z"></path><path stroke-width="1" id="E242-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E242-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E242-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E242-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E242-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E242-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E242-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E242-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E242-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E242-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E242-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E242-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E242-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E242-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E242-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E242-MJSZ2-28" d="M180 96T180 250T205 541T266 770T353 944T444 1069T527 1150H555Q561 1144 561 1141Q561 1137 545 1120T504 1072T447 995T386 878T330 721T288 513T272 251Q272 133 280 56Q293 -87 326 -209T399 -405T475 -531T536 -609T561 -640Q561 -643 555 -649H527Q483 -612 443 -568T353 -443T266 -270T205 -41Z"></path><path stroke-width="1" id="E242-MJSZ2-29" d="M35 1138Q35 1150 51 1150H56H69Q113 1113 153 1069T243 944T330 771T391 541T416 250T391 -40T330 -270T243 -443T152 -568T69 -649H56Q43 -649 39 -647T35 -637Q65 -607 110 -548Q283 -316 316 56Q324 133 324 251Q324 368 316 445Q278 877 48 1123Q36 1137 35 1138Z"></path><path stroke-width="1" id="E242-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E242-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E242-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-6A" x="663" y="-213"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-66" x="1370" y="0"></use><g transform="translate(2087,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-3B8" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-29" x="859" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-3D" x="3613" y="0"></use><g transform="translate(4392,0)"><g transform="translate(397,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-6A" x="663" y="-213"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-5B" x="6040" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2212" x="6318" y="0"></use><g transform="translate(7097,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(8658,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(9938,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2B" x="1320" y="0"></use><g transform="translate(2320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2212" x="0" y="0"></use><g transform="translate(550,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-54" x="663" y="612"></use></g><g transform="translate(1305,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJSZ2-29" x="5230" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2212" x="15988" y="0"></use><g transform="translate(16989,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(21191,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-6C"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-6F" x="278" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-67" x="779" y="0"></use></g><g transform="translate(22470,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJSZ2-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-31" x="597" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-2B" x="1320" y="0"></use><g transform="translate(2320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-65" x="0" y="0"></use><g transform="translate(466,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-54" x="663" y="612"></use><g transform="translate(754,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJSZ2-29" x="4680" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E242-MJMAIN-5D" x="27748" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-234">\frac{\partial }{\partial {\theta_{j}}}f\left( \theta  \right)=\frac{\partial }{\partial {\theta_{j}}}[-{{y}^{(i)}}\log \left( 1+{{e}^{-{\theta^{T}}{{x}^{(i)}}}} \right)-\left( 1-{{y}^{(i)}} \right)\log \left( 1+{{e}^{{\theta^{T}}{{x}^{(i)}}}} \right)]</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-235-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="37.77ex" height="5.612ex" viewBox="0 -1610.3 16261.9 2416.4" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E243-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E243-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E243-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E243-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E243-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E243-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E243-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E243-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E243-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E243-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E243-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E243-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E243-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E243-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E243-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-3D" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-2212" x="1056" y="0"></use><g transform="translate(1834,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(3229,0)"><g transform="translate(120,0)"><rect stroke="none" width="4033" height="60" x="0" y="220"></rect><g transform="translate(60,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-2212" x="0" y="0"></use><g transform="translate(550,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-6A" x="809" y="-430"></use></g><g transform="translate(1588,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-54" x="469" y="362"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(401,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-2212" x="7725" y="0"></use><g transform="translate(8726,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(12761,0)"><g transform="translate(286,0)"><rect stroke="none" width="3093" height="60" x="0" y="220"></rect><g transform="translate(60,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-6A" x="809" y="-430"></use><g transform="translate(1037,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(126,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E243-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-235">=-{{y}^{(i)}}\frac{-x_{j}^{(i)}{{e}^{-{\theta^{T}}{{x}^{(i)}}}}}{1+{{e}^{-{\theta^{T}}{{x}^{(i)}}}}}-\left( 1-{{y}^{(i)}} \right)\frac{x_j^{(i)}{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}</script>
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-236-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="33.469ex" height="5.612ex" viewBox="0 -1610.3 14410.2 2416.4" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E244-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E244-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E244-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E244-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E244-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E244-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E244-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E244-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E244-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E244-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E244-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E244-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E244-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E244-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E244-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(2451,0)"><g transform="translate(120,0)"><rect stroke="none" width="2960" height="60" x="0" y="220"></rect><g transform="translate(961,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-6A" x="809" y="-430"></use></g><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-2212" x="5873" y="0"></use><g transform="translate(6874,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJSZ1-28"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-31" x="458" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-2212" x="1181" y="0"></use><g transform="translate(2181,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJSZ1-29" x="3576" y="-1"></use></g><g transform="translate(10909,0)"><g transform="translate(286,0)"><rect stroke="none" width="3093" height="60" x="0" y="220"></rect><g transform="translate(60,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-6A" x="809" y="-430"></use><g transform="translate(1037,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(126,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E244-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-236">={{y}^{(i)}}\frac{x_j^{(i)}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}-\left( 1-{{y}^{(i)}} \right)\frac{x_j^{(i)}{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}</script> 
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-237-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="26.652ex" height="5.612ex" viewBox="0 -1610.3 11475.3 2416.4" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E245-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E245-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E245-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E245-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E245-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E245-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E245-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E245-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E245-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E245-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E245-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E245-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E245-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><g transform="translate(120,0)"><rect stroke="none" width="10179" height="60" x="0" y="220"></rect><g transform="translate(60,721)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-79" x="0" y="0"></use><g transform="translate(353,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-29" x="735" y="0"></use></g><g transform="translate(986,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-6A" x="809" y="-430"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-2212" x="2862" y="0"></use><g transform="translate(2574,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-6A" x="809" y="-430"></use></g><g transform="translate(3612,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-2B" x="7846" y="0"></use><g transform="translate(6098,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-79" x="0" y="0"></use><g transform="translate(353,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-29" x="735" y="0"></use></g></g><g transform="translate(7085,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-78" x="0" y="0"></use><g transform="translate(404,369)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-29" x="735" y="0"></use></g><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-6A" x="809" y="-430"></use></g><g transform="translate(8122,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(3669,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E245-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-237">={\frac{{{y}^{(i)}}x_j^{(i)}-x_j^{(i)}{{e}^{{\theta^T}{{x}^{(i)}}}}+{{y}^{(i)}}x_j^{(i)}{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}}</script>
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-238-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="23.324ex" height="5.963ex" viewBox="0 -1761.1 10042.2 2567.2" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E246-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E246-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E246-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E246-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E246-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E246-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E246-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E246-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E246-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E246-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E246-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E246-MJSZ2-28" d="M180 96T180 250T205 541T266 770T353 944T444 1069T527 1150H555Q561 1144 561 1141Q561 1137 545 1120T504 1072T447 995T386 878T330 721T288 513T272 251Q272 133 280 56Q293 -87 326 -209T399 -405T475 -531T536 -609T561 -640Q561 -643 555 -649H527Q483 -612 443 -568T353 -443T266 -270T205 -41Z"></path><path stroke-width="1" id="E246-MJSZ2-29" d="M35 1138Q35 1150 51 1150H56H69Q113 1113 153 1069T243 944T330 771T391 541T416 250T391 -40T330 -270T243 -443T152 -568T69 -649H56Q43 -649 39 -647T35 -637Q65 -607 110 -548Q283 -316 316 56Q324 133 324 251Q324 368 316 445Q278 877 48 1123Q36 1137 35 1138Z"></path><path stroke-width="1" id="E246-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E246-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><g transform="translate(120,0)"><rect stroke="none" width="7278" height="60" x="0" y="220"></rect><g transform="translate(60,864)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-79" x="0" y="0"></use><g transform="translate(353,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-29" x="735" y="0"></use></g><g transform="translate(986,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJSZ2-28"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-31" x="597" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-2B" x="1098" y="0"></use><g transform="translate(1326,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-29" x="735" y="0"></use></g></g></g></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJSZ2-29" x="4614" y="-1"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-2212" x="6606" y="0"></use><g transform="translate(5222,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g><g transform="translate(2218,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g><g transform="translate(7518,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E246-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-238">={\frac{{{y}^{(i)}}\left( 1\text{+}{{e}^{{\theta^T}{{x}^{(i)}}}} \right)-{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}}x_j^{(i)}}</script>
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-239-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="21.185ex" height="4.912ex" viewBox="0 -1308.7 9121.1 2114.9" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E247-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E247-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E247-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E247-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E247-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E247-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E247-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E247-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E247-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E247-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E247-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E247-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E247-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-2212" x="2006" y="0"></use><g transform="translate(2785,0)"><g transform="translate(342,0)"><rect stroke="none" width="2960" height="60" x="0" y="220"></rect><g transform="translate(512,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,256)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-54" x="469" y="362"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,181)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-29" x="735" y="0"></use></g></g></g></g><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-54" x="469" y="319"></use><g transform="translate(637,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-29" x="6207" y="0"></use><g transform="translate(6597,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E247-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-239">={({{y}^{(i)}}-\frac{{{e}^{{\theta^T}{{x}^{(i)}}}}}{1+{{e}^{{\theta^T}{{x}^{(i)}}}}})x_j^{(i)}}</script>
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-240-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="22.089ex" height="4.445ex" viewBox="0 -1107.7 9510.4 1913.9" role="img" focusable="false" style="vertical-align: -1.872ex;"><defs><path stroke-width="1" id="E248-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E248-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E248-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E248-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E248-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E248-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E248-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E248-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E248-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E248-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E248-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E248-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E248-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-2212" x="2006" y="0"></use><g transform="translate(2785,0)"><g transform="translate(342,0)"><rect stroke="none" width="3349" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-31" x="2118" y="572"></use><g transform="translate(60,-664)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-31" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-2B" x="500" y="0"></use><g transform="translate(904,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-65" x="0" y="0"></use><g transform="translate(329,204)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-2212" x="0" y="0"></use><g transform="translate(389,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-54" x="469" y="319"></use></g><g transform="translate(1026,0)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-78" x="0" y="0"></use><g transform="translate(286,179)"><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-29" x="735" y="0"></use></g></g></g></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-29" x="6596" y="0"></use><g transform="translate(6986,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E248-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-240">={({{y}^{(i)}}-\frac{1}{1+{{e}^{-{\theta^T}{{x}^{(i)}}}}})x_j^{(i)}}</script>
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-241-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="22.727ex" height="3.745ex" viewBox="0 -1107.7 9785.1 1612.3" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E249-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E249-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E249-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E249-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E249-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E249-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E249-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E249-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E249-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E249-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E249-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E249-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMAIN-2212" x="2075" y="0"></use><g transform="translate(3076,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(4251,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJSZ1-29" x="6636" y="-1"></use><g transform="translate(7261,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E249-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-241">={\left({{y}^{(i)}}-{h_\theta}\left( {{x}^{(i)}} \right)\right)x_j^{(i)}}</script>
+<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-242-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="22.727ex" height="3.745ex" viewBox="0 -1107.7 9785.1 1612.3" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E250-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E250-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E250-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E250-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E250-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E250-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E250-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E250-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E250-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E250-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E250-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E250-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMAIN-3D" x="0" y="0"></use><g transform="translate(1056,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-3B8" x="815" y="-219"></use></g><g transform="translate(1633,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJSZ1-29" x="1926" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMAIN-2212" x="4240" y="0"></use><g transform="translate(5241,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJSZ1-29" x="6636" y="-1"></use><g transform="translate(7261,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E250-MJMATHI-6A" x="809" y="-430"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-242">={\left({h_\theta}\left( {{x}^{(i)}} \right)-{{y}^{(i)}}\right)x_j^{(i)}}</script></p><p>则可得对数损失函数的导数：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-243-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="54.512ex" height="5.846ex" viewBox="0 -1459.5 23470.3 2517" role="img" focusable="false" style="vertical-align: -2.456ex;"><defs><path stroke-width="1" id="E251-MJMAIN-2202" d="M202 508Q179 508 169 520T158 547Q158 557 164 577T185 624T230 675T301 710L333 715H345Q378 715 384 714Q447 703 489 661T549 568T566 457Q566 362 519 240T402 53Q321 -22 223 -22Q123 -22 73 56Q42 102 42 148V159Q42 276 129 370T322 465Q383 465 414 434T455 367L458 378Q478 461 478 515Q478 603 437 639T344 676Q266 676 223 612Q264 606 264 572Q264 547 246 528T202 508ZM430 306Q430 372 401 400T333 428Q270 428 222 382Q197 354 183 323T150 221Q132 149 132 116Q132 21 232 21Q244 21 250 22Q327 35 374 112Q389 137 409 196T430 306Z"></path><path stroke-width="1" id="E251-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E251-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E251-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E251-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E251-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E251-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E251-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E251-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E251-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E251-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E251-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E251-MJMATHI-66" d="M118 -162Q120 -162 124 -164T135 -167T147 -168Q160 -168 171 -155T187 -126Q197 -99 221 27T267 267T289 382V385H242Q195 385 192 387Q188 390 188 397L195 425Q197 430 203 430T250 431Q298 431 298 432Q298 434 307 482T319 540Q356 705 465 705Q502 703 526 683T550 630Q550 594 529 578T487 561Q443 561 443 603Q443 622 454 636T478 657L487 662Q471 668 457 668Q445 668 434 658T419 630Q412 601 403 552T387 469T380 433Q380 431 435 431Q480 431 487 430T498 424Q499 420 496 407T491 391Q489 386 482 386T428 385H372L349 263Q301 15 282 -47Q255 -132 212 -173Q175 -205 139 -205Q107 -205 81 -186T55 -132Q55 -95 76 -78T118 -61Q162 -61 162 -103Q162 -122 151 -136T127 -157L118 -162Z"></path><path stroke-width="1" id="E251-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E251-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E251-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E251-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-6A" x="663" y="-213"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-4A" x="1370" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-28" x="2003" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-3B8" x="2393" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-29" x="2862" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-3D" x="3530" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-2212" x="4586" y="0"></use><g transform="translate(5364,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(6512,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJSZ1-2211" x="46" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-6D" x="372" y="1344"></use></g><g transform="translate(7828,0)"><g transform="translate(120,0)"><rect stroke="none" width="1130" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-2202" x="515" y="594"></use><g transform="translate(60,-411)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-2202" x="0" y="0"></use><g transform="translate(401,0)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.5)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-6A" x="663" y="-213"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-66" x="1370" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-28" x="1920" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-3B8" x="2310" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-29" x="2779" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-3D" x="11275" y="0"></use><g transform="translate(12053,0)"><g transform="translate(397,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(13479,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJSZ1-2211" x="46" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-6D" x="372" y="1344"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-28" x="14627" y="0"></use><g transform="translate(15017,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-28" x="16025" y="0"></use><g transform="translate(16415,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-29" x="17882" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-2212" x="18494" y="0"></use><g transform="translate(19495,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-29" x="20890" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-22C5" x="21501" y="0"></use><g transform="translate(22002,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E251-MJMATHI-6A" x="809" y="-430"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-243">\frac{\partial }{\partial {\theta_{j}}}J(\theta) = -\frac{1}{m}\sum\limits_{i=1}^{m}{\frac{\partial }{\partial {\theta_{j}}}f(\theta)}=\frac{1}{m} \sum\limits_{i=1}^{m} (h_\theta(x^{(i)}) - y^{(i)}) \cdot x_j^{(i)} </script></p><h2><a name='header-n198' class='md-header-anchor '></a>6.6 进阶优化(Advanced Optimization)</h2><p>运行梯度下降算法，其能最小化损失函数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-246-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E254-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E254-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E254-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E254-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-246">J(\theta)</script> 并得出 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E22-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E22-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-16">\theta</script> 的最优值，在使用梯度下降算法时，如果不需要观察损失函数的收敛情况，则直接计算 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-246-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E254-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E254-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E254-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E254-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-246">J(\theta)</script> 的导数项即可，而不需要计算 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-246-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.371ex" height="2.577ex" viewBox="0 -806.1 1882 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E254-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E254-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E254-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E254-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E254-MJMAIN-29" x="1492" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-246">J(\theta)</script> 值。</p><p>我们编写代码给出损失函数及其偏导数然后传入梯度下降算法中，接下来算法则会为我们最小化损失函数给出参数的最优解。这类算法被称为<strong>最优化算法(Optimization Algorithms)</strong>，梯度下降算法不是唯一的最小化算法<sup><a href='#dfref-footnote-1' name='ref-footnote-1'>1</a></sup>。</p><p>一些最优化算法：</p><ul><li><p>梯度下降法(Gradient Descent)</p></li><li><p>共轭梯度算法(Conjugate gradient)</p></li><li><p>牛顿法和拟牛顿法(Newton&#39;s method &amp; Quasi-Newton Methods)</p><ul><li>DFP算法</li><li>局部优化法(BFGS)</li><li>有限内存局部优化法(L-BFGS)</li></ul></li><li><p>拉格朗日乘数法(Lagrange multiplier)</p></li></ul><p>比较梯度下降算法：一些最优化算法虽然会更为复杂，难以调试，自行实现又困难重重，开源库又效率也不一，哎，做个调包侠还得碰运气。不过这些算法通常效率更高，并无需选择学习速率 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-86-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.488ex" height="1.41ex" viewBox="0 -504.6 640.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E94-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E94-MJMATHI-3B1" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-86">\alpha</script>（少一个参数少一份痛苦啊！）。</p><p>Octave/Matlab 中对这类高级算法做了封装，易于调用。</p><p>&nbsp;</p><p>假设有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-247-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="28.332ex" height="2.811ex" viewBox="0 -906.7 12198.5 1210.2" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E255-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E255-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E255-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E255-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E255-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E255-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E255-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E255-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E255-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E255-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-3D" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-28" x="3216" y="0"></use><g transform="translate(3605,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-31" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-2212" x="4751" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-35" x="5751" y="0"></use><g transform="translate(6252,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-32" x="550" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-2B" x="7318" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-28" x="8318" y="0"></use><g transform="translate(8708,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-32" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-2212" x="9853" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-35" x="10854" y="0"></use><g transform="translate(11355,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E255-MJMAIN-32" x="550" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-247">J(\theta) = (\theta_1-5)^2 + (\theta_2-5)^2</script>，要求参数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-248-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.53ex" height="5.846ex" viewBox="0 -1509.8 4103 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E256-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E256-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E256-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E256-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E256-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E256-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E256-MJSZ3-5B" d="M247 -949V1450H516V1388H309V-887H516V-949H247Z"></path><path stroke-width="1" id="E256-MJSZ3-5D" d="M11 1388V1450H280V-949H11V-887H218V1388H11Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E256-MJMATHI-3B8" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E256-MJMAIN-3D" x="747" y="0"></use><g transform="translate(1803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E256-MJSZ3-5B"></use><g transform="translate(695,0)"><g transform="translate(-15,0)"><g transform="translate(0,650)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E256-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E256-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(0,-750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E256-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E256-MJMAIN-32" x="663" y="-213"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E256-MJSZ3-5D" x="1770" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-248">\theta=\begin{bmatrix} \theta_1\\\theta_2\end{bmatrix}</script>的最优值。</p><p>下面为 Octave/Matlab 求解最优化问题的代码实例：</p><ol start='' ><li>创建一个函数以返回损失函数及其偏导数：</li></ol><pre class="md-fences md-end-block md-fences-with-lineno" lang="matlab"> <div class="CodeMirror cm-s-inner CodeMirror-wrap"><div style="overflow: hidden; position: relative; width: 3px; height: 0px; top: 0px; left: 39px;"></div><div class="CodeMirror-scrollbar-filler" cm-not-content="true"></div><div class="CodeMirror-gutter-filler" cm-not-content="true"></div><div class="CodeMirror-scroll" tabindex="-1"><div class="CodeMirror-sizer" style="margin-left: 35px; margin-bottom: 0px; border-right-width: 30px; padding-right: 0px; padding-bottom: 0px;"><div style="position: relative; top: 0px;"><div class="CodeMirror-lines" role="presentation"><div role="presentation" style="position: relative; outline: none;"><div class="CodeMirror-measure"><pre><span>xxxxxxxxxx</span></pre><div class="CodeMirror-linenumber CodeMirror-gutter-elt"><div>10</div></div></div><div class="CodeMirror-measure"></div><div style="position: relative; z-index: 1;"></div><div class="CodeMirror-code" role="presentation"><div class="CodeMirror-activeline" style="position: relative;"><div class="CodeMirror-activeline-background CodeMirror-linebackground"></div><div class="CodeMirror-gutter-background CodeMirror-activeline-gutter" style="left: -35px; width: 35px;"></div><div class="CodeMirror-gutter-wrapper CodeMirror-activeline-gutter" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 26px;">1</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span class="cm-builtin">function</span> [<span class="cm-variable">jVal</span>, <span class="cm-variable">gradient</span>] = <span class="cm-variable">costFunction</span>(<span class="cm-variable">theta</span>)</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">2</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-comment">% code to compute J(theta)</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">3</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-variable">jVal</span>=(<span class="cm-variable">theta</span>(<span class="cm-number">1</span>)<span class="cm-number">-5</span>)<span class="cm-operator">^</span><span class="cm-number">2</span><span class="cm-operator">+</span>(<span class="cm-variable">theta</span>(<span class="cm-number">2</span>)<span class="cm-number">-5</span>)<span class="cm-operator">^</span><span class="cm-number">2</span>;</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">4</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">5</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-comment">% code to compute derivative of J(theta)</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">6</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-variable">gradient</span>=<span class="cm-builtin">zeros</span>(<span class="cm-number">2</span>,<span class="cm-number">1</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">7</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">8</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-variable">gradient</span>(<span class="cm-number">1</span>)=<span class="cm-number">2</span><span class="cm-operator">*</span>(<span class="cm-variable">theta</span>(<span class="cm-number">1</span>)<span class="cm-number">-5</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">9</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp;<span class="cm-variable">gradient</span>(<span class="cm-number">2</span>)=<span class="cm-number">2</span><span class="cm-operator">*</span>(<span class="cm-variable">theta</span>(<span class="cm-number">2</span>)<span class="cm-number">-5</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 26px;">10</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span class="cm-keyword">end</span></span></pre></div></div></div></div></div></div><div style="position: absolute; height: 30px; width: 1px; border-bottom: 0px solid transparent; top: 224px;"></div><div class="CodeMirror-gutters" style="height: 254px;"><div class="CodeMirror-gutter CodeMirror-linenumbers" style="width: 34px;"></div></div></div></div></pre><ol start='2' ><li>将 <code>costFunction</code> 函数及所需参数传入最优化函数 <code>fminunc</code>，以求解最优化问题：</li></ol><pre class="md-fences md-end-block md-fences-with-lineno" lang="matlab"> <div class="CodeMirror cm-s-inner CodeMirror-wrap"><div style="overflow: hidden; position: relative; width: 3px; height: 0px; top: 0px; left: 31px;"></div><div class="CodeMirror-scrollbar-filler" cm-not-content="true"></div><div class="CodeMirror-gutter-filler" cm-not-content="true"></div><div class="CodeMirror-scroll" tabindex="-1"><div class="CodeMirror-sizer" style="margin-left: 27px; margin-bottom: 0px; border-right-width: 30px; padding-right: 0px; padding-bottom: 0px;"><div style="position: relative; top: 0px;"><div class="CodeMirror-lines" role="presentation"><div role="presentation" style="position: relative; outline: none;"><div class="CodeMirror-measure"><pre><span>xxxxxxxxxx</span></pre><div class="CodeMirror-linenumber CodeMirror-gutter-elt"><div>3</div></div></div><div class="CodeMirror-measure"></div><div style="position: relative; z-index: 1;"></div><div class="CodeMirror-code" role="presentation"><div class="CodeMirror-activeline" style="position: relative;"><div class="CodeMirror-activeline-background CodeMirror-linebackground"></div><div class="CodeMirror-gutter-background CodeMirror-activeline-gutter" style="left: -27px; width: 27px;"></div><div class="CodeMirror-gutter-wrapper CodeMirror-activeline-gutter" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 18px;">1</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span class="cm-variable">options</span> = <span class="cm-variable">optimset</span>(<span class="cm-string">'GradObj'</span>, <span class="cm-string">'on'</span>, <span class="cm-string">'MaxIter'</span>, <span class="cm-number">100</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">2</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span class="cm-variable">initialTheta</span> = <span class="cm-builtin">zeros</span>(<span class="cm-number">2</span>,<span class="cm-number">1</span>);</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 18px;">3</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; [<span class="cm-variable">optTheta</span>, <span class="cm-variable">functionVal</span>, <span class="cm-variable">exitFlag</span>] = <span class="cm-variable">fminunc</span>(<span class="cm-operator">@</span><span class="cm-variable">costFunction</span>, <span class="cm-variable">initialTheta</span>, <span class="cm-variable">options</span>);</span></pre></div></div></div></div></div></div><div style="position: absolute; height: 30px; width: 1px; border-bottom: 0px solid transparent; top: 90px;"></div><div class="CodeMirror-gutters" style="height: 120px;"><div class="CodeMirror-gutter CodeMirror-linenumbers" style="width: 26px;"></div></div></div></div></pre><blockquote><p><code>&#39;GradObj&#39;, &#39;on&#39;</code>: 启用梯度目标参数（则需要将梯度传入算法）</p><p><code>&#39;MaxIter&#39;, 100</code>: 最大迭代次数为 100 次</p><p><code>@xxx</code>: Octave/Matlab 中的函数指针</p><p><code>optTheta</code>: 最优化得到的参数向量</p><p><code>functionVal</code>: 引用函数最后一次的返回值</p><p><code>exitFlag</code>: 标记损失函数是否收敛</p></blockquote><p>注：Octave/Matlab 中可以使用 <code>help fminunc</code> 命令随时查看函数的帮助文档。</p><ol start='3' ><li>返回结果</li></ol><pre class="md-fences md-end-block md-fences-with-lineno" lang=""> <div class="CodeMirror cm-s-inner CodeMirror-wrap"><div style="overflow: hidden; position: relative; width: 3px; height: 0px; top: 0px; left: 31px;"></div><div class="CodeMirror-scrollbar-filler" cm-not-content="true"></div><div class="CodeMirror-gutter-filler" cm-not-content="true"></div><div class="CodeMirror-scroll" tabindex="-1"><div class="CodeMirror-sizer" style="margin-left: 27px; margin-bottom: 0px; border-right-width: 30px; padding-right: 0px; padding-bottom: 0px;"><div style="position: relative; top: 0px;"><div class="CodeMirror-lines" role="presentation"><div role="presentation" style="position: relative; outline: none;"><div class="CodeMirror-measure"><pre><span>xxxxxxxxxx</span></pre><div class="CodeMirror-linenumber CodeMirror-gutter-elt"><div>8</div></div></div><div class="CodeMirror-measure"></div><div style="position: relative; z-index: 1;"></div><div class="CodeMirror-code" role="presentation"><div class="CodeMirror-activeline" style="position: relative;"><div class="CodeMirror-activeline-background CodeMirror-linebackground"></div><div class="CodeMirror-gutter-background CodeMirror-activeline-gutter" style="left: -27px; width: 27px;"></div><div class="CodeMirror-gutter-wrapper CodeMirror-activeline-gutter" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 18px;">1</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">optTheta =</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">2</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">3</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 5</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">4</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 5</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">5</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">6</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">functionVal = 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 18px;">7</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -27px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 18px;">8</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">exitFlag = 1</span></pre></div></div></div></div></div></div><div style="position: absolute; height: 30px; width: 1px; border-bottom: 0px solid transparent; top: 179px;"></div><div class="CodeMirror-gutters" style="height: 209px;"><div class="CodeMirror-gutter CodeMirror-linenumbers" style="width: 26px;"></div></div></div></div></pre><h2><a name='header-n268' class='md-header-anchor '></a>6.7 多类别分类: 一对多(Multiclass Classification: One-vs-all)</h2><p>一直在讨论二元分类问题，这里谈谈多类别分类问题（比如天气预报）。</p><p><img src='image/20180112_001720.png' alt='' /></p><p>原理是，转化多类别分类问题为<strong>多个二元分类问题</strong>，这种方法被称为 One-vs-all。</p><p>正式定义：<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-249-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="39.051ex" height="3.511ex" viewBox="0 -1107.7 16813.5 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E257-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E257-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E257-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E257-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E257-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E257-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E257-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E257-MJMATHI-70" d="M23 287Q24 290 25 295T30 317T40 348T55 381T75 411T101 433T134 442Q209 442 230 378L240 387Q302 442 358 442Q423 442 460 395T497 281Q497 173 421 82T249 -10Q227 -10 210 -4Q199 1 187 11T168 28L161 36Q160 35 139 -51T118 -138Q118 -144 126 -145T163 -148H188Q194 -155 194 -157T191 -175Q188 -187 185 -190T172 -194Q170 -194 161 -194T127 -193T65 -192Q-5 -192 -24 -194H-32Q-39 -187 -39 -183Q-37 -156 -26 -148H-6Q28 -147 33 -136Q36 -130 94 103T155 350Q156 355 156 364Q156 405 131 405Q109 405 94 377T71 316T59 280Q57 278 43 278H29Q23 284 23 287ZM178 102Q200 26 252 26Q282 26 310 49T356 107Q374 141 392 215T411 325V331Q411 405 350 405Q339 405 328 402T306 393T286 380T269 365T254 350T243 336T235 326L232 322Q232 321 229 308T218 264T204 212Q178 106 178 102Z"></path><path stroke-width="1" id="E257-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E257-MJMAIN-7C" d="M139 -249H137Q125 -249 119 -235V251L120 737Q130 750 139 750Q152 750 159 735V-235Q151 -249 141 -249H139Z"></path><path stroke-width="1" id="E257-MJMAIN-3B" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 85 94 103T137 121Q202 121 202 8Q202 -44 183 -94T144 -169T118 -194Q115 -194 106 -186T95 -174Q94 -171 107 -155T137 -107T160 -38Q161 -32 162 -22T165 -4T165 4Q165 5 161 4T142 0Q110 0 94 18T78 60Z"></path><path stroke-width="1" id="E257-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E257-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E257-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E257-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E257-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E257-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-68" x="0" y="0"></use><g transform="translate(576,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-3B8" x="815" y="-474"></use><g transform="translate(1638,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-3D" x="3267" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-70" x="4323" y="0"></use><g transform="translate(4994,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-79" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-3D" x="1164" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-69" x="2221" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-7C" x="2566" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-78" x="2845" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-3B" x="3417" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-3B8" x="3862" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-29" x="4332" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-2C" x="9882" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-69" x="10327" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-3D" x="10950" y="0"></use><g transform="translate(12007,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-31" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-2C" x="890" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-32" x="1335" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-2C" x="1835" y="0"></use><g transform="translate(2280,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-33"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-2E" x="779" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-2E" x="1057" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-2E" x="1336" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMATHI-6B" x="3895" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E257-MJMAIN-29" x="4416" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-249">h_\theta^{\left( i \right)}\left( x \right)=p\left( y=i|x;\theta  \right), i=\left( 1,2,3....k \right)</script></p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-250-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.944ex" height="3.511ex" viewBox="0 -1107.7 2989.8 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E258-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E258-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E258-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E258-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E258-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E258-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E258-MJMATHI-68" x="0" y="0"></use><g transform="translate(576,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E258-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E258-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E258-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E258-MJMATHI-3B8" x="815" y="-474"></use><g transform="translate(1638,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E258-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E258-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E258-MJMAIN-29" x="962" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-250">h_\theta^{\left( i \right)}\left( x \right)</script>: 输出 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-251-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.056ex" height="2.461ex" viewBox="0 -755.9 2177.1 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E259-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E259-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E259-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E259-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E259-MJMAIN-3D" x="775" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E259-MJMATHI-69" x="1831" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-251">y=i</script>（属于第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-40-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.802ex" height="1.994ex" viewBox="0 -755.9 345.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E47-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E47-MJMATHI-69" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-40">i</script> 个分类）的可能性</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-258-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E266-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E266-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-258">k</script>: 类别总数，如上图 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-253-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.472ex" height="1.994ex" viewBox="0 -755.9 2356.1 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E261-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path><path stroke-width="1" id="E261-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E261-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E261-MJMATHI-6B" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E261-MJMAIN-3D" x="799" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E261-MJMAIN-33" x="1855" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-253">k=3</script>。</p></blockquote><p>注意多类别分类问题中 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-259-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.481ex" height="2.577ex" viewBox="0 -806.1 2360 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E267-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E267-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E267-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E267-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E267-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMAIN-29" x="1970" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-259">h_\theta(x)</script> 的结果不再只是一个实数而是一个向量，如果类别总数为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-258-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E266-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E266-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-258">k</script>，现在 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-259-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.481ex" height="2.577ex" viewBox="0 -806.1 2360 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E267-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E267-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E267-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E267-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E267-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMAIN-29" x="1970" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-259">h_\theta(x)</script> 就是一个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-258-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E266-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E266-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-258">k</script> 维向量。</p><p>对于某个样本实例，需计算所有的 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-258-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E266-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E266-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-258">k</script> 种分类情况得到 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-259-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.481ex" height="2.577ex" viewBox="0 -806.1 2360 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E267-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E267-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E267-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E267-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E267-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E267-MJMAIN-29" x="1970" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-259">h_\theta(x)</script>，然后看分为哪个类别时预测输出的值最大，就说它输出属于哪个类别，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-260-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="16.298ex" height="4.562ex" viewBox="0 -1107.7 7017.2 1964.1" role="img" focusable="false" style="vertical-align: -1.989ex;"><defs><path stroke-width="1" id="E269-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E269-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E269-MJMAIN-6D" d="M41 46H55Q94 46 102 60V68Q102 77 102 91T102 122T103 161T103 203Q103 234 103 269T102 328V351Q99 370 88 376T43 385H25V408Q25 431 27 431L37 432Q47 433 65 434T102 436Q119 437 138 438T167 441T178 442H181V402Q181 364 182 364T187 369T199 384T218 402T247 421T285 437Q305 442 336 442Q351 442 364 440T387 434T406 426T421 417T432 406T441 395T448 384T452 374T455 366L457 361L460 365Q463 369 466 373T475 384T488 397T503 410T523 422T546 432T572 439T603 442Q729 442 740 329Q741 322 741 190V104Q741 66 743 59T754 49Q775 46 803 46H819V0H811L788 1Q764 2 737 2T699 3Q596 3 587 0H579V46H595Q656 46 656 62Q657 64 657 200Q656 335 655 343Q649 371 635 385T611 402T585 404Q540 404 506 370Q479 343 472 315T464 232V168V108Q464 78 465 68T468 55T477 49Q498 46 526 46H542V0H534L510 1Q487 2 460 2T422 3Q319 3 310 0H302V46H318Q379 46 379 62Q380 64 380 200Q379 335 378 343Q372 371 358 385T334 402T308 404Q263 404 229 370Q202 343 195 315T187 232V168V108Q187 78 188 68T191 55T200 49Q221 46 249 46H265V0H257L234 1Q210 2 183 2T145 3Q42 3 33 0H25V46H41Z"></path><path stroke-width="1" id="E269-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E269-MJMAIN-78" d="M201 0Q189 3 102 3Q26 3 17 0H11V46H25Q48 47 67 52T96 61T121 78T139 96T160 122T180 150L226 210L168 288Q159 301 149 315T133 336T122 351T113 363T107 370T100 376T94 379T88 381T80 383Q74 383 44 385H16V431H23Q59 429 126 429Q219 429 229 431H237V385Q201 381 201 369Q201 367 211 353T239 315T268 274L272 270L297 304Q329 345 329 358Q329 364 327 369T322 376T317 380T310 384L307 385H302V431H309Q324 428 408 428Q487 428 493 431H499V385H492Q443 385 411 368Q394 360 377 341T312 257L296 236L358 151Q424 61 429 57T446 50Q464 46 499 46H516V0H510H502Q494 1 482 1T457 2T432 2T414 3Q403 3 377 3T327 1L304 0H295V46H298Q309 46 320 51T331 63Q331 65 291 120L250 175Q249 174 219 133T185 88Q181 83 181 74Q181 63 188 55T206 46Q208 46 208 23V0H201Z"></path><path stroke-width="1" id="E269-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E269-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E269-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E269-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E269-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E269-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMATHI-79" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMAIN-3D" x="775" y="0"></use><g transform="translate(1831,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMAIN-6D"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMAIN-61" x="833" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMAIN-78" x="1334" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMATHI-69" x="1144" y="-915"></use></g><g transform="translate(4027,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMATHI-68" x="0" y="0"></use><g transform="translate(576,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMATHI-3B8" x="815" y="-474"></use></g><g transform="translate(5665,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E269-MJMAIN-29" x="962" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-260">y = \mathop{\max}\limits_i\,h_\theta^{\left( i \right)}\left( x \right)</script>。</p><h1><a name='header-n286' class='md-header-anchor '></a>7 正则化(Regularization)</h1><h2><a name='header-n287' class='md-header-anchor '></a>7.1 过拟合问题(The Problem of Overfitting)</h2><p>对于拟合的表现，可以分为三类情况：</p><ul><li><p><strong>欠拟合(Underfitting)</strong></p><p>无法很好的拟合训练集中的数据，预测值和实际值的误差很大，这类情况被称为欠拟合。拟合模型比较简单（特征选少了）时易出现这类情况。类似于，你上课不好好听，啥都不会，下课也差不多啥都不会。</p></li><li><p><strong>优良的拟合(Just right)</strong></p><p>不论是训练集数据还是不在训练集中的预测数据，都能给出较为正确的结果。类似于，学霸学神！</p></li><li><p><strong>过拟合(Overfitting)</strong></p><p>能很好甚至完美拟合训练集中的数据，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-261-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.148ex" height="2.577ex" viewBox="0 -806.1 3938.6 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E270-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E270-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E270-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E270-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E270-MJMAIN-2192" d="M56 237T56 250T70 270H835Q719 357 692 493Q692 494 692 496T691 499Q691 511 708 511H711Q720 511 723 510T729 506T732 497T735 481T743 456Q765 389 816 336T935 261Q944 258 944 250Q944 244 939 241T915 231T877 212Q836 186 806 152T761 85T740 35T732 4Q730 -6 727 -8T711 -11Q691 -11 691 0Q691 7 696 25Q728 151 835 230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E270-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E270-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E270-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E270-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E270-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E270-MJMAIN-2192" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E270-MJMAIN-30" x="3438" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-261">J(\theta) \to 0</script>，但是对于不在训练集中的<strong>新数据</strong>，预测值和实际值的误差会很大，<strong>泛化能力弱</strong>，这类情况被称为过拟合。拟合模型过于复杂（特征选多了）时易出现这类情况。类似于，你上课跟着老师做题都会都听懂了，下课遇到新题就懵了不会拓展。</p></li></ul><p>线性模型中的拟合情况(左图欠拟合，右图过拟合)：
 <img src='image/20180112_091654.png' alt='' /></p><p>逻辑分类模型中的拟合情况：
 <img src='image/20180112_092027.png' alt='' /></p><p>&nbsp;</p><p>为了度量拟合表现，引入：</p><ul><li><p>偏差(bias)</p><p>指模型的预测值与真实值的<strong>偏离程度</strong>。偏差越大，预测值偏离真实值越厉害。偏差低意味着能较好地反应训练集中的数据情况。</p></li><li><p>方差(Variance)</p><p>指模型预测值的<strong>离散程度或者变化范围</strong>。方差越大，数据的分布越分散，函数波动越大，泛化能力越差。方差低意味着拟合曲线的稳定性高，波动小。</p></li></ul><p>据此，我们有对同一数据的各类拟合情况如下图：
-<img src='image/20180112_085630.png' alt='' /></p><p>据上图，高偏差意味着欠拟合，高方差意味着过拟合。</p><p>我们应尽量使得拟合模型处于低方差（较好地拟合数据）状态且同时处于低偏差（较好地预测新值）的状态。</p><p>避免过拟合的方法有：</p><ul><li><p>减少特征的数量</p><ul><li>手动选取需保留的特征</li><li>使用模型选择算法来选取合适的特征(如 PCA 算法)</li><li>减少特征的方式易丢失有用的特征信息</li></ul></li><li><p>正则化(Regularization)</p><ul><li>可保留所有参数（许多有用的特征都能轻微影响结果）</li><li>减少/惩罚各参数大小(magnitude)，以减轻各参数对模型的影响程度</li><li>当有很多参数对于模型只有轻微影响时，正则化方法的表现很好</li></ul></li></ul><h2><a name='header-n1356' class='md-header-anchor '></a>7.2 损失函数(Cost Function)</h2><p>很多时候由于特征数量过多，过拟合时我们很难选出要保留的特征，这时候应用正则化方法则是很好的选择。</p><p>上文中，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-110-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="30.567ex" height="2.694ex" viewBox="0 -906.7 13160.5 1160" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E112-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E112-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E112-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E112-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E112-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E112-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E112-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E112-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-30" x="663" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-2B" x="1145" y="0"></use><g transform="translate(2146,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-31" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-78" x="3069" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-2B" x="3864" y="0"></use><g transform="translate(4865,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(5788,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-32" x="809" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-2B" x="7037" y="0"></use><g transform="translate(8037,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-33" x="663" y="-213"></use></g><g transform="translate(8961,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-33" x="809" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-2B" x="10209" y="0"></use><g transform="translate(11210,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-34" x="663" y="-213"></use></g><g transform="translate(12134,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMAIN-34" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-110">\theta_0 + \theta_1x + \theta_2x^2 + \theta_3x^3 + \theta_4x^4</script> 这样一个复杂的多项式较易过拟合，在不减少特征的情况下，<strong>如果能消除类似于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-119-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.529ex" height="2.694ex" viewBox="0 -906.7 1949.8 1160" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E121-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E121-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E121-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E121-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E121-MJMAIN-33" x="663" y="-213"></use><g transform="translate(923,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E121-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E121-MJMAIN-33" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-119">\theta_3x^3</script>、<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-120-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.529ex" height="2.577ex" viewBox="0 -906.7 1949.8 1109.7" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E122-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E122-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path><path stroke-width="1" id="E122-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E122-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E122-MJMAIN-34" x="663" y="-213"></use><g transform="translate(923,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E122-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E122-MJMAIN-34" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-120">\theta_4x^4</script> 等复杂部分，那复杂函数就变得简单了</strong>。</p><p>为了保留各个参数的信息，不修改假设函数，改而修改损失函数：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-113-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="54.733ex" height="5.029ex" viewBox="0 -1409.3 23565.7 2165.1" role="img" focusable="false" style="vertical-align: -1.756ex;"><defs><path stroke-width="1" id="E115-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E115-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E115-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E115-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E115-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E115-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E115-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E115-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E115-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E115-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E115-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E115-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E115-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E115-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E115-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E115-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E115-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E115-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E115-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-6D" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-69" x="878" y="0"></use><g transform="translate(1224,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-6E" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-3B8" x="849" y="-219"></use></g><g transform="translate(2506,0)"><g transform="translate(120,0)"><rect stroke="none" width="1499" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-31" x="499" y="676"></use><g transform="translate(60,-686)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-32" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-6D" x="500" y="0"></use></g></g></g><g transform="translate(4412,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJSZ1-2211" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-6D" x="1494" y="675"></use><g transform="translate(1056,-287)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-31" x="1124" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-28" x="6717" y="0"></use><g transform="translate(7106,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-28" x="8115" y="0"></use><g transform="translate(8504,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-29" x="9972" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-2212" x="10584" y="0"></use><g transform="translate(11584,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(12979,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-32" x="550" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-2B" x="14045" y="0"></use><g transform="translate(15046,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-30" x="1501" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-22C5" x="17270" y="0"></use><g transform="translate(17771,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-33" x="663" y="-434"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-2B" x="18916" y="0"></use><g transform="translate(19917,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-30" x="1501" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-22C5" x="22141" y="0"></use><g transform="translate(22642,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E115-MJMAIN-34" x="663" y="-446"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-113">min_\theta\ \dfrac{1}{2m}\sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})^2 + 1000\cdot\theta_3^2 + 1000\cdot\theta_4^2</script></p><p>上式中，我们在损失函数中增加了 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-117-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.414ex" viewBox="0 -790.8 923.4 1039.3" role="img" focusable="false" style="vertical-align: -0.577ex;"><defs><path stroke-width="1" id="E119-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E119-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E119-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E119-MJMAIN-33" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-117">\theta_3</script>、<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-118-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.414ex" viewBox="0 -790.8 923.4 1039.3" role="img" focusable="false" style="vertical-align: -0.577ex;"><defs><path stroke-width="1" id="E120-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E120-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E120-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E120-MJMAIN-34" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-118">\theta_4</script> 的惩罚项(penalty term) <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-116-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="19.788ex" height="3.044ex" viewBox="0 -906.7 8519.6 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E118-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E118-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E118-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E118-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E118-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E118-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E118-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E118-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-30" x="1501" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-22C5" x="2224" y="0"></use><g transform="translate(2724,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-33" x="663" y="-434"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-2B" x="3870" y="0"></use><g transform="translate(4871,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-30" x="1501" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-22C5" x="7095" y="0"></use><g transform="translate(7596,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMAIN-34" x="663" y="-446"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-116">1000\cdot\theta_3^2 + 1000\cdot\theta_4^2</script>，如果要最小化损失函数，那么势必需要极大地<strong>减小 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-117-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.414ex" viewBox="0 -790.8 923.4 1039.3" role="img" focusable="false" style="vertical-align: -0.577ex;"><defs><path stroke-width="1" id="E119-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E119-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E119-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E119-MJMAIN-33" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-117">\theta_3</script>、<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-118-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.414ex" viewBox="0 -790.8 923.4 1039.3" role="img" focusable="false" style="vertical-align: -0.577ex;"><defs><path stroke-width="1" id="E120-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E120-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E120-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E120-MJMAIN-34" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-118">\theta_4</script></strong>，从而使得假设函数中的 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-119-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.529ex" height="2.694ex" viewBox="0 -906.7 1949.8 1160" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E121-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E121-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E121-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E121-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E121-MJMAIN-33" x="663" y="-213"></use><g transform="translate(923,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E121-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E121-MJMAIN-33" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-119">\theta_3x^3</script>、<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-120-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.529ex" height="2.577ex" viewBox="0 -906.7 1949.8 1109.7" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E122-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E122-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path><path stroke-width="1" id="E122-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E122-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E122-MJMAIN-34" x="663" y="-213"></use><g transform="translate(923,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E122-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E122-MJMAIN-34" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-120">\theta_4x^4</script> 这两项的参数非常小，就相当于没有了，假设函数也就<strong>“变得”简单</strong>了，从而在保留各参数的情况下避免了过拟合问题。</p><p><img src='image/20180114_090054.png' alt='' /></p><p>&nbsp;</p><p>根据上面的讨论，有时也无法决定要减少哪个参数，故统一惩罚除了 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-129-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.461ex" viewBox="0 -806.1 923.4 1059.4" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E131-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E131-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E131-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E131-MJMAIN-30" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-129">\theta_0</script> 外的所有参数。</p><p>损失函数：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-121-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="41.703ex" height="6.196ex" viewBox="0 -1459.5 17955.2 2667.7" role="img" focusable="false" style="vertical-align: -2.806ex;"><defs><path stroke-width="1" id="E123-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E123-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E123-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E123-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E123-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E123-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E123-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E123-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E123-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E123-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E123-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E123-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E123-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E123-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E123-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E123-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E123-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E123-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E123-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E123-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-4A" x="0" y="0"></use><g transform="translate(800,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-3B8" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-29" x="859" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-3D" x="2326" y="0"></use><g transform="translate(3104,0)"><g transform="translate(397,0)"><rect stroke="none" width="1095" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-31" x="524" y="572"></use><g transform="translate(60,-376)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-32" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-6D" x="500" y="0"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-5B" x="4717" y="0"></use><g transform="translate(4996,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJSZ1-2211" x="46" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-6D" x="372" y="1344"></use></g><g transform="translate(6311,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-28" x="1397" y="0"></use><g transform="translate(1787,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-29" x="3255" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-2212" x="3866" y="0"></use><g transform="translate(4867,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-29" x="6262" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-32" x="9407" y="878"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-2B" x="7327" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-3BB" x="8328" y="0"></use><g transform="translate(9078,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJSZ1-2211" x="69" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-3D" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-31" x="1191" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-6E" x="545" y="1344"></use></g><g transform="translate(10441,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMATHI-6A" x="663" y="-430"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E123-MJMAIN-5D" x="11365" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-121">J\left( \theta  \right)=\frac{1}{2m}[\sum\limits_{i=1}^{m}{{{({h_\theta}({{x}^{(i)}})-{{y}^{(i)}})}^{2}}+\lambda \sum\limits_{j=1}^{n}{\theta_{j}^{2}}]}</script></p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-127-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.355ex" height="1.994ex" viewBox="0 -755.9 583.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E129-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E129-MJMATHI-3BB" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-127">\lambda</script>: 正则化参数(Regularization Parameter)，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-123-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.616ex" height="1.994ex" viewBox="0 -755.9 2418.1 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E125-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E125-MJMAIN-3E" d="M84 520Q84 528 88 533T96 539L99 540Q106 540 253 471T544 334L687 265Q694 260 694 250T687 235Q685 233 395 96L107 -40H101Q83 -38 83 -20Q83 -19 83 -17Q82 -10 98 -1Q117 9 248 71Q326 108 378 132L626 250L378 368Q90 504 86 509Q84 513 84 520Z"></path><path stroke-width="1" id="E125-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E125-MJMATHI-3BB" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E125-MJMAIN-3E" x="861" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E125-MJMAIN-30" x="1917" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-123">\lambda > 0</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-124-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.797ex" height="6.196ex" viewBox="-8.1 -1459.5 1204.2 2667.7" role="img" focusable="false" style="vertical-align: -2.806ex; margin-left: -0.019ex;"><defs><path stroke-width="1" id="E126-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E126-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E126-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E126-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E126-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E126-MJSZ1-2211" x="69" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E126-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E126-MJMAIN-3D" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E126-MJMAIN-31" x="1191" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E126-MJMATHI-6E" x="545" y="1344"></use></g></svg></span><script type="math/tex" id="MathJax-Element-124">\sum\limits_{j=1}^{n}</script>: 不惩罚基础参数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-129-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.461ex" viewBox="0 -806.1 923.4 1059.4" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E131-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E131-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E131-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E131-MJMAIN-30" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-129">\theta_0</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-126-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="7.052ex" height="6.196ex" viewBox="0 -1459.5 3036.3 2667.7" role="img" focusable="false" style="vertical-align: -2.806ex;"><defs><path stroke-width="1" id="E128-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E128-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E128-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E128-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E128-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E128-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E128-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E128-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJMATHI-3BB" x="0" y="0"></use><g transform="translate(750,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJSZ1-2211" x="69" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJMAIN-3D" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJMAIN-31" x="1191" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJMATHI-6E" x="545" y="1344"></use></g><g transform="translate(2112,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E128-MJMATHI-6A" x="663" y="-430"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-126">\lambda \sum\limits_{j=1}^{n}{\theta_{j}^{2}}</script>: 正则化项</p></blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-127-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.355ex" height="1.994ex" viewBox="0 -755.9 583.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E129-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E129-MJMATHI-3BB" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-127">\lambda</script> 正则化参数类似于学习速率，也需要我们自行对其选择一个合适的值。</p><ul><li><p>过大</p><ul><li>导致模型欠拟合(假设可能会变成近乎 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-128-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.573ex" height="2.461ex" viewBox="0 -806.1 2830 1059.4" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E130-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E130-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E130-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E130-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E130-MJMATHI-78" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E130-MJMAIN-3D" x="850" y="0"></use><g transform="translate(1906,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E130-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E130-MJMAIN-30" x="663" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-128">x = \theta_0</script> 的直线 )</li><li>无法正常去过拟问题</li><li>梯度下降可能无法收敛</li></ul></li><li><p>过小</p><ul><li>无法避免过拟合（等于没有）</li></ul></li></ul><blockquote><p>正则化符合奥卡姆剃刀(Occam&#39;s razor)原理。在所有可能选择的模型中，能够很好地解释已知数据并且十分简单才是最好的模型，也就是应该选择的模型。从贝叶斯估计的角度来看，正则化项对应于模型的先验概率。可以假设复杂的模型有较大的先验概率，简单的模型有较小的先验概率。</p></blockquote><blockquote><p>正则化是结构风险最小化策略的实现，是去过拟合问题的典型方法，虽然看起来多了个一参数多了一重麻烦，后文会介绍自动选取正则化参数的方法。模型越复杂，正则化参数值就越大。比如，正则化项可以是模型参数向量的范数。</p></blockquote><h2><a name='header-n1413' class='md-header-anchor '></a>7.3 线性回归正则化(Regularized Linear Regression)</h2><p>应用正则化的线性回归梯度下降算法：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-130-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="72.252ex" height="20.788ex" viewBox="0 -4726.4 31108.5 8950.1" role="img" focusable="false" style="vertical-align: -9.81ex;"><defs><path stroke-width="1" id="E132-MJMAIN-52" d="M130 622Q123 629 119 631T103 634T60 637H27V683H202H236H300Q376 683 417 677T500 648Q595 600 609 517Q610 512 610 501Q610 468 594 439T556 392T511 361T472 343L456 338Q459 335 467 332Q497 316 516 298T545 254T559 211T568 155T578 94Q588 46 602 31T640 16H645Q660 16 674 32T692 87Q692 98 696 101T712 105T728 103T732 90Q732 59 716 27T672 -16Q656 -22 630 -22Q481 -16 458 90Q456 101 456 163T449 246Q430 304 373 320L363 322L297 323H231V192L232 61Q238 51 249 49T301 46H334V0H323Q302 3 181 3Q59 3 38 0H27V46H60Q102 47 111 49T130 61V622ZM491 499V509Q491 527 490 539T481 570T462 601T424 623T362 636Q360 636 340 636T304 637H283Q238 637 234 628Q231 624 231 492V360H289Q390 360 434 378T489 456Q491 467 491 499Z"></path><path stroke-width="1" id="E132-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E132-MJMAIN-70" d="M36 -148H50Q89 -148 97 -134V-126Q97 -119 97 -107T97 -77T98 -38T98 6T98 55T98 106Q98 140 98 177T98 243T98 296T97 335T97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 61 434T98 436Q115 437 135 438T165 441T176 442H179V416L180 390L188 397Q247 441 326 441Q407 441 464 377T522 216Q522 115 457 52T310 -11Q242 -11 190 33L182 40V-45V-101Q182 -128 184 -134T195 -145Q216 -148 244 -148H260V-194H252L228 -193Q205 -192 178 -192T140 -191Q37 -191 28 -194H20V-148H36ZM424 218Q424 292 390 347T305 402Q234 402 182 337V98Q222 26 294 26Q345 26 384 80T424 218Z"></path><path stroke-width="1" id="E132-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E132-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E132-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E132-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E132-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E132-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E132-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E132-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E132-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E132-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E132-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E132-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E132-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E132-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E132-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E132-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E132-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E132-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E132-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E132-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E132-MJSZ4-28" d="M758 -1237T758 -1240T752 -1249H736Q718 -1249 717 -1248Q711 -1245 672 -1199Q237 -706 237 251T672 1700Q697 1730 716 1749Q718 1750 735 1750H752Q758 1744 758 1741Q758 1737 740 1713T689 1644T619 1537T540 1380T463 1176Q348 802 348 251Q348 -242 441 -599T744 -1218Q758 -1237 758 -1240Z"></path><path stroke-width="1" id="E132-MJSZ4-29" d="M33 1741Q33 1750 51 1750H60H65Q73 1750 81 1743T119 1700Q554 1207 554 251Q554 -707 119 -1199Q76 -1250 66 -1250Q65 -1250 62 -1250T56 -1249Q55 -1249 53 -1249T49 -1250Q33 -1250 33 -1239Q33 -1236 50 -1214T98 -1150T163 -1052T238 -910T311 -727Q443 -335 443 251Q443 402 436 532T405 831T339 1142T224 1438T50 1716Q33 1737 33 1741Z"></path><path stroke-width="1" id="E132-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E132-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E132-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E132-MJSZ4-5B" d="M269 -1249V1750H577V1677H342V-1176H577V-1249H269Z"></path><path stroke-width="1" id="E132-MJSZ4-5D" d="M5 1677V1750H313V-1249H5V-1176H240V1677H5Z"></path><path stroke-width="1" id="E132-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E132-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E132-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E132-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E132-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E132-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,3833)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-52"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-65" x="736" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-70" x="1181" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-65" x="1737" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-61" x="2182" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-74" x="2682" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-7B" x="3322" y="0"></use></g><g transform="translate(0,1717)"><g transform="translate(1000,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-30" x="663" y="-213"></use></g><g transform="translate(2201,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(3535,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2212" x="4681" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B1" x="5682" y="0"></use><g transform="translate(6572,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(8227,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="9672" y="0"></use><g transform="translate(10061,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="11070" y="0"></use><g transform="translate(11459,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="12927" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2212" x="13539" y="0"></use><g transform="translate(14540,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="15934" y="0"></use><g transform="translate(16324,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-30" x="809" y="-435"></use></g></g><g transform="translate(0,-1532)"><g transform="translate(1000,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="663" y="-213"></use></g><g transform="translate(2138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(3473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2212" x="4557" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B1" x="5557" y="0"></use><g transform="translate(6615,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ4-5B"></use><g transform="translate(583,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ4-28"></use><g transform="translate(792,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(2447,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="3892" y="0"></use><g transform="translate(4281,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="5290" y="0"></use><g transform="translate(5679,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="7147" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2212" x="7759" y="0"></use><g transform="translate(8759,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="10154" y="0"></use><g transform="translate(10544,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="809" y="-430"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ4-29" x="12011" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2B" x="13609" y="0"></use><g transform="translate(14388,0)"><g transform="translate(342,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3BB" x="207" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(15849,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ4-5D" x="16710" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2C" x="24075" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="25270" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2208" x="25960" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-7B" x="26906" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="27406" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2C" x="27907" y="0"></use><g transform="translate(28352,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2E" x="779" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2E" x="1057" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6E" x="29688" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-7D" x="30288" y="0"></use></g><g transform="translate(0,-3883)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-7D" x="0" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-130">\begin{align*} & \text{Repeat}\ \lbrace \newline & \ \ \ \ \theta_0 := \theta_0 - \alpha\ \frac{1}{m}\ \sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})x_0^{(i)} \newline & \ \ \ \ \theta_j := \theta_j - \alpha\ \left[ \left( \frac{1}{m}\ \sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})x_j^{(i)} \right) + \frac{\lambda}{m}\theta_j \right], \ \ \ j \in \lbrace 1,2...n\rbrace\newline & \rbrace \end{align*}</script></p><p>也可以移项得到更新表达式的另一种表示形式</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-131-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="48.531ex" height="3.745ex" viewBox="0 -1107.7 20895.1 1612.3" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E133-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E133-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E133-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E133-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E133-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E133-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E133-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E133-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E133-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E133-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E133-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E133-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E133-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E133-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E133-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E133-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-6A" x="663" y="-213"></use><g transform="translate(1138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(2473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-28" x="3334" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-31" x="3724" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-2212" x="4447" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-3B1" x="5447" y="0"></use><g transform="translate(6088,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-3BB" x="232" y="584"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-6D" x="84" y="-488"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-29" x="7069" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-2212" x="7681" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-3B1" x="8682" y="0"></use><g transform="translate(9322,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(10470,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJSZ1-2211" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-6D" x="1494" y="675"></use><g transform="translate(1056,-287)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-31" x="1124" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-28" x="12775" y="0"></use><g transform="translate(13165,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-28" x="14173" y="0"></use><g transform="translate(14563,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-29" x="16030" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-2212" x="16642" y="0"></use><g transform="translate(17643,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-29" x="19037" y="0"></use><g transform="translate(19427,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E133-MJMATHI-6A" x="809" y="-430"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-131">\theta_j := \theta_j(1 - \alpha\frac{\lambda}{m}) - \alpha\frac{1}{m}\sum_{i=1}^m(h_\theta(x^{(i)}) - y^{(i)})x_j^{(i)}</script></p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-132-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.279ex" height="3.395ex" viewBox="0 -1007.2 1842.4 1461.5" role="img" focusable="false" style="vertical-align: -1.055ex;"><defs><path stroke-width="1" id="E134-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E134-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E134-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E134-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E134-MJMATHI-3BB" x="232" y="584"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E134-MJMATHI-6D" x="84" y="-488"></use></g><g transform="translate(981,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E134-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E134-MJMATHI-6A" x="663" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-132">\frac{\lambda}{m}\theta_j</script>: 正则化项</p></blockquote><p>&nbsp;</p><p>应用正则化的正规方程法<sup><a href='#dfref-footnote-2' name='ref-footnote-2'>2</a></sup>：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-133-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="33.291ex" height="21.488ex" viewBox="0 -4877.1 14333.7 9251.7" role="img" focusable="false" style="vertical-align: -9.944ex; margin-bottom: -0.217ex;"><defs><path stroke-width="1" id="E135-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E135-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E135-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E135-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E135-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E135-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E135-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E135-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E135-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path><path stroke-width="1" id="E135-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E135-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E135-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E135-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E135-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E135-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E135-MJMAIN-77" d="M90 368Q84 378 76 380T40 385H18V431H24L43 430Q62 430 84 429T116 428Q206 428 221 431H229V385H215Q177 383 177 368Q177 367 221 239L265 113L339 328L333 345Q323 374 316 379Q308 384 278 385H258V431H264Q270 428 348 428Q439 428 454 431H461V385H452Q404 385 404 369Q404 366 418 324T449 234T481 143L496 100L537 219Q579 341 579 347Q579 363 564 373T530 385H522V431H529Q541 428 624 428Q692 428 698 431H703V385H697Q696 385 691 385T682 384Q635 377 619 334L559 161Q546 124 528 71Q508 12 503 1T487 -11H479Q460 -11 456 -4Q455 -3 407 133L361 267Q359 263 266 -4Q261 -11 243 -11H238Q225 -11 220 -3L90 368Z"></path><path stroke-width="1" id="E135-MJMAIN-68" d="M41 46H55Q94 46 102 60V68Q102 77 102 91T102 124T102 167T103 217T103 272T103 329Q103 366 103 407T103 482T102 542T102 586T102 603Q99 622 88 628T43 637H25V660Q25 683 27 683L37 684Q47 685 66 686T103 688Q120 689 140 690T170 693T181 694H184V367Q244 442 328 442Q451 442 463 329Q464 322 464 190V104Q464 66 466 59T477 49Q498 46 526 46H542V0H534L510 1Q487 2 460 2T422 3Q319 3 310 0H302V46H318Q379 46 379 62Q380 64 380 200Q379 335 378 343Q372 371 358 385T334 402T308 404Q263 404 229 370Q202 343 195 315T187 232V168V108Q187 78 188 68T191 55T200 49Q221 46 249 46H265V0H257L234 1Q210 2 183 2T145 3Q42 3 33 0H25V46H41Z"></path><path stroke-width="1" id="E135-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E135-MJMAIN-72" d="M36 46H50Q89 46 97 60V68Q97 77 97 91T98 122T98 161T98 203Q98 234 98 269T98 328L97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 60 434T96 436Q112 437 131 438T160 441T171 442H174V373Q213 441 271 441H277Q322 441 343 419T364 373Q364 352 351 337T313 322Q288 322 276 338T263 372Q263 381 265 388T270 400T273 405Q271 407 250 401Q234 393 226 386Q179 341 179 207V154Q179 141 179 127T179 101T180 81T180 66V61Q181 59 183 57T188 54T193 51T200 49T207 48T216 47T225 47T235 46T245 46H276V0H267Q249 3 140 3Q37 3 28 0H20V46H36Z"></path><path stroke-width="1" id="E135-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E135-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E135-MJMAIN-22F1" d="M133 760Q133 784 150 802T193 820Q217 820 235 804T254 761Q254 736 237 718T194 700T151 717T133 760ZM580 460Q580 484 597 502T640 520Q664 520 682 504T701 461Q701 436 684 418T641 400T598 417T580 460ZM1027 160Q1027 184 1044 202T1087 220Q1111 220 1129 204T1148 161Q1148 136 1131 118T1088 100T1045 117T1027 160Z"></path><path stroke-width="1" id="E135-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E135-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E135-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E135-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E135-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E135-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E135-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,3690)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-3B8" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-3D" x="747" y="0"></use><g transform="translate(1803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-54" x="1215" y="583"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-58" x="1916" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-2B" x="2991" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-3BB" x="3991" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-22C5" x="4797" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-4C" x="5298" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJSZ1-29" x="5979" y="-1"></use><g transform="translate(6438,619)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-2212" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-31" x="778" y="0"></use></g></g><g transform="translate(9246,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-54" x="1215" y="583"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-79" x="10704" y="0"></use></g><g transform="translate(0,-871)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-77"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-68" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-65" x="1279" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-72" x="1723" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-65" x="2116" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMATHI-4C" x="3060" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-3D" x="4019" y="0"></use><g transform="translate(5076,0)"><g transform="translate(0,3910)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-5563.67715231788) scale(1,6.322847682119205)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJSZ4-23A3" x="0" y="-6676"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-30" x="0" y="3110"></use></g><g transform="translate(1485,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-31" x="0" y="1710"></use></g><g transform="translate(2986,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-31" x="0" y="310"></use></g><g transform="translate(4486,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-22F1" x="0" y="-1811"></use></g><g transform="translate(6769,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJMAIN-31" x="0" y="-3211"></use></g></g><g transform="translate(8271,3910)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-5563.67715231788) scale(1,6.322847682119205)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E135-MJSZ4-23A6" x="0" y="-6676"></use></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-133">\begin{align*}& \theta = \left( X^TX + \lambda \cdot L \right)^{-1} X^Ty \newline& \text{where}\ \ L = \begin{bmatrix} 0 & & & & \newline & 1 & & & \newline & & 1 & & \newline & & & \ddots & \newline & & & & 1 \newline\end{bmatrix}\end{align*}</script></p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-134-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.617ex" height="1.994ex" viewBox="0 -755.9 1987.9 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E136-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E136-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E136-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E136-MJMATHI-3BB" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E136-MJMAIN-22C5" x="805" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E136-MJMATHI-4C" x="1306" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-134">\lambda\cdot L</script>: 正则化项</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-135-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.583ex" height="1.994ex" viewBox="0 -755.9 681.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E137-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E137-MJMATHI-4C" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-135">L</script>: 第一行第一列为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-136-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E138-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E138-MJMAIN-30" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-136">0</script> 的 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-137-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.398ex" height="2.11ex" viewBox="0 -755.9 2323.9 908.7" role="img" focusable="false" style="vertical-align: -0.355ex;"><defs><path stroke-width="1" id="E139-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E139-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E139-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E139-MJMATHI-6E" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E139-MJMAIN-2B" x="822" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E139-MJMAIN-31" x="1823" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-137">n+1</script> 维单位矩阵</p></blockquote><p>Matlab/Octave 代码：</p><pre class="md-fences md-end-block md-fences-with-lineno" lang=""> <div class="CodeMirror cm-s-inner CodeMirror-wrap"><div style="overflow: hidden; position: relative; width: 3px; height: 0px; top: 0px; left: 39px;"></div><div class="CodeMirror-scrollbar-filler" cm-not-content="true"></div><div class="CodeMirror-gutter-filler" cm-not-content="true"></div><div class="CodeMirror-scroll" tabindex="-1"><div class="CodeMirror-sizer" style="margin-left: 35px; margin-bottom: 0px; border-right-width: 30px; padding-right: 0px; padding-bottom: 0px;"><div style="position: relative; top: 0px;"><div class="CodeMirror-lines" role="presentation"><div role="presentation" style="position: relative; outline: none;"><div class="CodeMirror-measure"><pre><span>xxxxxxxxxx</span></pre><div class="CodeMirror-linenumber CodeMirror-gutter-elt"><div>10</div></div></div><div class="CodeMirror-measure"></div><div style="position: relative; z-index: 1;"></div><div class="CodeMirror-code" role="presentation"><div class="CodeMirror-activeline" style="position: relative;"><div class="CodeMirror-activeline-background CodeMirror-linebackground"></div><div class="CodeMirror-gutter-background CodeMirror-activeline-gutter" style="left: -35px; width: 35px;"></div><div class="CodeMirror-gutter-wrapper CodeMirror-activeline-gutter" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 26px;">1</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">&gt;&gt; L = eye(5)</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">2</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">&gt;&gt; L(1,1) = 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">3</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">4</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">L =</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">5</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">6</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">7</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 1 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">8</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 1 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">9</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 1 &nbsp; &nbsp; 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 26px;">10</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 1</span></pre></div></div></div></div></div></div><div style="position: absolute; height: 30px; width: 1px; border-bottom: 0px solid transparent; top: 224px;"></div><div class="CodeMirror-gutters" style="height: 254px;"><div class="CodeMirror-gutter CodeMirror-linenumbers" style="width: 34px;"></div></div></div></div></pre><p>&nbsp;</p><p>前文提到正则化可以解决正规方程法中不可逆的问题，即增加了 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-138-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.617ex" height="1.994ex" viewBox="0 -755.9 1987.9 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E140-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E140-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E140-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E140-MJMATHI-3BB" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E140-MJMAIN-22C5" x="805" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E140-MJMATHI-4C" x="1306" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-138">\lambda \cdot L</script> 正则化项后，可以保证 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-139-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.824ex" height="2.461ex" viewBox="0 -906.7 5521.3 1059.4" role="img" focusable="false" style="vertical-align: -0.355ex;"><defs><path stroke-width="1" id="E141-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E141-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E141-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E141-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E141-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E141-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E141-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E141-MJMATHI-54" x="1215" y="513"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E141-MJMATHI-58" x="1457" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E141-MJMAIN-2B" x="2532" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E141-MJMATHI-3BB" x="3533" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E141-MJMAIN-22C5" x="4339" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E141-MJMATHI-4C" x="4839" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-139">X^TX + \lambda \cdot L</script> 可逆(invertible)，即便 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-140-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.366ex" height="2.344ex" viewBox="0 -906.7 2310.4 1009.2" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E142-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E142-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E142-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E142-MJMATHI-54" x="1215" y="513"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E142-MJMATHI-58" x="1457" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-140">X^TX</script> 不可逆(non-invertible)。 </p><h2><a name='header-n1445' class='md-header-anchor '></a>7.4 逻辑回归正则化(Regularized Logistic Regression)</h2><p>为逻辑回归的损失函数添加正则化项：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-141-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="89.471ex" height="4.095ex" viewBox="0 -1158 38522.3 1763.1" role="img" focusable="false" style="vertical-align: -1.405ex;"><defs><path stroke-width="1" id="E143-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E143-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E143-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E143-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E143-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E143-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E143-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E143-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E143-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E143-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E143-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E143-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E143-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E143-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E143-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E143-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E143-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E143-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E143-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E143-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E143-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E143-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E143-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-3D" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-2212" x="3216" y="0"></use><g transform="translate(3994,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(5142,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJSZ1-2211" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-6D" x="1494" y="675"></use><g transform="translate(1056,-287)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-31" x="1124" y="0"></use></g></g><g transform="translate(7447,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-5B" x="0" y="0"></use><g transform="translate(334,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-79" x="0" y="0"></use><g transform="translate(599,435)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="735" y="0"></use></g></g><g transform="translate(2457,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-6C"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-6F" x="278" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-67" x="779" y="0"></use></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="3327" y="0"></use><g transform="translate(4460,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-3B8" x="815" y="-219"></use></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="4725" y="0"></use><g transform="translate(6138,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-78" x="0" y="0"></use><g transform="translate(687,435)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="735" y="0"></use></g></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="6582" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="6972" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-2B" x="7584" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="8584" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-31" x="8974" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-2212" x="9697" y="0"></use><g transform="translate(12837,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-79" x="0" y="0"></use><g transform="translate(599,435)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="735" y="0"></use></g></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="12092" y="0"></use><g transform="translate(15428,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-6C"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-6F" x="278" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-67" x="779" y="0"></use></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="14136" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-31" x="14526" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-2212" x="15248" y="0"></use><g transform="translate(19499,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-3B8" x="815" y="-219"></use></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="17258" y="0"></use><g transform="translate(21177,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-78" x="0" y="0"></use><g transform="translate(687,435)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="735" y="0"></use></g></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="19115" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-29" x="19504" y="0"></use><g transform="translate(23872,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-5D" x="0" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-2B" x="278" y="0"></use><g transform="translate(1268,0)"><g transform="translate(144,0)"><rect stroke="none" width="1314" height="72" x="0" y="264"></rect><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-3BB" x="482" y="562"></use><g transform="translate(72,-433)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-32" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-6D" x="500" y="0"></use></g></g></g><g transform="translate(3070,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJSZ1-2211" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-6E" x="1494" y="675"></use><g transform="translate(1267,-344)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-3D" x="412" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-31" x="1191" y="0"></use></g></g><g transform="translate(6093,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMAIN-32" x="663" y="612"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E143-MJMATHI-6A" x="663" y="-350"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-141">J(\theta) = - \frac{1}{m} \sum_{i=1}^m \large[ y^{(i)}\ \log (h_\theta (x^{(i)})) + (1 - y^{(i)})\ \log (1 - h_\theta(x^{(i)}))\large] + \frac{\lambda}{2m}\sum_{j=1}^n \theta_j^2</script></p><p>前文已经证明过逻辑回归和线性回归的损失函数的求导结果是一样的，此处通过给正则化项添加常数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-153-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.658ex" height="3.278ex" viewBox="0 -956.9 713.9 1411.3" role="img" focusable="false" style="vertical-align: -1.055ex;"><defs><path stroke-width="1" id="E165-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E165-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="473" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E165-MJMAIN-31" x="84" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E165-MJMAIN-32" x="84" y="-532"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-153">\frac{1}{2}</script>，则其求导结果也就一样了。</p><p>从而有应用正则化的逻辑回归梯度下降算法：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-130-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="72.252ex" height="20.788ex" viewBox="0 -4726.4 31108.5 8950.1" role="img" focusable="false" style="vertical-align: -9.81ex;"><defs><path stroke-width="1" id="E132-MJMAIN-52" d="M130 622Q123 629 119 631T103 634T60 637H27V683H202H236H300Q376 683 417 677T500 648Q595 600 609 517Q610 512 610 501Q610 468 594 439T556 392T511 361T472 343L456 338Q459 335 467 332Q497 316 516 298T545 254T559 211T568 155T578 94Q588 46 602 31T640 16H645Q660 16 674 32T692 87Q692 98 696 101T712 105T728 103T732 90Q732 59 716 27T672 -16Q656 -22 630 -22Q481 -16 458 90Q456 101 456 163T449 246Q430 304 373 320L363 322L297 323H231V192L232 61Q238 51 249 49T301 46H334V0H323Q302 3 181 3Q59 3 38 0H27V46H60Q102 47 111 49T130 61V622ZM491 499V509Q491 527 490 539T481 570T462 601T424 623T362 636Q360 636 340 636T304 637H283Q238 637 234 628Q231 624 231 492V360H289Q390 360 434 378T489 456Q491 467 491 499Z"></path><path stroke-width="1" id="E132-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E132-MJMAIN-70" d="M36 -148H50Q89 -148 97 -134V-126Q97 -119 97 -107T97 -77T98 -38T98 6T98 55T98 106Q98 140 98 177T98 243T98 296T97 335T97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 61 434T98 436Q115 437 135 438T165 441T176 442H179V416L180 390L188 397Q247 441 326 441Q407 441 464 377T522 216Q522 115 457 52T310 -11Q242 -11 190 33L182 40V-45V-101Q182 -128 184 -134T195 -145Q216 -148 244 -148H260V-194H252L228 -193Q205 -192 178 -192T140 -191Q37 -191 28 -194H20V-148H36ZM424 218Q424 292 390 347T305 402Q234 402 182 337V98Q222 26 294 26Q345 26 384 80T424 218Z"></path><path stroke-width="1" id="E132-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E132-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E132-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E132-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E132-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E132-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E132-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E132-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E132-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E132-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E132-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E132-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E132-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E132-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E132-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E132-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E132-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E132-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E132-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E132-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E132-MJSZ4-28" d="M758 -1237T758 -1240T752 -1249H736Q718 -1249 717 -1248Q711 -1245 672 -1199Q237 -706 237 251T672 1700Q697 1730 716 1749Q718 1750 735 1750H752Q758 1744 758 1741Q758 1737 740 1713T689 1644T619 1537T540 1380T463 1176Q348 802 348 251Q348 -242 441 -599T744 -1218Q758 -1237 758 -1240Z"></path><path stroke-width="1" id="E132-MJSZ4-29" d="M33 1741Q33 1750 51 1750H60H65Q73 1750 81 1743T119 1700Q554 1207 554 251Q554 -707 119 -1199Q76 -1250 66 -1250Q65 -1250 62 -1250T56 -1249Q55 -1249 53 -1249T49 -1250Q33 -1250 33 -1239Q33 -1236 50 -1214T98 -1150T163 -1052T238 -910T311 -727Q443 -335 443 251Q443 402 436 532T405 831T339 1142T224 1438T50 1716Q33 1737 33 1741Z"></path><path stroke-width="1" id="E132-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E132-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E132-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E132-MJSZ4-5B" d="M269 -1249V1750H577V1677H342V-1176H577V-1249H269Z"></path><path stroke-width="1" id="E132-MJSZ4-5D" d="M5 1677V1750H313V-1249H5V-1176H240V1677H5Z"></path><path stroke-width="1" id="E132-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E132-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E132-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E132-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E132-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E132-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,3833)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-52"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-65" x="736" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-70" x="1181" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-65" x="1737" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-61" x="2182" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-74" x="2682" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-7B" x="3322" y="0"></use></g><g transform="translate(0,1717)"><g transform="translate(1000,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-30" x="663" y="-213"></use></g><g transform="translate(2201,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(3535,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2212" x="4681" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B1" x="5682" y="0"></use><g transform="translate(6572,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(8227,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="9672" y="0"></use><g transform="translate(10061,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="11070" y="0"></use><g transform="translate(11459,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="12927" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2212" x="13539" y="0"></use><g transform="translate(14540,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="15934" y="0"></use><g transform="translate(16324,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-30" x="809" y="-435"></use></g></g><g transform="translate(0,-1532)"><g transform="translate(1000,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="663" y="-213"></use></g><g transform="translate(2138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(3473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2212" x="4557" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B1" x="5557" y="0"></use><g transform="translate(6615,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ4-5B"></use><g transform="translate(583,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ4-28"></use><g transform="translate(792,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(2447,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="3892" y="0"></use><g transform="translate(4281,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="5290" y="0"></use><g transform="translate(5679,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="7147" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2212" x="7759" y="0"></use><g transform="translate(8759,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="10154" y="0"></use><g transform="translate(10544,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="809" y="-430"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ4-29" x="12011" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2B" x="13609" y="0"></use><g transform="translate(14388,0)"><g transform="translate(342,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3BB" x="207" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(15849,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJSZ4-5D" x="16710" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2C" x="24075" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6A" x="25270" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2208" x="25960" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-7B" x="26906" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-31" x="27406" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2C" x="27907" y="0"></use><g transform="translate(28352,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2E" x="779" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-2E" x="1057" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMATHI-6E" x="29688" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-7D" x="30288" y="0"></use></g><g transform="translate(0,-3883)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E132-MJMAIN-7D" x="0" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-130">\begin{align*} & \text{Repeat}\ \lbrace \newline & \ \ \ \ \theta_0 := \theta_0 - \alpha\ \frac{1}{m}\ \sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})x_0^{(i)} \newline & \ \ \ \ \theta_j := \theta_j - \alpha\ \left[ \left( \frac{1}{m}\ \sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})x_j^{(i)} \right) + \frac{\lambda}{m}\theta_j \right], \ \ \ j \in \lbrace 1,2...n\rbrace\newline & \rbrace \end{align*}</script></p><p>&nbsp;</p><div class='footnotes-area'  ><hr/>
+<img src='image/20180112_085630.png' alt='' /></p><p>据上图，高偏差意味着欠拟合，高方差意味着过拟合。</p><p>我们应尽量使得拟合模型处于低方差（较好地拟合数据）状态且同时处于低偏差（较好地预测新值）的状态。</p><p>避免过拟合的方法有：</p><ul><li><p>减少特征的数量</p><ul><li>手动选取需保留的特征</li><li>使用模型选择算法来选取合适的特征(如 PCA 算法)</li><li>减少特征的方式易丢失有用的特征信息</li></ul></li><li><p>正则化(Regularization)</p><ul><li>可保留所有参数（许多有用的特征都能轻微影响结果）</li><li>减少/惩罚各参数大小(magnitude)，以减轻各参数对模型的影响程度</li><li>当有很多参数对于模型只有轻微影响时，正则化方法的表现很好</li></ul></li></ul><h2><a name='header-n363' class='md-header-anchor '></a>7.2 损失函数(Cost Function)</h2><p>很多时候由于特征数量过多，过拟合时我们很难选出要保留的特征，这时候应用正则化方法则是很好的选择。</p><p>上文中，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-262-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="30.567ex" height="2.694ex" viewBox="0 -906.7 13160.5 1160" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E271-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E271-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E271-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E271-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E271-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E271-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E271-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E271-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-30" x="663" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-2B" x="1145" y="0"></use><g transform="translate(2146,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-31" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-78" x="3069" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-2B" x="3864" y="0"></use><g transform="translate(4865,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(5788,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-32" x="809" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-2B" x="7037" y="0"></use><g transform="translate(8037,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-33" x="663" y="-213"></use></g><g transform="translate(8961,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-33" x="809" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-2B" x="10209" y="0"></use><g transform="translate(11210,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-34" x="663" y="-213"></use></g><g transform="translate(12134,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E271-MJMAIN-34" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-262">\theta_0 + \theta_1x + \theta_2x^2 + \theta_3x^3 + \theta_4x^4</script> 这样一个复杂的多项式较易过拟合，在不减少特征的情况下，<strong>如果能消除类似于 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-271-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.529ex" height="2.694ex" viewBox="0 -906.7 1949.8 1160" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E280-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E280-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E280-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E280-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E280-MJMAIN-33" x="663" y="-213"></use><g transform="translate(923,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E280-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E280-MJMAIN-33" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-271">\theta_3x^3</script>、<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-272-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.529ex" height="2.577ex" viewBox="0 -906.7 1949.8 1109.7" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E281-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E281-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path><path stroke-width="1" id="E281-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E281-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E281-MJMAIN-34" x="663" y="-213"></use><g transform="translate(923,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E281-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E281-MJMAIN-34" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-272">\theta_4x^4</script> 等复杂部分，那复杂函数就变得简单了</strong>。</p><p>为了保留各个参数的信息，不修改假设函数，改而修改损失函数：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-265-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="54.733ex" height="5.029ex" viewBox="0 -1409.3 23565.7 2165.1" role="img" focusable="false" style="vertical-align: -1.756ex;"><defs><path stroke-width="1" id="E274-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E274-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E274-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E274-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E274-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E274-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E274-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E274-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E274-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E274-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E274-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E274-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E274-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E274-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E274-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E274-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E274-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E274-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E274-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-6D" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-69" x="878" y="0"></use><g transform="translate(1224,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-6E" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-3B8" x="849" y="-219"></use></g><g transform="translate(2506,0)"><g transform="translate(120,0)"><rect stroke="none" width="1499" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-31" x="499" y="676"></use><g transform="translate(60,-686)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-32" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-6D" x="500" y="0"></use></g></g></g><g transform="translate(4412,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJSZ1-2211" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-6D" x="1494" y="675"></use><g transform="translate(1056,-287)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-31" x="1124" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-28" x="6717" y="0"></use><g transform="translate(7106,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-28" x="8115" y="0"></use><g transform="translate(8504,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-29" x="9972" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-2212" x="10584" y="0"></use><g transform="translate(11584,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-29" x="734" y="0"></use></g></g><g transform="translate(12979,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-32" x="550" y="513"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-2B" x="14045" y="0"></use><g transform="translate(15046,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-30" x="1501" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-22C5" x="17270" y="0"></use><g transform="translate(17771,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-33" x="663" y="-434"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-2B" x="18916" y="0"></use><g transform="translate(19917,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-30" x="1501" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-22C5" x="22141" y="0"></use><g transform="translate(22642,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E274-MJMAIN-34" x="663" y="-446"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-265">min_\theta\ \dfrac{1}{2m}\sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})^2 + 1000\cdot\theta_3^2 + 1000\cdot\theta_4^2</script></p><p>上式中，我们在损失函数中增加了 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-269-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.414ex" viewBox="0 -790.8 923.4 1039.3" role="img" focusable="false" style="vertical-align: -0.577ex;"><defs><path stroke-width="1" id="E278-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E278-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E278-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E278-MJMAIN-33" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-269">\theta_3</script>、<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-270-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.414ex" viewBox="0 -790.8 923.4 1039.3" role="img" focusable="false" style="vertical-align: -0.577ex;"><defs><path stroke-width="1" id="E279-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E279-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E279-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E279-MJMAIN-34" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-270">\theta_4</script> 的惩罚项(penalty term) <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-268-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="19.788ex" height="3.044ex" viewBox="0 -906.7 8519.6 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E277-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E277-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E277-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E277-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E277-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E277-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E277-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E277-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-30" x="1501" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-22C5" x="2224" y="0"></use><g transform="translate(2724,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-33" x="663" y="-434"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-2B" x="3870" y="0"></use><g transform="translate(4871,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-30" x="1501" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-22C5" x="7095" y="0"></use><g transform="translate(7596,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E277-MJMAIN-34" x="663" y="-446"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-268">1000\cdot\theta_3^2 + 1000\cdot\theta_4^2</script>，如果要最小化损失函数，那么势必需要极大地<strong>减小 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-269-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.414ex" viewBox="0 -790.8 923.4 1039.3" role="img" focusable="false" style="vertical-align: -0.577ex;"><defs><path stroke-width="1" id="E278-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E278-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E278-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E278-MJMAIN-33" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-269">\theta_3</script>、<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-270-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.414ex" viewBox="0 -790.8 923.4 1039.3" role="img" focusable="false" style="vertical-align: -0.577ex;"><defs><path stroke-width="1" id="E279-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E279-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E279-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E279-MJMAIN-34" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-270">\theta_4</script></strong>，从而使得假设函数中的 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-271-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.529ex" height="2.694ex" viewBox="0 -906.7 1949.8 1160" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E280-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E280-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E280-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E280-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E280-MJMAIN-33" x="663" y="-213"></use><g transform="translate(923,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E280-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E280-MJMAIN-33" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-271">\theta_3x^3</script>、<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-272-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.529ex" height="2.577ex" viewBox="0 -906.7 1949.8 1109.7" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E281-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E281-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path><path stroke-width="1" id="E281-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E281-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E281-MJMAIN-34" x="663" y="-213"></use><g transform="translate(923,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E281-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E281-MJMAIN-34" x="809" y="513"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-272">\theta_4x^4</script> 这两项的参数非常小，就相当于没有了，假设函数也就<strong>“变得”简单</strong>了，从而在保留各参数的情况下避免了过拟合问题。</p><p><img src='image/20180114_090054.png' alt='' /></p><p>&nbsp;</p><p>根据上面的讨论，有时也无法决定要减少哪个参数，故统一惩罚除了 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-45-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.461ex" viewBox="0 -806.1 923.4 1059.4" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E52-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E52-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-30" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-45">\theta_0</script> 外的所有参数。</p><p>损失函数：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-273-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="41.703ex" height="6.196ex" viewBox="0 -1459.5 17955.2 2667.7" role="img" focusable="false" style="vertical-align: -2.806ex;"><defs><path stroke-width="1" id="E282-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E282-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E282-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E282-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E282-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E282-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E282-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E282-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E282-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E282-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E282-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E282-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E282-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E282-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E282-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E282-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E282-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E282-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E282-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E282-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-4A" x="0" y="0"></use><g transform="translate(800,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-3B8" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-29" x="859" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-3D" x="2326" y="0"></use><g transform="translate(3104,0)"><g transform="translate(397,0)"><rect stroke="none" width="1095" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-31" x="524" y="572"></use><g transform="translate(60,-376)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-32" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-6D" x="500" y="0"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-5B" x="4717" y="0"></use><g transform="translate(4996,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJSZ1-2211" x="46" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-6D" x="372" y="1344"></use></g><g transform="translate(6311,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-28" x="1397" y="0"></use><g transform="translate(1787,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-29" x="3255" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-2212" x="3866" y="0"></use><g transform="translate(4867,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-29" x="6262" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-32" x="9407" y="878"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-2B" x="7327" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-3BB" x="8328" y="0"></use><g transform="translate(9078,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJSZ1-2211" x="69" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-3D" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-31" x="1191" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-6E" x="545" y="1344"></use></g><g transform="translate(10441,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMATHI-6A" x="663" y="-430"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E282-MJMAIN-5D" x="11365" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-273">J\left( \theta  \right)=\frac{1}{2m}[\sum\limits_{i=1}^{m}{{{({h_\theta}({{x}^{(i)}})-{{y}^{(i)}})}^{2}}+\lambda \sum\limits_{j=1}^{n}{\theta_{j}^{2}}]}</script></p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-278-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.355ex" height="1.994ex" viewBox="0 -755.9 583.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E287-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E287-MJMATHI-3BB" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-278">\lambda</script>: 正则化参数(Regularization Parameter)，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-275-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.616ex" height="1.994ex" viewBox="0 -755.9 2418.1 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E284-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E284-MJMAIN-3E" d="M84 520Q84 528 88 533T96 539L99 540Q106 540 253 471T544 334L687 265Q694 260 694 250T687 235Q685 233 395 96L107 -40H101Q83 -38 83 -20Q83 -19 83 -17Q82 -10 98 -1Q117 9 248 71Q326 108 378 132L626 250L378 368Q90 504 86 509Q84 513 84 520Z"></path><path stroke-width="1" id="E284-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E284-MJMATHI-3BB" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E284-MJMAIN-3E" x="861" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E284-MJMAIN-30" x="1917" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-275">\lambda > 0</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-276-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.797ex" height="6.196ex" viewBox="-8.1 -1459.5 1204.2 2667.7" role="img" focusable="false" style="vertical-align: -2.806ex; margin-left: -0.019ex;"><defs><path stroke-width="1" id="E285-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E285-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E285-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E285-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E285-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E285-MJSZ1-2211" x="69" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E285-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E285-MJMAIN-3D" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E285-MJMAIN-31" x="1191" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E285-MJMATHI-6E" x="545" y="1344"></use></g></svg></span><script type="math/tex" id="MathJax-Element-276">\sum\limits_{j=1}^{n}</script>: 不惩罚基础参数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-45-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="2.461ex" viewBox="0 -806.1 923.4 1059.4" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E52-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E52-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E52-MJMAIN-30" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-45">\theta_0</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-277-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="7.052ex" height="6.196ex" viewBox="0 -1459.5 3036.3 2667.7" role="img" focusable="false" style="vertical-align: -2.806ex;"><defs><path stroke-width="1" id="E286-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E286-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E286-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E286-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E286-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E286-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E286-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E286-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJMATHI-3BB" x="0" y="0"></use><g transform="translate(750,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJSZ1-2211" x="69" y="0"></use><g transform="translate(0,-890)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJMAIN-3D" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJMAIN-31" x="1191" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJMATHI-6E" x="545" y="1344"></use></g><g transform="translate(2112,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJMAIN-32" x="663" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E286-MJMATHI-6A" x="663" y="-430"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-277">\lambda \sum\limits_{j=1}^{n}{\theta_{j}^{2}}</script>: 正则化项</p></blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-278-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.355ex" height="1.994ex" viewBox="0 -755.9 583.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E287-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E287-MJMATHI-3BB" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-278">\lambda</script> 正则化参数类似于学习速率，也需要我们自行对其选择一个合适的值。</p><ul><li><p>过大</p><ul><li>导致模型欠拟合(假设可能会变成近乎 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-279-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.573ex" height="2.461ex" viewBox="0 -806.1 2830 1059.4" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E288-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E288-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E288-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E288-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E288-MJMATHI-78" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E288-MJMAIN-3D" x="850" y="0"></use><g transform="translate(1906,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E288-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E288-MJMAIN-30" x="663" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-279">x = \theta_0</script> 的直线 )</li><li>无法正常去过拟问题</li><li>梯度下降可能无法收敛</li></ul></li><li><p>过小</p><ul><li>无法避免过拟合（等于没有）</li></ul></li></ul><blockquote><p>正则化符合奥卡姆剃刀(Occam&#39;s razor)原理。在所有可能选择的模型中，能够很好地解释已知数据并且十分简单才是最好的模型，也就是应该选择的模型。从贝叶斯估计的角度来看，正则化项对应于模型的先验概率。可以假设复杂的模型有较大的先验概率，简单的模型有较小的先验概率。</p></blockquote><blockquote><p>正则化是结构风险最小化策略的实现，是去过拟合问题的典型方法，虽然看起来多了个一参数多了一重麻烦，后文会介绍自动选取正则化参数的方法。模型越复杂，正则化参数值就越大。比如，正则化项可以是模型参数向量的范数。</p></blockquote><h2><a name='header-n420' class='md-header-anchor '></a>7.3 线性回归正则化(Regularized Linear Regression)</h2><p>应用正则化的线性回归梯度下降算法：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-289-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="72.252ex" height="20.788ex" viewBox="0 -4726.4 31108.5 8950.1" role="img" focusable="false" style="vertical-align: -9.81ex;"><defs><path stroke-width="1" id="E298-MJMAIN-52" d="M130 622Q123 629 119 631T103 634T60 637H27V683H202H236H300Q376 683 417 677T500 648Q595 600 609 517Q610 512 610 501Q610 468 594 439T556 392T511 361T472 343L456 338Q459 335 467 332Q497 316 516 298T545 254T559 211T568 155T578 94Q588 46 602 31T640 16H645Q660 16 674 32T692 87Q692 98 696 101T712 105T728 103T732 90Q732 59 716 27T672 -16Q656 -22 630 -22Q481 -16 458 90Q456 101 456 163T449 246Q430 304 373 320L363 322L297 323H231V192L232 61Q238 51 249 49T301 46H334V0H323Q302 3 181 3Q59 3 38 0H27V46H60Q102 47 111 49T130 61V622ZM491 499V509Q491 527 490 539T481 570T462 601T424 623T362 636Q360 636 340 636T304 637H283Q238 637 234 628Q231 624 231 492V360H289Q390 360 434 378T489 456Q491 467 491 499Z"></path><path stroke-width="1" id="E298-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E298-MJMAIN-70" d="M36 -148H50Q89 -148 97 -134V-126Q97 -119 97 -107T97 -77T98 -38T98 6T98 55T98 106Q98 140 98 177T98 243T98 296T97 335T97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 61 434T98 436Q115 437 135 438T165 441T176 442H179V416L180 390L188 397Q247 441 326 441Q407 441 464 377T522 216Q522 115 457 52T310 -11Q242 -11 190 33L182 40V-45V-101Q182 -128 184 -134T195 -145Q216 -148 244 -148H260V-194H252L228 -193Q205 -192 178 -192T140 -191Q37 -191 28 -194H20V-148H36ZM424 218Q424 292 390 347T305 402Q234 402 182 337V98Q222 26 294 26Q345 26 384 80T424 218Z"></path><path stroke-width="1" id="E298-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E298-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E298-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E298-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E298-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E298-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E298-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E298-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E298-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E298-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E298-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E298-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E298-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E298-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E298-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E298-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E298-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E298-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E298-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E298-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E298-MJSZ4-28" d="M758 -1237T758 -1240T752 -1249H736Q718 -1249 717 -1248Q711 -1245 672 -1199Q237 -706 237 251T672 1700Q697 1730 716 1749Q718 1750 735 1750H752Q758 1744 758 1741Q758 1737 740 1713T689 1644T619 1537T540 1380T463 1176Q348 802 348 251Q348 -242 441 -599T744 -1218Q758 -1237 758 -1240Z"></path><path stroke-width="1" id="E298-MJSZ4-29" d="M33 1741Q33 1750 51 1750H60H65Q73 1750 81 1743T119 1700Q554 1207 554 251Q554 -707 119 -1199Q76 -1250 66 -1250Q65 -1250 62 -1250T56 -1249Q55 -1249 53 -1249T49 -1250Q33 -1250 33 -1239Q33 -1236 50 -1214T98 -1150T163 -1052T238 -910T311 -727Q443 -335 443 251Q443 402 436 532T405 831T339 1142T224 1438T50 1716Q33 1737 33 1741Z"></path><path stroke-width="1" id="E298-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E298-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E298-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E298-MJSZ4-5B" d="M269 -1249V1750H577V1677H342V-1176H577V-1249H269Z"></path><path stroke-width="1" id="E298-MJSZ4-5D" d="M5 1677V1750H313V-1249H5V-1176H240V1677H5Z"></path><path stroke-width="1" id="E298-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E298-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E298-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E298-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E298-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E298-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,3833)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-52"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-65" x="736" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-70" x="1181" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-65" x="1737" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-61" x="2182" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-74" x="2682" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-7B" x="3322" y="0"></use></g><g transform="translate(0,1717)"><g transform="translate(1000,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-30" x="663" y="-213"></use></g><g transform="translate(2201,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(3535,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2212" x="4681" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B1" x="5682" y="0"></use><g transform="translate(6572,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(8227,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="9672" y="0"></use><g transform="translate(10061,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="11070" y="0"></use><g transform="translate(11459,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="12927" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2212" x="13539" y="0"></use><g transform="translate(14540,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="15934" y="0"></use><g transform="translate(16324,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-30" x="809" y="-435"></use></g></g><g transform="translate(0,-1532)"><g transform="translate(1000,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="663" y="-213"></use></g><g transform="translate(2138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(3473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2212" x="4557" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B1" x="5557" y="0"></use><g transform="translate(6615,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ4-5B"></use><g transform="translate(583,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ4-28"></use><g transform="translate(792,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(2447,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="3892" y="0"></use><g transform="translate(4281,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="5290" y="0"></use><g transform="translate(5679,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="7147" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2212" x="7759" y="0"></use><g transform="translate(8759,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="10154" y="0"></use><g transform="translate(10544,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="809" y="-430"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ4-29" x="12011" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2B" x="13609" y="0"></use><g transform="translate(14388,0)"><g transform="translate(342,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3BB" x="207" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(15849,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ4-5D" x="16710" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2C" x="24075" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="25270" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2208" x="25960" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-7B" x="26906" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="27406" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2C" x="27907" y="0"></use><g transform="translate(28352,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2E" x="779" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2E" x="1057" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6E" x="29688" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-7D" x="30288" y="0"></use></g><g transform="translate(0,-3883)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-7D" x="0" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-289">\begin{align*} & \text{Repeat}\ \lbrace \newline & \ \ \ \ \theta_0 := \theta_0 - \alpha\ \frac{1}{m}\ \sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})x_0^{(i)} \newline & \ \ \ \ \theta_j := \theta_j - \alpha\ \left[ \left( \frac{1}{m}\ \sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})x_j^{(i)} \right) + \frac{\lambda}{m}\theta_j \right], \ \ \ j \in \lbrace 1,2...n\rbrace\newline & \rbrace \end{align*}</script></p><p>也可以移项得到更新表达式的另一种表示形式</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-281-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="48.531ex" height="3.745ex" viewBox="0 -1107.7 20895.1 1612.3" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E290-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E290-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E290-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E290-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E290-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E290-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E290-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E290-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E290-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E290-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E290-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E290-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E290-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E290-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E290-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E290-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-6A" x="663" y="-213"></use><g transform="translate(1138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(2473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-28" x="3334" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-31" x="3724" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-2212" x="4447" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-3B1" x="5447" y="0"></use><g transform="translate(6088,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-3BB" x="232" y="584"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-6D" x="84" y="-488"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-29" x="7069" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-2212" x="7681" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-3B1" x="8682" y="0"></use><g transform="translate(9322,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(10470,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJSZ1-2211" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-6D" x="1494" y="675"></use><g transform="translate(1056,-287)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-31" x="1124" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-28" x="12775" y="0"></use><g transform="translate(13165,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-28" x="14173" y="0"></use><g transform="translate(14563,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-29" x="16030" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-2212" x="16642" y="0"></use><g transform="translate(17643,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-29" x="19037" y="0"></use><g transform="translate(19427,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E290-MJMATHI-6A" x="809" y="-430"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-281">\theta_j := \theta_j(1 - \alpha\frac{\lambda}{m}) - \alpha\frac{1}{m}\sum_{i=1}^m(h_\theta(x^{(i)}) - y^{(i)})x_j^{(i)}</script></p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-282-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.279ex" height="3.395ex" viewBox="0 -1007.2 1842.4 1461.5" role="img" focusable="false" style="vertical-align: -1.055ex;"><defs><path stroke-width="1" id="E291-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E291-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E291-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E291-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E291-MJMATHI-3BB" x="232" y="584"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E291-MJMATHI-6D" x="84" y="-488"></use></g><g transform="translate(981,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E291-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E291-MJMATHI-6A" x="663" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-282">\frac{\lambda}{m}\theta_j</script>: 正则化项</p></blockquote><p>&nbsp;</p><p>应用正则化的正规方程法<sup><a href='#dfref-footnote-2' name='ref-footnote-2'>2</a></sup>：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-283-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="33.291ex" height="21.488ex" viewBox="0 -4877.1 14333.7 9251.7" role="img" focusable="false" style="vertical-align: -9.944ex; margin-bottom: -0.217ex;"><defs><path stroke-width="1" id="E292-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E292-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E292-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E292-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E292-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E292-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E292-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E292-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E292-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path><path stroke-width="1" id="E292-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E292-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E292-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path><path stroke-width="1" id="E292-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E292-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E292-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E292-MJMAIN-77" d="M90 368Q84 378 76 380T40 385H18V431H24L43 430Q62 430 84 429T116 428Q206 428 221 431H229V385H215Q177 383 177 368Q177 367 221 239L265 113L339 328L333 345Q323 374 316 379Q308 384 278 385H258V431H264Q270 428 348 428Q439 428 454 431H461V385H452Q404 385 404 369Q404 366 418 324T449 234T481 143L496 100L537 219Q579 341 579 347Q579 363 564 373T530 385H522V431H529Q541 428 624 428Q692 428 698 431H703V385H697Q696 385 691 385T682 384Q635 377 619 334L559 161Q546 124 528 71Q508 12 503 1T487 -11H479Q460 -11 456 -4Q455 -3 407 133L361 267Q359 263 266 -4Q261 -11 243 -11H238Q225 -11 220 -3L90 368Z"></path><path stroke-width="1" id="E292-MJMAIN-68" d="M41 46H55Q94 46 102 60V68Q102 77 102 91T102 124T102 167T103 217T103 272T103 329Q103 366 103 407T103 482T102 542T102 586T102 603Q99 622 88 628T43 637H25V660Q25 683 27 683L37 684Q47 685 66 686T103 688Q120 689 140 690T170 693T181 694H184V367Q244 442 328 442Q451 442 463 329Q464 322 464 190V104Q464 66 466 59T477 49Q498 46 526 46H542V0H534L510 1Q487 2 460 2T422 3Q319 3 310 0H302V46H318Q379 46 379 62Q380 64 380 200Q379 335 378 343Q372 371 358 385T334 402T308 404Q263 404 229 370Q202 343 195 315T187 232V168V108Q187 78 188 68T191 55T200 49Q221 46 249 46H265V0H257L234 1Q210 2 183 2T145 3Q42 3 33 0H25V46H41Z"></path><path stroke-width="1" id="E292-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E292-MJMAIN-72" d="M36 46H50Q89 46 97 60V68Q97 77 97 91T98 122T98 161T98 203Q98 234 98 269T98 328L97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 60 434T96 436Q112 437 131 438T160 441T171 442H174V373Q213 441 271 441H277Q322 441 343 419T364 373Q364 352 351 337T313 322Q288 322 276 338T263 372Q263 381 265 388T270 400T273 405Q271 407 250 401Q234 393 226 386Q179 341 179 207V154Q179 141 179 127T179 101T180 81T180 66V61Q181 59 183 57T188 54T193 51T200 49T207 48T216 47T225 47T235 46T245 46H276V0H267Q249 3 140 3Q37 3 28 0H20V46H36Z"></path><path stroke-width="1" id="E292-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E292-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E292-MJMAIN-22F1" d="M133 760Q133 784 150 802T193 820Q217 820 235 804T254 761Q254 736 237 718T194 700T151 717T133 760ZM580 460Q580 484 597 502T640 520Q664 520 682 504T701 461Q701 436 684 418T641 400T598 417T580 460ZM1027 160Q1027 184 1044 202T1087 220Q1111 220 1129 204T1148 161Q1148 136 1131 118T1088 100T1045 117T1027 160Z"></path><path stroke-width="1" id="E292-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E292-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E292-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E292-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E292-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E292-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E292-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,3690)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-3B8" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-3D" x="747" y="0"></use><g transform="translate(1803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-54" x="1215" y="583"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-58" x="1916" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-2B" x="2991" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-3BB" x="3991" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-22C5" x="4797" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-4C" x="5298" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJSZ1-29" x="5979" y="-1"></use><g transform="translate(6438,619)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-2212" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-31" x="778" y="0"></use></g></g><g transform="translate(9246,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-54" x="1215" y="583"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-79" x="10704" y="0"></use></g><g transform="translate(0,-871)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-77"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-68" x="722" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-65" x="1279" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-72" x="1723" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-65" x="2116" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMATHI-4C" x="3060" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-3D" x="4019" y="0"></use><g transform="translate(5076,0)"><g transform="translate(0,3910)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-5563.67715231788) scale(1,6.322847682119205)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJSZ4-23A3" x="0" y="-6676"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-30" x="0" y="3110"></use></g><g transform="translate(1485,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-31" x="0" y="1710"></use></g><g transform="translate(2986,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-31" x="0" y="310"></use></g><g transform="translate(4486,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-22F1" x="0" y="-1811"></use></g><g transform="translate(6769,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJMAIN-31" x="0" y="-3211"></use></g></g><g transform="translate(8271,3910)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-5563.67715231788) scale(1,6.322847682119205)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E292-MJSZ4-23A6" x="0" y="-6676"></use></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-283">\begin{align*}& \theta = \left( X^TX + \lambda \cdot L \right)^{-1} X^Ty \newline& \text{where}\ \ L = \begin{bmatrix} 0 & & & & \newline & 1 & & & \newline & & 1 & & \newline & & & \ddots & \newline & & & & 1 \newline\end{bmatrix}\end{align*}</script></p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-284-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.617ex" height="1.994ex" viewBox="0 -755.9 1987.9 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E293-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E293-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E293-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E293-MJMATHI-3BB" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E293-MJMAIN-22C5" x="805" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E293-MJMATHI-4C" x="1306" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-284">\lambda\cdot L</script>: 正则化项</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-285-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.583ex" height="1.994ex" viewBox="0 -755.9 681.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E294-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E294-MJMATHI-4C" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-285">L</script>: 第一行第一列为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-131-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E139-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E139-MJMAIN-30" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-131">0</script> 的 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-52-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.398ex" height="2.11ex" viewBox="0 -755.9 2323.9 908.7" role="img" focusable="false" style="vertical-align: -0.355ex;"><defs><path stroke-width="1" id="E59-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E59-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E59-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E59-MJMATHI-6E" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E59-MJMAIN-2B" x="822" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E59-MJMAIN-31" x="1823" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-52">n+1</script> 维单位矩阵</p></blockquote><p>Matlab/Octave 代码：</p><pre class="md-fences md-end-block md-fences-with-lineno" lang=""> <div class="CodeMirror cm-s-inner CodeMirror-wrap"><div style="overflow: hidden; position: relative; width: 3px; height: 0px; top: 0px; left: 39px;"></div><div class="CodeMirror-scrollbar-filler" cm-not-content="true"></div><div class="CodeMirror-gutter-filler" cm-not-content="true"></div><div class="CodeMirror-scroll" tabindex="-1"><div class="CodeMirror-sizer" style="margin-left: 35px; margin-bottom: 0px; border-right-width: 30px; padding-right: 0px; padding-bottom: 0px;"><div style="position: relative; top: 0px;"><div class="CodeMirror-lines" role="presentation"><div role="presentation" style="position: relative; outline: none;"><div class="CodeMirror-measure"><pre><span>xxxxxxxxxx</span></pre><div class="CodeMirror-linenumber CodeMirror-gutter-elt"><div>10</div></div></div><div class="CodeMirror-measure"></div><div style="position: relative; z-index: 1;"></div><div class="CodeMirror-code" role="presentation"><div class="CodeMirror-activeline" style="position: relative;"><div class="CodeMirror-activeline-background CodeMirror-linebackground"></div><div class="CodeMirror-gutter-background CodeMirror-activeline-gutter" style="left: -35px; width: 35px;"></div><div class="CodeMirror-gutter-wrapper CodeMirror-activeline-gutter" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 26px;">1</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">&gt;&gt; L = eye(5)</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">2</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">&gt;&gt; L(1,1) = 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">3</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">4</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;">L =</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">5</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"><span cm-text="">​</span></span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">6</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">7</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 1 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">8</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 1 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt" style="left: 0px; width: 26px;">9</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 1 &nbsp; &nbsp; 0</span></pre></div><div style="position: relative;"><div class="CodeMirror-gutter-wrapper" style="left: -35px;"><div class="CodeMirror-linenumber CodeMirror-gutter-elt CodeMirror-linenumber-show" style="left: 0px; width: 26px;">10</div></div><pre class=" CodeMirror-line " role="presentation"><span role="presentation" style="padding-right: 0.1px;"> &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 0 &nbsp; &nbsp; 1</span></pre></div></div></div></div></div></div><div style="position: absolute; height: 30px; width: 1px; border-bottom: 0px solid transparent; top: 224px;"></div><div class="CodeMirror-gutters" style="height: 254px;"><div class="CodeMirror-gutter CodeMirror-linenumbers" style="width: 34px;"></div></div></div></div></pre><p>&nbsp;</p><p>前文提到正则化可以解决正规方程法中不可逆的问题，即增加了 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-286-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.617ex" height="1.994ex" viewBox="0 -755.9 1987.9 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E295-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E295-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E295-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E295-MJMATHI-3BB" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E295-MJMAIN-22C5" x="805" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E295-MJMATHI-4C" x="1306" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-286">\lambda \cdot L</script> 正则化项后，可以保证 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-287-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.824ex" height="2.461ex" viewBox="0 -906.7 5521.3 1059.4" role="img" focusable="false" style="vertical-align: -0.355ex;"><defs><path stroke-width="1" id="E296-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E296-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path><path stroke-width="1" id="E296-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E296-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E296-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E296-MJMATHI-4C" d="M228 637Q194 637 192 641Q191 643 191 649Q191 673 202 682Q204 683 217 683Q271 680 344 680Q485 680 506 683H518Q524 677 524 674T522 656Q517 641 513 637H475Q406 636 394 628Q387 624 380 600T313 336Q297 271 279 198T252 88L243 52Q243 48 252 48T311 46H328Q360 46 379 47T428 54T478 72T522 106T564 161Q580 191 594 228T611 270Q616 273 628 273H641Q647 264 647 262T627 203T583 83T557 9Q555 4 553 3T537 0T494 -1Q483 -1 418 -1T294 0H116Q32 0 32 10Q32 17 34 24Q39 43 44 45Q48 46 59 46H65Q92 46 125 49Q139 52 144 61Q147 65 216 339T285 628Q285 635 228 637Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E296-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E296-MJMATHI-54" x="1215" y="513"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E296-MJMATHI-58" x="1457" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E296-MJMAIN-2B" x="2532" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E296-MJMATHI-3BB" x="3533" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E296-MJMAIN-22C5" x="4339" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E296-MJMATHI-4C" x="4839" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-287">X^TX + \lambda \cdot L</script> 可逆(invertible)，即便 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-104-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.366ex" height="2.344ex" viewBox="0 -906.7 2310.4 1009.2" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E112-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E112-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-54" x="1215" y="513"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E112-MJMATHI-58" x="1457" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-104">X^TX</script> 不可逆(non-invertible)。 </p><h2><a name='header-n450' class='md-header-anchor '></a>7.4 逻辑回归正则化(Regularized Logistic Regression)</h2><p>为逻辑回归的损失函数添加正则化项：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-288-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="89.471ex" height="4.095ex" viewBox="0 -1158 38522.3 1763.1" role="img" focusable="false" style="vertical-align: -1.405ex;"><defs><path stroke-width="1" id="E297-MJMATHI-4A" d="M447 625Q447 637 354 637H329Q323 642 323 645T325 664Q329 677 335 683H352Q393 681 498 681Q541 681 568 681T605 682T619 682Q633 682 633 672Q633 670 630 658Q626 642 623 640T604 637Q552 637 545 623Q541 610 483 376Q420 128 419 127Q397 64 333 21T195 -22Q137 -22 97 8T57 88Q57 130 80 152T132 174Q177 174 182 130Q182 98 164 80T123 56Q115 54 115 53T122 44Q148 15 197 15Q235 15 271 47T324 130Q328 142 387 380T447 625Z"></path><path stroke-width="1" id="E297-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E297-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E297-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E297-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E297-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E297-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E297-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E297-MJSZ1-2211" d="M61 748Q64 750 489 750H913L954 640Q965 609 976 579T993 533T999 516H979L959 517Q936 579 886 621T777 682Q724 700 655 705T436 710H319Q183 710 183 709Q186 706 348 484T511 259Q517 250 513 244L490 216Q466 188 420 134T330 27L149 -187Q149 -188 362 -188Q388 -188 436 -188T506 -189Q679 -189 778 -162T936 -43Q946 -27 959 6H999L913 -249L489 -250Q65 -250 62 -248Q56 -246 56 -239Q56 -234 118 -161Q186 -81 245 -11L428 206Q428 207 242 462L57 717L56 728Q56 744 61 748Z"></path><path stroke-width="1" id="E297-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E297-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E297-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E297-MJMAIN-6C" d="M42 46H56Q95 46 103 60V68Q103 77 103 91T103 124T104 167T104 217T104 272T104 329Q104 366 104 407T104 482T104 542T103 586T103 603Q100 622 89 628T44 637H26V660Q26 683 28 683L38 684Q48 685 67 686T104 688Q121 689 141 690T171 693T182 694H185V379Q185 62 186 60Q190 52 198 49Q219 46 247 46H263V0H255L232 1Q209 2 183 2T145 3T107 3T57 1L34 0H26V46H42Z"></path><path stroke-width="1" id="E297-MJMAIN-6F" d="M28 214Q28 309 93 378T250 448Q340 448 405 380T471 215Q471 120 407 55T250 -10Q153 -10 91 57T28 214ZM250 30Q372 30 372 193V225V250Q372 272 371 288T364 326T348 362T317 390T268 410Q263 411 252 411Q222 411 195 399Q152 377 139 338T126 246V226Q126 130 145 91Q177 30 250 30Z"></path><path stroke-width="1" id="E297-MJMAIN-67" d="M329 409Q373 453 429 453Q459 453 472 434T485 396Q485 382 476 371T449 360Q416 360 412 390Q410 404 415 411Q415 412 416 414V415Q388 412 363 393Q355 388 355 386Q355 385 359 381T368 369T379 351T388 325T392 292Q392 230 343 187T222 143Q172 143 123 171Q112 153 112 133Q112 98 138 81Q147 75 155 75T227 73Q311 72 335 67Q396 58 431 26Q470 -13 470 -72Q470 -139 392 -175Q332 -206 250 -206Q167 -206 107 -175Q29 -140 29 -75Q29 -39 50 -15T92 18L103 24Q67 55 67 108Q67 155 96 193Q52 237 52 292Q52 355 102 398T223 442Q274 442 318 416L329 409ZM299 343Q294 371 273 387T221 404Q192 404 171 388T145 343Q142 326 142 292Q142 248 149 227T179 192Q196 182 222 182Q244 182 260 189T283 207T294 227T299 242Q302 258 302 292T299 343ZM403 -75Q403 -50 389 -34T348 -11T299 -2T245 0H218Q151 0 138 -6Q118 -15 107 -34T95 -74Q95 -84 101 -97T122 -127T170 -155T250 -167Q319 -167 361 -139T403 -75Z"></path><path stroke-width="1" id="E297-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E297-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E297-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E297-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E297-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E297-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E297-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E297-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-4A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="633" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-3B8" x="1023" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="1492" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-3D" x="2159" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-2212" x="3216" y="0"></use><g transform="translate(3994,0)"><g transform="translate(120,0)"><rect stroke="none" width="741" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-31" x="273" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-6D" x="84" y="-488"></use></g></g><g transform="translate(5142,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJSZ1-2211" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-6D" x="1494" y="675"></use><g transform="translate(1056,-287)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-31" x="1124" y="0"></use></g></g><g transform="translate(7447,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-5B" x="0" y="0"></use><g transform="translate(334,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-79" x="0" y="0"></use><g transform="translate(599,435)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="735" y="0"></use></g></g><g transform="translate(2457,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-6C"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-6F" x="278" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-67" x="779" y="0"></use></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="3327" y="0"></use><g transform="translate(4460,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-3B8" x="815" y="-219"></use></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="4725" y="0"></use><g transform="translate(6138,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-78" x="0" y="0"></use><g transform="translate(687,435)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="735" y="0"></use></g></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="6582" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="6972" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-2B" x="7584" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="8584" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-31" x="8974" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-2212" x="9697" y="0"></use><g transform="translate(12837,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-79" x="0" y="0"></use><g transform="translate(599,435)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="735" y="0"></use></g></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="12092" y="0"></use><g transform="translate(15428,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-6C"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-6F" x="278" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-67" x="779" y="0"></use></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="14136" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-31" x="14526" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-2212" x="15248" y="0"></use><g transform="translate(19499,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-3B8" x="815" y="-219"></use></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="17258" y="0"></use><g transform="translate(21177,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-78" x="0" y="0"></use><g transform="translate(687,435)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="735" y="0"></use></g></g><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="19115" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-29" x="19504" y="0"></use><g transform="translate(23872,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-5D" x="0" y="0"></use><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-2B" x="278" y="0"></use><g transform="translate(1268,0)"><g transform="translate(144,0)"><rect stroke="none" width="1314" height="72" x="0" y="264"></rect><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-3BB" x="482" y="562"></use><g transform="translate(72,-433)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-32" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-6D" x="500" y="0"></use></g></g></g><g transform="translate(3070,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJSZ1-2211" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-6E" x="1494" y="675"></use><g transform="translate(1267,-344)"><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-3D" x="412" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-31" x="1191" y="0"></use></g></g><g transform="translate(6093,0)"><use transform="scale(1.2)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMAIN-32" x="663" y="612"></use><use transform="scale(0.849)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E297-MJMATHI-6A" x="663" y="-350"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-288">J(\theta) = - \frac{1}{m} \sum_{i=1}^m \large[ y^{(i)}\ \log (h_\theta (x^{(i)})) + (1 - y^{(i)})\ \log (1 - h_\theta(x^{(i)}))\large] + \frac{\lambda}{2m}\sum_{j=1}^n \theta_j^2</script></p><p>前文已经证明过逻辑回归和线性回归的损失函数的求导结果是一样的，此处通过给正则化项添加常数 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-117-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.658ex" height="3.278ex" viewBox="0 -956.9 713.9 1411.3" role="img" focusable="false" style="vertical-align: -1.055ex;"><defs><path stroke-width="1" id="E125-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E125-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(120,0)"><rect stroke="none" width="473" height="60" x="0" y="220"></rect><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E125-MJMAIN-31" x="84" y="572"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E125-MJMAIN-32" x="84" y="-532"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-117">\frac{1}{2}</script>，则其求导结果也就一样了。</p><p>从而有应用正则化的逻辑回归梯度下降算法：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-289-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="72.252ex" height="20.788ex" viewBox="0 -4726.4 31108.5 8950.1" role="img" focusable="false" style="vertical-align: -9.81ex;"><defs><path stroke-width="1" id="E298-MJMAIN-52" d="M130 622Q123 629 119 631T103 634T60 637H27V683H202H236H300Q376 683 417 677T500 648Q595 600 609 517Q610 512 610 501Q610 468 594 439T556 392T511 361T472 343L456 338Q459 335 467 332Q497 316 516 298T545 254T559 211T568 155T578 94Q588 46 602 31T640 16H645Q660 16 674 32T692 87Q692 98 696 101T712 105T728 103T732 90Q732 59 716 27T672 -16Q656 -22 630 -22Q481 -16 458 90Q456 101 456 163T449 246Q430 304 373 320L363 322L297 323H231V192L232 61Q238 51 249 49T301 46H334V0H323Q302 3 181 3Q59 3 38 0H27V46H60Q102 47 111 49T130 61V622ZM491 499V509Q491 527 490 539T481 570T462 601T424 623T362 636Q360 636 340 636T304 637H283Q238 637 234 628Q231 624 231 492V360H289Q390 360 434 378T489 456Q491 467 491 499Z"></path><path stroke-width="1" id="E298-MJMAIN-65" d="M28 218Q28 273 48 318T98 391T163 433T229 448Q282 448 320 430T378 380T406 316T415 245Q415 238 408 231H126V216Q126 68 226 36Q246 30 270 30Q312 30 342 62Q359 79 369 104L379 128Q382 131 395 131H398Q415 131 415 121Q415 117 412 108Q393 53 349 21T250 -11Q155 -11 92 58T28 218ZM333 275Q322 403 238 411H236Q228 411 220 410T195 402T166 381T143 340T127 274V267H333V275Z"></path><path stroke-width="1" id="E298-MJMAIN-70" d="M36 -148H50Q89 -148 97 -134V-126Q97 -119 97 -107T97 -77T98 -38T98 6T98 55T98 106Q98 140 98 177T98 243T98 296T97 335T97 351Q94 370 83 376T38 385H20V408Q20 431 22 431L32 432Q42 433 61 434T98 436Q115 437 135 438T165 441T176 442H179V416L180 390L188 397Q247 441 326 441Q407 441 464 377T522 216Q522 115 457 52T310 -11Q242 -11 190 33L182 40V-45V-101Q182 -128 184 -134T195 -145Q216 -148 244 -148H260V-194H252L228 -193Q205 -192 178 -192T140 -191Q37 -191 28 -194H20V-148H36ZM424 218Q424 292 390 347T305 402Q234 402 182 337V98Q222 26 294 26Q345 26 384 80T424 218Z"></path><path stroke-width="1" id="E298-MJMAIN-61" d="M137 305T115 305T78 320T63 359Q63 394 97 421T218 448Q291 448 336 416T396 340Q401 326 401 309T402 194V124Q402 76 407 58T428 40Q443 40 448 56T453 109V145H493V106Q492 66 490 59Q481 29 455 12T400 -6T353 12T329 54V58L327 55Q325 52 322 49T314 40T302 29T287 17T269 6T247 -2T221 -8T190 -11Q130 -11 82 20T34 107Q34 128 41 147T68 188T116 225T194 253T304 268H318V290Q318 324 312 340Q290 411 215 411Q197 411 181 410T156 406T148 403Q170 388 170 359Q170 334 154 320ZM126 106Q126 75 150 51T209 26Q247 26 276 49T315 109Q317 116 318 175Q318 233 317 233Q309 233 296 232T251 223T193 203T147 166T126 106Z"></path><path stroke-width="1" id="E298-MJMAIN-74" d="M27 422Q80 426 109 478T141 600V615H181V431H316V385H181V241Q182 116 182 100T189 68Q203 29 238 29Q282 29 292 100Q293 108 293 146V181H333V146V134Q333 57 291 17Q264 -10 221 -10Q187 -10 162 2T124 33T105 68T98 100Q97 107 97 248V385H18V422H27Z"></path><path stroke-width="1" id="E298-MJMAIN-7B" d="M434 -231Q434 -244 428 -250H410Q281 -250 230 -184Q225 -177 222 -172T217 -161T213 -148T211 -133T210 -111T209 -84T209 -47T209 0Q209 21 209 53Q208 142 204 153Q203 154 203 155Q189 191 153 211T82 231Q71 231 68 234T65 250T68 266T82 269Q116 269 152 289T203 345Q208 356 208 377T209 529V579Q209 634 215 656T244 698Q270 724 324 740Q361 748 377 749Q379 749 390 749T408 750H428Q434 744 434 732Q434 719 431 716Q429 713 415 713Q362 710 332 689T296 647Q291 634 291 499V417Q291 370 288 353T271 314Q240 271 184 255L170 250L184 245Q202 239 220 230T262 196T290 137Q291 131 291 1Q291 -134 296 -147Q306 -174 339 -192T415 -213Q429 -213 431 -216Q434 -219 434 -231Z"></path><path stroke-width="1" id="E298-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E298-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E298-MJMAIN-3A" d="M78 370Q78 394 95 412T138 430Q162 430 180 414T199 371Q199 346 182 328T139 310T96 327T78 370ZM78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E298-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E298-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E298-MJMATHI-3B1" d="M34 156Q34 270 120 356T309 442Q379 442 421 402T478 304Q484 275 485 237V208Q534 282 560 374Q564 388 566 390T582 393Q603 393 603 385Q603 376 594 346T558 261T497 161L486 147L487 123Q489 67 495 47T514 26Q528 28 540 37T557 60Q559 67 562 68T577 70Q597 70 597 62Q597 56 591 43Q579 19 556 5T512 -10H505Q438 -10 414 62L411 69L400 61Q390 53 370 41T325 18T267 -2T203 -11Q124 -11 79 39T34 156ZM208 26Q257 26 306 47T379 90L403 112Q401 255 396 290Q382 405 304 405Q235 405 183 332Q156 292 139 224T121 120Q121 71 146 49T208 26Z"></path><path stroke-width="1" id="E298-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E298-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E298-MJSZ2-2211" d="M60 948Q63 950 665 950H1267L1325 815Q1384 677 1388 669H1348L1341 683Q1320 724 1285 761Q1235 809 1174 838T1033 881T882 898T699 902H574H543H251L259 891Q722 258 724 252Q725 250 724 246Q721 243 460 -56L196 -356Q196 -357 407 -357Q459 -357 548 -357T676 -358Q812 -358 896 -353T1063 -332T1204 -283T1307 -196Q1328 -170 1348 -124H1388Q1388 -125 1381 -145T1356 -210T1325 -294L1267 -449L666 -450Q64 -450 61 -448Q55 -446 55 -439Q55 -437 57 -433L590 177Q590 178 557 222T452 366T322 544L56 909L55 924Q55 945 60 948Z"></path><path stroke-width="1" id="E298-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E298-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E298-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E298-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E298-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E298-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E298-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E298-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E298-MJSZ4-28" d="M758 -1237T758 -1240T752 -1249H736Q718 -1249 717 -1248Q711 -1245 672 -1199Q237 -706 237 251T672 1700Q697 1730 716 1749Q718 1750 735 1750H752Q758 1744 758 1741Q758 1737 740 1713T689 1644T619 1537T540 1380T463 1176Q348 802 348 251Q348 -242 441 -599T744 -1218Q758 -1237 758 -1240Z"></path><path stroke-width="1" id="E298-MJSZ4-29" d="M33 1741Q33 1750 51 1750H60H65Q73 1750 81 1743T119 1700Q554 1207 554 251Q554 -707 119 -1199Q76 -1250 66 -1250Q65 -1250 62 -1250T56 -1249Q55 -1249 53 -1249T49 -1250Q33 -1250 33 -1239Q33 -1236 50 -1214T98 -1150T163 -1052T238 -910T311 -727Q443 -335 443 251Q443 402 436 532T405 831T339 1142T224 1438T50 1716Q33 1737 33 1741Z"></path><path stroke-width="1" id="E298-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E298-MJMATHI-3BB" d="M166 673Q166 685 183 694H202Q292 691 316 644Q322 629 373 486T474 207T524 67Q531 47 537 34T546 15T551 6T555 2T556 -2T550 -11H482Q457 3 450 18T399 152L354 277L340 262Q327 246 293 207T236 141Q211 112 174 69Q123 9 111 -1T83 -12Q47 -12 47 20Q47 37 61 52T199 187Q229 216 266 252T321 306L338 322Q338 323 288 462T234 612Q214 657 183 657Q166 657 166 673Z"></path><path stroke-width="1" id="E298-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E298-MJSZ4-5B" d="M269 -1249V1750H577V1677H342V-1176H577V-1249H269Z"></path><path stroke-width="1" id="E298-MJSZ4-5D" d="M5 1677V1750H313V-1249H5V-1176H240V1677H5Z"></path><path stroke-width="1" id="E298-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E298-MJMAIN-2208" d="M84 250Q84 372 166 450T360 539Q361 539 377 539T419 540T469 540H568Q583 532 583 520Q583 511 570 501L466 500Q355 499 329 494Q280 482 242 458T183 409T147 354T129 306T124 272V270H568Q583 262 583 250T568 230H124V228Q124 207 134 177T167 112T231 48T328 7Q355 1 466 0H570Q583 -10 583 -20Q583 -32 568 -40H471Q464 -40 446 -40T417 -41Q262 -41 172 45Q84 127 84 250Z"></path><path stroke-width="1" id="E298-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E298-MJMAIN-2E" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60Z"></path><path stroke-width="1" id="E298-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E298-MJMAIN-7D" d="M65 731Q65 745 68 747T88 750Q171 750 216 725T279 670Q288 649 289 635T291 501Q292 362 293 357Q306 312 345 291T417 269Q428 269 431 266T434 250T431 234T417 231Q380 231 345 210T298 157Q293 143 292 121T291 -28V-79Q291 -134 285 -156T256 -198Q202 -250 89 -250Q71 -250 68 -247T65 -230Q65 -224 65 -223T66 -218T69 -214T77 -213Q91 -213 108 -210T146 -200T183 -177T207 -139Q208 -134 209 3L210 139Q223 196 280 230Q315 247 330 250Q305 257 280 270Q225 304 212 352L210 362L209 498Q208 635 207 640Q195 680 154 696T77 713Q68 713 67 716T65 731Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,3833)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-52"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-65" x="736" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-70" x="1181" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-65" x="1737" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-61" x="2182" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-74" x="2682" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-7B" x="3322" y="0"></use></g><g transform="translate(0,1717)"><g transform="translate(1000,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-30" x="663" y="-213"></use></g><g transform="translate(2201,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(3535,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2212" x="4681" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B1" x="5682" y="0"></use><g transform="translate(6572,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(8227,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="9672" y="0"></use><g transform="translate(10061,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="11070" y="0"></use><g transform="translate(11459,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="12927" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2212" x="13539" y="0"></use><g transform="translate(14540,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="15934" y="0"></use><g transform="translate(16324,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-30" x="809" y="-435"></use></g></g><g transform="translate(0,-1532)"><g transform="translate(1000,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="663" y="-213"></use></g><g transform="translate(2138,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3A"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3D" x="278" y="0"></use></g><g transform="translate(3473,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2212" x="4557" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B1" x="5557" y="0"></use><g transform="translate(6615,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ4-5B"></use><g transform="translate(583,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ4-28"></use><g transform="translate(792,0)"><g transform="translate(120,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="249" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(2447,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ2-2211" x="0" y="0"></use><g transform="translate(147,-1090)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-3D" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="1124" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="582" y="1627"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="3892" y="0"></use><g transform="translate(4281,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="815" y="-219"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="5290" y="0"></use><g transform="translate(5679,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="7147" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2212" x="7759" y="0"></use><g transform="translate(8759,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="10154" y="0"></use><g transform="translate(10544,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-78" x="0" y="0"></use><g transform="translate(572,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-29" x="734" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="809" y="-430"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ4-29" x="12011" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2B" x="13609" y="0"></use><g transform="translate(14388,0)"><g transform="translate(342,0)"><rect stroke="none" width="998" height="60" x="0" y="220"></rect><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3BB" x="207" y="676"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6D" x="60" y="-686"></use></g></g><g transform="translate(15849,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJSZ4-5D" x="16710" y="-1"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2C" x="24075" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6A" x="25270" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2208" x="25960" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-7B" x="26906" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-31" x="27406" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2C" x="27907" y="0"></use><g transform="translate(28352,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2E" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2E" x="779" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-2E" x="1057" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMATHI-6E" x="29688" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-7D" x="30288" y="0"></use></g><g transform="translate(0,-3883)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E298-MJMAIN-7D" x="0" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-289">\begin{align*} & \text{Repeat}\ \lbrace \newline & \ \ \ \ \theta_0 := \theta_0 - \alpha\ \frac{1}{m}\ \sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})x_0^{(i)} \newline & \ \ \ \ \theta_j := \theta_j - \alpha\ \left[ \left( \frac{1}{m}\ \sum_{i=1}^m (h_\theta(x^{(i)}) - y^{(i)})x_j^{(i)} \right) + \frac{\lambda}{m}\theta_j \right], \ \ \ j \in \lbrace 1,2...n\rbrace\newline & \rbrace \end{align*}</script></p><p>&nbsp;</p><div class='footnotes-area'  ><hr/>
 <div class='footnote-line'><span class='md-fn-count'>1</span> <a href='https://en.wikipedia.org/wiki/List_of_algorithms#Optimization_algorithms' target='_blank' >https://en.wikipedia.org/wiki/List_of_algorithms#Optimization_algorithms</a><a name='dfref-footnote-1' href='#ref-footnote-1' title='回到文档' class='reversefootnote' >↩</a></div>
 <div class='footnote-line'><span class='md-fn-count'>2</span> week2 - 4.6<a name='dfref-footnote-2' href='#ref-footnote-2' title='回到文档' class='reversefootnote' >↩</a></div></div></div>
 </body>
diff --git a/week3.md b/week3.md
index 08295a8..3f52a7e 100644
--- a/week3.md
+++ b/week3.md
@@ -72,7 +72,7 @@ $\begin{align*}& h_\theta(x) = P(y=1 | x ; \theta) = 1 - P(y=0 | x ; \theta) \ne
 
 $\begin{align*}& h_\theta(x) \geq 0.5 \rightarrow y = 1 \newline& h_\theta(x) < 0.5 \rightarrow y = 0 \newline\end{align*}$
 
-回忆一下逻辑函数的图像：
+回忆一下 sigmoid 函数的图像：
 
 ![sigmoid function](image/2413fbec8ff9fa1f19aaf78265b8a33b_Logistic_function.png)
 
diff --git a/week4.html b/week4.html
index d46cfa3..7df1b73 100644
--- a/week4.html
+++ b/week4.html
@@ -220,6 +220,6 @@ header, .context-menu, .megamenu-content, footer { font-family: "Segoe UI", Aria
 </style>
 </head>
 <body class='typora-export' >
-<div  id='write'  class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n2">8 神经网络：表达(Neural Networks: Representation)</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n3">8.1 非线性假设(Non-linear Hypotheses)</a></span><span class="md-toc-item md-toc-h2" data-ref="n14"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n14">8.2 神经网络和大脑(Neurons and the Brain)</a></span><span class="md-toc-item md-toc-h2" data-ref="n29"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n29">8.3 模型表示1(Model Representation I)</a></span><span class="md-toc-item md-toc-h2" data-ref="n102"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n102">8.4 模型表示2(Model Representation II)</a></span><span class="md-toc-item md-toc-h2" data-ref="n321"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n321">8.5 例子和直观理解1(Examples and Intuitions I)</a></span><span class="md-toc-item md-toc-h2" data-ref="n118"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n118">8.6 例子和直观理解2(Examples and Intuitions II)</a></span><span class="md-toc-item md-toc-h2" data-ref="n119"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n119">8.7 多类别分类(Multiclass Classification)</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>8 神经网络：表达(Neural Networks: Representation)</h1><h2><a name='header-n3' class='md-header-anchor '></a>8.1 非线性假设(Non-linear Hypotheses)</h2><p>理论上我们可以用多项式函数去近似任意函数，从而可得到任意问题的拟合曲线，即泰勒极数(Taylor series)。</p><p>在实际处理时，特征量通常会很多，如果再构造高阶多项式等，特征数量将会急剧增加，这使得线性模型的复杂度太高，可见并不合适。神经网络无需构造高阶多项式，在特征量很大时也可以处理的很好。</p><p>那特征能有多大呢？下面是一个计算机视觉中的例子：</p><p><img src='image/20180115_084326.png' alt='' /></p><p>如上图，如果选取一小块 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.845ex" height="1.994ex" viewBox="0 -755.9 2946.9 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E1-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E1-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1-MJMAIN-2217" d="M229 286Q216 420 216 436Q216 454 240 464Q241 464 245 464T251 465Q263 464 273 456T283 436Q283 419 277 356T270 286L328 328Q384 369 389 372T399 375Q412 375 423 365T435 338Q435 325 425 315Q420 312 357 282T289 250L355 219L425 184Q434 175 434 161Q434 146 425 136T401 125Q393 125 383 131T328 171L270 213Q283 79 283 63Q283 53 276 44T250 35Q231 35 224 44T216 63Q216 80 222 143T229 213L171 171Q115 130 110 127Q106 124 100 124Q87 124 76 134T64 161Q64 166 64 169T67 175T72 181T81 188T94 195T113 204T138 215T170 230T210 250L74 315Q65 324 65 338Q65 353 74 363T98 374Q106 374 116 368T171 328L229 286Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-35"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-2217" x="1223" y="0"></use><g transform="translate(1945,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-35"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-30" x="500" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1">50 * 50</script> 像素的灰度图片（一个像素只有亮度一个值），选择每个像素点作为特征，则特征总量 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-2-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.143ex" height="1.994ex" viewBox="0 -755.9 3936.6 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E2-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E2-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E2-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E2-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E2-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMATHI-6E" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-3D" x="878" y="0"></use><g transform="translate(1934,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-35" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-30" x="1501" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-2">n=2500</script>（换成 RGB（一个像素有三个值），则 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-3-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.143ex" height="1.994ex" viewBox="0 -755.9 3936.6 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E3-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E3-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E3-MJMAIN-37" d="M55 458Q56 460 72 567L88 674Q88 676 108 676H128V672Q128 662 143 655T195 646T364 644H485V605L417 512Q408 500 387 472T360 435T339 403T319 367T305 330T292 284T284 230T278 162T275 80Q275 66 275 52T274 28V19Q270 2 255 -10T221 -22Q210 -22 200 -19T179 0T168 40Q168 198 265 368Q285 400 349 489L395 552H302Q128 552 119 546Q113 543 108 522T98 479L95 458V455H55V458Z"></path><path stroke-width="1" id="E3-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E3-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMATHI-6E" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-3D" x="878" y="0"></use><g transform="translate(1934,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-37"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-35" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-30" x="1501" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-3">n = 7500</script>），如果将其两两组合作为新特征，则特征数量将为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-4-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.578ex" height="3.044ex" viewBox="0 -906.7 7568.2 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E4-MJMATHI-43" d="M50 252Q50 367 117 473T286 641T490 704Q580 704 633 653Q642 643 648 636T656 626L657 623Q660 623 684 649Q691 655 699 663T715 679T725 690L740 705H746Q760 705 760 698Q760 694 728 561Q692 422 692 421Q690 416 687 415T669 413H653Q647 419 647 422Q647 423 648 429T650 449T651 481Q651 552 619 605T510 659Q484 659 454 652T382 628T299 572T226 479Q194 422 175 346T156 222Q156 108 232 58Q280 24 350 24Q441 24 512 92T606 240Q610 253 612 255T628 257Q648 257 648 248Q648 243 647 239Q618 132 523 55T319 -22Q206 -22 128 53T50 252Z"></path><path stroke-width="1" id="E4-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E4-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E4-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E4-MJMAIN-2248" d="M55 319Q55 360 72 393T114 444T163 472T205 482Q207 482 213 482T223 483Q262 483 296 468T393 413L443 381Q502 346 553 346Q609 346 649 375T694 454Q694 465 698 474T708 483Q722 483 722 452Q722 386 675 338T555 289Q514 289 468 310T388 357T308 404T224 426Q164 426 125 393T83 318Q81 289 69 289Q55 289 55 319ZM55 85Q55 126 72 159T114 210T163 238T205 248Q207 248 213 248T223 249Q262 249 296 234T393 179L443 147Q502 112 553 112Q609 112 649 141T694 220Q694 249 708 249T722 217Q722 153 675 104T555 55Q514 55 468 76T388 123T308 170T224 192Q164 192 125 159T83 84Q80 55 69 55Q55 55 55 85Z"></path><path stroke-width="1" id="E4-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E4-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E4-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E4-MJMATHI-6C" d="M117 59Q117 26 142 26Q179 26 205 131Q211 151 215 152Q217 153 225 153H229Q238 153 241 153T246 151T248 144Q247 138 245 128T234 90T214 43T183 6T137 -11Q101 -11 70 11T38 85Q38 97 39 102L104 360Q167 615 167 623Q167 626 166 628T162 632T157 634T149 635T141 636T132 637T122 637Q112 637 109 637T101 638T95 641T94 647Q94 649 96 661Q101 680 107 682T179 688Q194 689 213 690T243 693T254 694Q266 694 266 686Q266 675 193 386T118 83Q118 81 118 75T117 65V59Z"></path><path stroke-width="1" id="E4-MJMATHI-6F" d="M201 -11Q126 -11 80 38T34 156Q34 221 64 279T146 380Q222 441 301 441Q333 441 341 440Q354 437 367 433T402 417T438 387T464 338T476 268Q476 161 390 75T201 -11ZM121 120Q121 70 147 48T206 26Q250 26 289 58T351 142Q360 163 374 216T388 308Q388 352 370 375Q346 405 306 405Q243 405 195 347Q158 303 140 230T121 120Z"></path><path stroke-width="1" id="E4-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-43" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-32" x="1094" y="488"></use><g transform="translate(715,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-35" x="500" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-30" x="1001" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-30" x="1501" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-2248" x="2508" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-33" x="3565" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6D" x="4315" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-69" x="5194" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6C" x="5539" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6C" x="5838" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-69" x="6136" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6F" x="6482" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6E" x="6967" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-4">C_{2500}^{2} \approx 3\ million</script>。</p><h2><a name='header-n14' class='md-header-anchor '></a>8.2 神经网络和大脑(Neurons and the Brain)</h2><p>脑科学家通过对动物实验，发现大脑中专用于处理听觉信号的脑皮层也能处理其他诸如视觉等信号，即如果切断其与耳朵的联系，将其与眼睛相连，则这块负责听觉的脑皮层区域也能接受并处理视觉信号，从而学会“看”。脑科学家通过这类换源实验，就推论假设大脑的学习算法只有一种(“one learning algorithm” hypothesis)。那么如果能找出这种学习算法并应用于计算机中，那梦想中和人一样的人工智能就成真了。</p><p>神经网络就源于<strong>模拟人类大脑</strong>，但其需要的计算量很大。随着计算机硬件性能的提高，神经网络逐渐从衰落变为流行，如今已广泛地被应用在各行各业中。</p><p>下图是根据研究做的一些应用（有兴趣可回顾视频）：</p><p><img src='image/20180115_101441.png' alt='' /></p><p>BrainPort  系统：帮助失明人士通过摄像头以及舌尖感官“看”东西</p><p><img src='image/20180115_101442.png' alt='' /></p><p>触觉皮带：在朝北时蜂鸣器会发出声响，可使人拥有方向感（声音信号转换为方向信号）。</p><h2><a name='header-n29' class='md-header-anchor '></a>8.3 模型表示1(Model Representation I)</h2><p>既然神经网络模仿的是大脑神经元，那就先看一下大脑的神经元长什么样吧：</p><p><img src='image/20141213201613758.jpg' alt='来源: http://blog.csdn.net/zzwu/article/details/574931' /></p><p>想象一下印刷厂中流水线的工人（机器人也算哦），每个工人都有特定的任务，比如装订，塑封，贴防伪标识等等，工人们看到书本并处理完自己的任务后，就回放回传送带，紧接着传送带就传给下一个环节的工人，如此不断重复从而完成一个又一个环节，直到一本书印制完成。</p><p>那么类比一下，把上图中的<strong>细胞核(nucleus)</strong>类比成工人，<strong>轴突(axon)</strong>类比传送带，<strong>树突(dendrite)</strong>则比类比成工人的双眼。一个又一个细胞体，从树突接收需要处理的信息，对其进行处理后，再经由轴突通过电信号把处理完的信息传递出去，直到理解信息的内容。当然啦，我们大脑的实际上还要更为复杂，而且一个人的神经元数目就比地球上所有流水线的工人之和还要多呢~</p><p>人工神经网络中，树突对应<strong>输入(input)</strong>，细胞核对应<strong>激活单元(activation unit)</strong>，轴突对应<strong>输出(output)</strong>。</p><p>我们一般把神经网络划分为三部分（注意，不是只有三层！），即输入层(input layer)，隐藏层(hidden layer)和输出层(output layer)。</p><p><img src='image/20180116_001543.png' alt='' /></p><p>图中的一个圈表示神经网络中的一个激活单元，输入层对应输入单元，隐藏层对应中间单元，输出层则对应输出单元。中间激活单元应用<strong>激活函数</strong>(<a href='https://en.wikipedia.org/wiki/Activation_function'>activation_function</a>)处理数据。</p><p>下面列出一些已有概念在神经网络中的别称：</p><ul><li><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-9-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.384ex" height="1.76ex" viewBox="0 -504.6 1026.4 757.9" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E12-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E12-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-30" x="809" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-9">x_0</script>: 偏置单元(bias unit)，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-9-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.384ex" height="1.76ex" viewBox="0 -504.6 1026.4 757.9" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E12-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E12-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-30" x="809" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-9">x_0</script>=1</li><li><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E22-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E22-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-16">\theta</script>: 权重(weight)，即参数。</li><li>激活函数: <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-18-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.116ex" height="1.877ex" viewBox="0 -504.6 480.5 808.1" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E25-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E25-MJMATHI-67" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-18">g</script>，即逻辑函数等。</li><li>输入层: 对应于训练集中的特征 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-5-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E5-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E5-MJMATHI-78" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-5">x</script>。</li><li>输出层: 对应于训练集中的结果 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-29-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.155ex" height="1.877ex" viewBox="0 -504.6 497.5 808.1" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E36-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMATHI-79" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-29">y</script>。</li></ul><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-334-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.419ex" height="3.511ex" viewBox="0 -1107.7 1472 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E351-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E351-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E351-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E351-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E351-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMATHI-69" x="748" y="-430"></use></g></svg></span><script type="math/tex" id="MathJax-Element-334">a^{(j)}_i</script>: 第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.985ex" height="2.461ex" viewBox="-11.5 -755.9 424 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E48-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-41">j</script> 层的第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-40-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.802ex" height="1.994ex" viewBox="0 -755.9 345.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E47-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E47-MJMATHI-69" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-40">i</script> 个激活单元</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-381-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.997ex" height="2.461ex" viewBox="0 -956.9 1721 1059.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E421-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E421-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E421-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E421-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-29" x="802" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-381">\Theta^{(j)}</script>: 从第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.985ex" height="2.461ex" viewBox="-11.5 -755.9 424 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E48-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-41">j</script> 层映射到第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-360-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.988ex" height="2.461ex" viewBox="-11.5 -755.9 2147.4 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E387-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E387-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E387-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMATHI-6A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-2B" x="634" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-31" x="1635" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-360">j+1</script> 层时的权重矩阵。</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-704-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.235ex" height="3.395ex" viewBox="0 -1107.7 1823.5 1461.5" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E885-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E885-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E885-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E885-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E885-MJMATHI-76" d="M173 380Q173 405 154 405Q130 405 104 376T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Q21 294 29 316T53 368T97 419T160 441Q202 441 225 417T249 361Q249 344 246 335Q246 329 231 291T200 202T182 113Q182 86 187 69Q200 26 250 26Q287 26 319 60T369 139T398 222T409 277Q409 300 401 317T383 343T365 361T357 383Q357 405 376 424T417 443Q436 443 451 425T467 367Q467 340 455 284T418 159T347 40T241 -11Q177 -11 139 22Q102 54 102 117Q102 148 110 181T151 298Q173 362 173 380Z"></path><path stroke-width="1" id="E885-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E885-MJMATHI-75" d="M21 287Q21 295 30 318T55 370T99 420T158 442Q204 442 227 417T250 358Q250 340 216 246T182 105Q182 62 196 45T238 27T291 44T328 78L339 95Q341 99 377 247Q407 367 413 387T427 416Q444 431 463 431Q480 431 488 421T496 402L420 84Q419 79 419 68Q419 43 426 35T447 26Q469 29 482 57T512 145Q514 153 532 153Q551 153 551 144Q550 139 549 130T540 98T523 55T498 17T462 -8Q454 -10 438 -10Q372 -10 347 46Q345 45 336 36T318 21T296 6T267 -6T233 -11Q189 -11 155 7Q103 38 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMAIN-29" x="802" y="0"></use></g><g transform="translate(778,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMATHI-76" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMAIN-2C" x="485" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMATHI-75" x="764" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-704">\Theta^{(j)}_{v,u}</script>: 从第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.985ex" height="2.461ex" viewBox="-11.5 -755.9 424 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E48-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-41">j</script> 层的第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-510-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E595-MJMATHI-75" d="M21 287Q21 295 30 318T55 370T99 420T158 442Q204 442 227 417T250 358Q250 340 216 246T182 105Q182 62 196 45T238 27T291 44T328 78L339 95Q341 99 377 247Q407 367 413 387T427 416Q444 431 463 431Q480 431 488 421T496 402L420 84Q419 79 419 68Q419 43 426 35T447 26Q469 29 482 57T512 145Q514 153 532 153Q551 153 551 144Q550 139 549 130T540 98T523 55T498 17T462 -8Q454 -10 438 -10Q372 -10 347 46Q345 45 336 36T318 21T296 6T267 -6T233 -11Q189 -11 155 7Q103 38 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E595-MJMATHI-75" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-510">u</script> 个单元映射到第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-360-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.988ex" height="2.461ex" viewBox="-11.5 -755.9 2147.4 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E387-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E387-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E387-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMATHI-6A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-2B" x="634" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-31" x="1635" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-360">j+1</script> 层的第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-514-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.128ex" height="1.41ex" viewBox="0 -504.6 485.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E601-MJMATHI-76" d="M173 380Q173 405 154 405Q130 405 104 376T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Q21 294 29 316T53 368T97 419T160 441Q202 441 225 417T249 361Q249 344 246 335Q246 329 231 291T200 202T182 113Q182 86 187 69Q200 26 250 26Q287 26 319 60T369 139T398 222T409 277Q409 300 401 317T383 343T365 361T357 383Q357 405 376 424T417 443Q436 443 451 425T467 367Q467 340 455 284T418 159T347 40T241 -11Q177 -11 139 22Q102 54 102 117Q102 148 110 181T151 298Q173 362 173 380Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E601-MJMATHI-76" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-514">v</script> 个单元的权重</p></blockquote><p>注意：</p><ul><li>符号较多，记不住可随时回顾！</li><li><strong>每个单元会作用于下一层的所有单元</strong>（矩阵乘法运算）。</li><li>如果第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.985ex" height="2.461ex" viewBox="-11.5 -755.9 424 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E48-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-41">j</script> 层有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-363-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2ex" height="1.994ex" viewBox="0 -504.6 861.2 858.4" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E391-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E391-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E391-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E391-MJMATHI-6A" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-363">s_j</script> 个单元，第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-360-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.988ex" height="2.461ex" viewBox="-11.5 -755.9 2147.4 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E387-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E387-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E387-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMATHI-6A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-2B" x="634" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-31" x="1635" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-360">j+1</script> 层有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-375-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.101ex" height="1.994ex" viewBox="0 -504.6 1765.6 858.4" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E405-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E405-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E405-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E405-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E405-MJMATHI-73" x="0" y="0"></use><g transform="translate(469,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E405-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E405-MJMAIN-2B" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E405-MJMAIN-31" x="1191" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-375">s_{j+1}</script> 个单元，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-381-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.997ex" height="2.461ex" viewBox="0 -956.9 1721 1059.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E421-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E421-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E421-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E421-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-29" x="802" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-381">\Theta^{(j)}</script> 是一个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-520-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="14.753ex" height="2.694ex" viewBox="0 -806.1 6352.1 1160" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E610-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E610-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E610-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E610-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E610-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E610-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E610-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMATHI-73" x="0" y="0"></use><g transform="translate(469,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-2B" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-31" x="1191" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-D7" x="1987" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-28" x="2988" y="0"></use><g transform="translate(3378,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-2B" x="4461" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-31" x="5462" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-29" x="5962" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-520">s_{j+1} \times (s_j+1)</script> 维的权重矩阵。即每一层的权重矩阵大小都是非固定的。</li><li>其中，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-432-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.971ex" height="2.11ex" viewBox="0 -755.9 1279 908.7" role="img" focusable="false" style="vertical-align: -0.355ex;"><defs><path stroke-width="1" id="E491-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E491-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E491-MJMAIN-2B" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E491-MJMAIN-31" x="778" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-432">+1</script> 来自于偏置单元，这样意味着输出层不包含偏置单元，输入层和隐藏层需要增加偏置单元。</li></ul><p>&nbsp;</p><p>依据本节所给模型，有：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-467-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="36.54ex" height="3.044ex" viewBox="0 -956.9 15732.4 1310.7" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E539-MJMATHI-53" d="M308 24Q367 24 416 76T466 197Q466 260 414 284Q308 311 278 321T236 341Q176 383 176 462Q176 523 208 573T273 648Q302 673 343 688T407 704H418H425Q521 704 564 640Q565 640 577 653T603 682T623 704Q624 704 627 704T632 705Q645 705 645 698T617 577T585 459T569 456Q549 456 549 465Q549 471 550 475Q550 478 551 494T553 520Q553 554 544 579T526 616T501 641Q465 662 419 662Q362 662 313 616T263 510Q263 480 278 458T319 427Q323 425 389 408T456 390Q490 379 522 342T554 242Q554 216 546 186Q541 164 528 137T492 78T426 18T332 -20Q320 -22 298 -22Q199 -22 144 33L134 44L106 13Q83 -14 78 -18T65 -22Q52 -22 52 -14Q52 -11 110 221Q112 227 130 227H143Q149 221 149 216Q149 214 148 207T144 186T142 153Q144 114 160 87T203 47T255 29T308 24Z"></path><path stroke-width="1" id="E539-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E539-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E539-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E539-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E539-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E539-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E539-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E539-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E539-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E539-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E539-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E539-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E539-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E539-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMATHI-53" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMATHI-69" x="645" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMATHI-7A" x="991" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMATHI-65" x="1459" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-28" x="1926" y="0"></use><g transform="translate(2315,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-29" x="4098" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-3D" x="4766" y="0"></use><g transform="translate(5822,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMATHI-73" x="0" y="0"></use><g transform="translate(469,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-2B" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-31" x="1191" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-D7" x="7810" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-28" x="8810" y="0"></use><g transform="translate(9200,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-2B" x="10283" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-31" x="11284" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-29" x="11784" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-3D" x="12452" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-33" x="13508" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-D7" x="14231" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E539-MJMAIN-34" x="15231" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-467">Size(\Theta^{(1)})=s_{j+1} \times (s_j + 1) = 3 \times 4</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-492-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="36.54ex" height="3.044ex" viewBox="0 -956.9 15732.4 1310.7" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E569-MJMATHI-53" d="M308 24Q367 24 416 76T466 197Q466 260 414 284Q308 311 278 321T236 341Q176 383 176 462Q176 523 208 573T273 648Q302 673 343 688T407 704H418H425Q521 704 564 640Q565 640 577 653T603 682T623 704Q624 704 627 704T632 705Q645 705 645 698T617 577T585 459T569 456Q549 456 549 465Q549 471 550 475Q550 478 551 494T553 520Q553 554 544 579T526 616T501 641Q465 662 419 662Q362 662 313 616T263 510Q263 480 278 458T319 427Q323 425 389 408T456 390Q490 379 522 342T554 242Q554 216 546 186Q541 164 528 137T492 78T426 18T332 -20Q320 -22 298 -22Q199 -22 144 33L134 44L106 13Q83 -14 78 -18T65 -22Q52 -22 52 -14Q52 -11 110 221Q112 227 130 227H143Q149 221 149 216Q149 214 148 207T144 186T142 153Q144 114 160 87T203 47T255 29T308 24Z"></path><path stroke-width="1" id="E569-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E569-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E569-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E569-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E569-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E569-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E569-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E569-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E569-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E569-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E569-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E569-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E569-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E569-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMATHI-53" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMATHI-69" x="645" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMATHI-7A" x="991" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMATHI-65" x="1459" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-28" x="1926" y="0"></use><g transform="translate(2315,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-29" x="4098" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-3D" x="4766" y="0"></use><g transform="translate(5822,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMATHI-73" x="0" y="0"></use><g transform="translate(469,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-2B" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-31" x="1191" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-D7" x="7810" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-28" x="8810" y="0"></use><g transform="translate(9200,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-2B" x="10283" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-31" x="11284" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-29" x="11784" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-3D" x="12452" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-31" x="13508" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-D7" x="14231" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E569-MJMAIN-34" x="15231" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-492">Size(\Theta^{(2)})=s_{j+1} \times (s_j + 1) = 1 \times 4</script></p><h2><a name='header-n102' class='md-header-anchor '></a>8.4 模型表示2(Model Representation II)</h2><blockquote><p>神经网络中的符号较多，易乱，建议多看几遍多回顾。</p></blockquote><p><img src='image/20180116_001543.png' alt='' /></p><p>对第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-215-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E223-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E223-MJMAIN-31" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-215">1</script> 层的所有激活单元应用激活函数，从而得到第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-542-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E639-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E639-MJMAIN-32" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-542">2</script> 层激活单元的值：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-439-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="44.952ex" height="11.449ex" viewBox="0 -2716 19354.3 4929.4" role="img" focusable="false" style="vertical-align: -5.141ex;"><defs><path stroke-width="1" id="E499-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E499-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E499-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E499-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E499-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E499-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E499-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E499-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E499-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E499-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E499-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E499-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,1561)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(5521,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="6770" y="0"></use><g transform="translate(7770,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(9554,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="10802" y="0"></use><g transform="translate(11803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(13586,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="14835" y="0"></use><g transform="translate(15836,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(17619,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="18645" y="0"></use></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(5521,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="6770" y="0"></use><g transform="translate(7770,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(9554,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="10802" y="0"></use><g transform="translate(11803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(13586,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="14835" y="0"></use><g transform="translate(15836,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(17619,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="18645" y="0"></use></g><g transform="translate(0,-1792)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="748" y="-434"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(5521,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="6770" y="0"></use><g transform="translate(7770,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(9554,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="10802" y="0"></use><g transform="translate(11803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(13586,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="14835" y="0"></use><g transform="translate(15836,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-307)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(17619,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="18645" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-439">\begin{align*} a_1^{(2)} = g(\Theta_{10}^{(1)}x_0 + \Theta_{11}^{(1)}x_1 + \Theta_{12}^{(1)}x_2 + \Theta_{13}^{(1)}x_3) \newline a_2^{(2)} = g(\Theta_{20}^{(1)}x_0 + \Theta_{21}^{(1)}x_1 + \Theta_{22}^{(1)}x_2 + \Theta_{23}^{(1)}x_3) \newline a_3^{(2)} = g(\Theta_{30}^{(1)}x_0 + \Theta_{31}^{(1)}x_1 + \Theta_{32}^{(1)}x_2 + \Theta_{33}^{(1)}x_3) \newline \end{align*}</script></p><p>对第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-542-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E639-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E639-MJMAIN-32" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-542">2</script> 层的所有激活单元应用激活函数，从而得到输出：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-440-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="58.016ex" height="3.511ex" viewBox="0 -1107.7 24979.1 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E501-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E501-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E501-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E501-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E501-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E501-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E501-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E501-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E501-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E501-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E501-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E501-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E501-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-3D" x="2856" y="0"></use><g transform="translate(3912,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-33" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-3D" x="5724" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-67" x="6780" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="7261" y="0"></use><g transform="translate(7650,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(9434,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-30" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-2B" x="11190" y="0"></use><g transform="translate(12191,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(13974,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-2B" x="15730" y="0"></use><g transform="translate(16731,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(18514,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-2B" x="20271" y="0"></use><g transform="translate(21272,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(23055,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-33" x="748" y="-434"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="24589" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-440">h_\Theta(x) = a_1^{(3)} = g(\Theta_{10}^{(2)}a_0^{(2)} + \Theta_{11}^{(2)}a_1^{(2)} + \Theta_{12}^{(2)}a_2^{(2)} + \Theta_{13}^{(2)}a_3^{(2)})</script></p><p>上面的计算过程被称为<strong>前向传播(Forward propagation)</strong>，即从输入层开始，一层一层地向下计算并传递结果。</p><p>&nbsp;</p><p>再回顾一下逻辑回归：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-628-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="36.851ex" height="3.044ex" viewBox="0 -906.7 15866.6 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E769-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E769-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E769-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E769-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E769-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E769-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E769-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E769-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E769-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E769-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E769-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E769-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E769-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E769-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-67" x="3860" y="0"></use><g transform="translate(4507,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-2B" x="1604" y="0"></use><g transform="translate(2604,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(3528,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-2B" x="4776" y="0"></use><g transform="translate(5777,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(6701,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-2B" x="7949" y="0"></use><g transform="translate(8950,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-33" x="663" y="-213"></use></g><g transform="translate(9873,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-32" x="809" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-31" x="809" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJSZ1-29" x="10900" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-628">{h_\theta}\left( x \right)=g\left( {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}+{\theta_{3}}x_{1}^{2} \right)</script></p><p>是不是除了符号表示，其他都完全一样？其实神经网络就好似回归模型，只不过输入变成了中间单元 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-652-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="16.469ex" height="3.511ex" viewBox="0 -1107.7 7090.7 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E809-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E809-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E809-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E809-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E809-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E809-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E809-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E809-MJMAIN-2026" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60ZM525 60Q525 84 542 102T585 120Q609 120 627 104T646 61Q646 36 629 18T586 0T543 17T525 60ZM972 60Q972 84 989 102T1032 120Q1056 120 1074 104T1093 61Q1093 36 1076 18T1033 0T990 17T972 60Z"></path><path stroke-width="1" id="E809-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-31" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-2C" x="1472" y="0"></use><g transform="translate(1917,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-32" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-2C" x="3389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-2026" x="3834" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-2C" x="5173" y="0"></use><g transform="translate(5618,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-6E" x="748" y="-212"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-652">a_1^{(j)}, a_2^{(j)}, \dots, a_n^{(j)}</script>。中间单元从输入向量 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-5-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E5-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E5-MJMATHI-78" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-5">x</script> 开始，下一层的每个单元对所有输入的信息通过最优化算法不断迭代计算，每个单元因为包含了前一层的所有单元值，那么每个单元都能依赖于权重与输入得出关于输入向量的更多信息，就好像是在给假设函数加多项式。</p><p>中间单元就好像是包含了更多信息的升级版输入参数，使用包含更多信息的中间单元，也能产生更好地预测。</p><p>&nbsp;</p><p><strong>向量化实现</strong></p><p>定义 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-790-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.316ex" height="12.383ex" viewBox="0 -2917 7455.3 5331.5" role="img" focusable="false" style="vertical-align: -5.608ex;"><defs><path stroke-width="1" id="E1022-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E1022-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1022-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1022-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1022-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1022-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1022-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1022-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1022-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1022-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1022-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-3D" x="3718" y="0"></use><g transform="translate(4774,0)"><g transform="translate(0,2850)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-3446.188741721854) scale(1,2.8112582781456954)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A3" x="0" y="-4555"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,2050)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-30" x="809" y="-213"></use></g><g transform="translate(0,650)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-31" x="809" y="-213"></use></g><g transform="translate(0,-750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-32" x="809" y="-213"></use></g><g transform="translate(0,-2150)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-33" x="809" y="-213"></use></g></g></g><g transform="translate(2012,2850)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-3446.188741721854) scale(1,2.8112582781456954)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A6" x="0" y="-4555"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-790">a^{(1)}=x=\left[ \begin{matrix}x_0\\ x_1 \\ x_2 \\ x_3 \end{matrix} \right]</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-810-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="34.617ex" height="11.916ex" viewBox="0 -2816.5 14904.3 5130.4" role="img" focusable="false" style="vertical-align: -5.374ex;"><defs><path stroke-width="1" id="E1057-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1057-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1057-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1057-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1057-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1057-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1057-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1057-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1057-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1057-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-3D" x="2061" y="0"></use><g transform="translate(3117,0)"><g transform="translate(0,2714)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-3175.9109848438047) scale(1,2.3630364591107873)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A3" x="0" y="-4285"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,1661)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(0,-1892)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-30" x="500" y="0"></use></g></g></g><g transform="translate(2768,0)"><g transform="translate(0,1661)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(0,-1892)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="500" y="0"></use></g></g></g><g transform="translate(5551,0)"><g transform="translate(0,1661)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(0,-1892)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32" x="500" y="0"></use></g></g></g><g transform="translate(8334,0)"><g transform="translate(0,1661)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(0,-1892)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-307)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33" x="500" y="0"></use></g></g></g></g><g transform="translate(11119,2714)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-3175.9109848438047) scale(1,2.3630364591107873)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A6" x="0" y="-4285"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-810">\Theta^{(1)}=\left[\begin{matrix}\Theta^{(1)}_{10}& \Theta^{(1)}_{11}& \Theta^{(1)}_{12}& \Theta^{(1)}_{13}\\ \Theta^{(1)}_{20}& \Theta^{(1)}_{21}& \Theta^{(1)}_{22}& \Theta^{(1)}_{23}\\ \Theta^{(1)}_{30}& \Theta^{(1)}_{31}& \Theta^{(1)}_{32} & \Theta^{(1)}_{33}\end{matrix}\right]</script>，</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-658-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.752ex" height="11.216ex" viewBox="0 -2665.7 5921.1 4828.9" role="img" focusable="false" style="vertical-align: -4.874ex; margin-bottom: -0.15ex;"><defs><path stroke-width="1" id="E816-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E816-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E816-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E816-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E816-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E816-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E816-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E816-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E816-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,1545)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-31" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-31" x="658" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="5212" y="0"></use></g><g transform="translate(0,-116)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="658" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="5212" y="0"></use></g><g transform="translate(0,-1776)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-33" x="748" y="-434"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-33" x="658" y="-434"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="5212" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-658">\begin{align*}a_1^{(2)} = g(z_1^{(2)}) \newline a_2^{(2)} = g(z_2^{(2)}) \newline a_3^{(2)} = g(z_3^{(2)}) \newline \end{align*}</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-811-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.788ex" height="11.682ex" viewBox="0 -2766.3 5936.5 5029.9" role="img" focusable="false" style="vertical-align: -5.258ex;"><defs><path stroke-width="1" id="E1059-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1059-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1059-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1059-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1059-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1059-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1059-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1059-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-3D" x="1751" y="0"></use><g transform="translate(2808,0)"><g transform="translate(0,2691)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-3129.3192039205233) scale(1,2.28576982408047)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A3" x="0" y="-4238"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,1638)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-31" x="658" y="-435"></use></g><g transform="translate(0,-123)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-31" x="658" y="-435"></use></g><g transform="translate(0,-1884)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-31" x="658" y="-435"></use></g></g></g><g transform="translate(2460,2691)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-3129.3192039205233) scale(1,2.28576982408047)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A6" x="0" y="-4238"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-811">z^{(2)}=\left[ \begin{matrix}z_1^{(2)}\\ z_1^{(2)} \\ z_1^{(2)}\end{matrix} \right]</script></p><p>则有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-846-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="26.74ex" height="2.928ex" viewBox="0 -956.9 11513 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1104-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E1104-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1104-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1104-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1104-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1104-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E1104-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1104-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1104-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="890" y="0"></use></g></g><g transform="translate(5521,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="7055" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-3D" x="7723" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-67" x="8779" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="9259" y="0"></use><g transform="translate(9649,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="11123" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-846">a^{(2)}= g(\Theta^{(1)}a^{(1)})=g(z^{(2)})</script></p><p>预测结果即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-831-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="35.827ex" height="2.928ex" viewBox="0 -956.9 15425.6 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1084-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1084-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1084-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1084-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1084-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1084-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1084-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E1084-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1084-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E1084-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1084-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-3D" x="2856" y="0"></use><g transform="translate(3912,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-33" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-3D" x="5724" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-67" x="6780" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="7261" y="0"></use><g transform="translate(7650,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="890" y="0"></use></g></g><g transform="translate(9434,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="10968" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-3D" x="11635" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-67" x="12691" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="13172" y="0"></use><g transform="translate(13561,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-33" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="15036" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-831">h_\Theta(x) = a^{(3)} = g(\Theta^{(2)}a^{(2)}) = g(z^{(3)})</script></p><p>&nbsp;</p><p>即有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-738-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="52.474ex" height="3.745ex" viewBox="0 -1107.7 22592.8 1612.3" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E948-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E948-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E948-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E948-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E948-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E948-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E948-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E948-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E948-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E948-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E948-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E948-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E948-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E948-MJMAIN-22EF" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250ZM525 250Q525 274 542 292T585 310Q609 310 627 294T646 251Q646 226 629 208T586 190T543 207T525 250ZM972 250Q972 274 989 292T1032 310Q1056 310 1074 294T1093 251Q1093 226 1076 208T1033 190T990 207T972 250Z"></path><path stroke-width="1" id="E948-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-69" x="658" y="-430"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-3D" x="1689" y="0"></use><g transform="translate(2746,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2C" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-30" x="624" y="0"></use></g></g><g transform="translate(5371,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-30" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2B" x="7970" y="0"></use><g transform="translate(8970,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2C" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="624" y="0"></use></g></g><g transform="translate(11596,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2B" x="14194" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-22EF" x="15195" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2B" x="16590" y="0"></use><g transform="translate(17590,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><g transform="translate(778,-304)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2C" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6E" x="624" y="0"></use></g></g><g transform="translate(20216,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6E" x="748" y="-212"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-738">z^{(j)}_i = \Theta^{(j-1)}_{i,0}a^{(j-1)}_{0}+ \Theta^{(j-1)}_{i,1}a^{(j-1)}_{1}+\dots+ \Theta^{(j-1)}_{i,n}a^{(j-1)}_{n}</script>，</p><p> <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-669-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.995ex" height="2.461ex" viewBox="0 -956.9 7747.8 1059.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E827-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E827-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E827-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E827-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E827-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E827-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E827-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E827-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E827-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-29" x="802" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-3D" x="1689" y="0"></use><g transform="translate(2746,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-29" x="2081" y="0"></use></g></g><g transform="translate(5371,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-29" x="2081" y="0"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-669">z^{(j)} = \Theta^{(j-1)}a^{(j-1)}</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-663-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.722ex" height="2.928ex" viewBox="0 -956.9 5477.5 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E821-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E821-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E821-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E821-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E821-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E821-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E821-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-29" x="802" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-3D" x="1749" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-67" x="2806" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-28" x="3286" y="0"></use><g transform="translate(3676,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-29" x="802" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-29" x="5088" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-663">a^{(j)} = g(z^{(j)})</script>，通过该式即可计算神经网络中每一层的值。</p><p>结果即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-761-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="39.45ex" height="2.928ex" viewBox="0 -956.9 16985.4 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E982-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E982-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E982-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E982-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E982-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E982-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E982-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E982-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E982-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E982-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E982-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E982-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-3D" x="2856" y="0"></use><g transform="translate(3912,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="802" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-3D" x="5662" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-67" x="6718" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="7199" y="0"></use><g transform="translate(7588,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="2081" y="0"></use></g></g><g transform="translate(10214,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="2081" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="12590" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-3D" x="13257" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-67" x="14313" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="14794" y="0"></use><g transform="translate(15183,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="802" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="16595" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-761">h_\Theta(x) = a^{(j)} = g(\Theta^{(j-1)}a^{(j-1)}) = g(z^{(j)})</script></p><p>扩展到所有样本实例：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-851-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="14.05ex" height="2.694ex" viewBox="0 -1057.4 6049.4 1160" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E1109-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1109-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1109-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1109-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1109-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1109-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1109-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1109-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E1109-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-3D" x="1751" y="0"></use><g transform="translate(2808,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,432)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-29" x="890" y="0"></use></g></g><g transform="translate(4591,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMATHI-54" x="1215" y="581"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-851">{{z}^{\left( 2 \right)}}={{\Theta }^{\left( 1 \right)}} {{X}^{T}}</script>，这时 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-894-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.424ex" height="2.461ex" viewBox="0 -956.9 1474.2 1059.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E1161-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1161-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1161-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1161-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1161-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1161-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1161-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1161-MJMAIN-29" x="890" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-894">z^{(2)}</script> 是一个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-914-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="7.025ex" height="1.76ex" viewBox="0 -554.9 3024.9 757.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E1193-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E1193-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1193-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E1193-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1193-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1193-MJMAIN-32" x="663" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1193-MJMAIN-D7" x="1145" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1193-MJMATHI-6D" x="2146" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-914">s_2 \times m</script> 维向量。</p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-110-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.04ex" height="1.41ex" viewBox="0 -504.6 878.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E118-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMATHI-6D" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-110">m</script>: 训练集中的样本实例数量</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-918-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="1.644ex" viewBox="0 -504.6 923.4 707.6" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E1198-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E1198-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1198-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1198-MJMAIN-32" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-918">s_2</script>: 第二层神经网络中激活单元的数量</p></blockquote><p>&nbsp;</p><p>当然，神经网络不仅限于三层，每层的激活单元数量也并不固定：</p><p><img src='image/20180116_105545.png' alt='' /></p><h2><a name='header-n321' class='md-header-anchor '></a>8.5 例子和直观理解1(Examples and Intuitions I)</h2><h2><a name='header-n118' class='md-header-anchor '></a>8.6 例子和直观理解2(Examples and Intuitions II)</h2><h2><a name='header-n119' class='md-header-anchor '></a>8.7 多类别分类(Multiclass Classification)</h2></div>
+<div  id='write'  class = 'is-node show-fences-line-number'><div class='md-toc' mdtype='toc'><p class="md-toc-content"><span class="md-toc-item md-toc-h1" data-ref="n2"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n2">8 神经网络：表达(Neural Networks: Representation)</a></span><span class="md-toc-item md-toc-h2" data-ref="n3"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n3">8.1 非线性假设(Non-linear Hypotheses)</a></span><span class="md-toc-item md-toc-h2" data-ref="n14"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n14">8.2 神经网络和大脑(Neurons and the Brain)</a></span><span class="md-toc-item md-toc-h2" data-ref="n29"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n29">8.3 模型表示1(Model Representation I)</a></span><span class="md-toc-item md-toc-h2" data-ref="n94"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n94">8.4 模型表示2(Model Representation II)</a></span><span class="md-toc-item md-toc-h2" data-ref="n152"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n152">8.5 例子和直观理解1(Examples and Intuitions I)</a></span><span class="md-toc-item md-toc-h2" data-ref="n169"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n169">8.6 例子和直观理解2(Examples and Intuitions II)</a></span><span class="md-toc-item md-toc-h2" data-ref="n263"><a class="md-toc-inner" style="cursor: pointer;" href="#header-n263">8.7 多类别分类(Multiclass Classification)</a></span></p></div><h1><a name='header-n2' class='md-header-anchor '></a>8 神经网络：表达(Neural Networks: Representation)</h1><h2><a name='header-n3' class='md-header-anchor '></a>8.1 非线性假设(Non-linear Hypotheses)</h2><p>理论上我们可以用多项式函数去近似任意函数，从而可得到任意问题的拟合曲线，即泰勒极数(Taylor series)。</p><p>在实际处理时，特征量通常会很多，如果再构造高阶多项式等，特征数量将会急剧增加，这使得线性模型的复杂度太高，可见并不合适。神经网络无需构造高阶多项式，在特征量很大时也可以处理的很好。</p><p>那特征能有多大呢？下面是一个计算机视觉中的例子：</p><p><img src='image/20180115_084326.png' alt='' /></p><p>如上图，如果选取一小块 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.845ex" height="1.994ex" viewBox="0 -755.9 2946.9 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E1-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E1-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1-MJMAIN-2217" d="M229 286Q216 420 216 436Q216 454 240 464Q241 464 245 464T251 465Q263 464 273 456T283 436Q283 419 277 356T270 286L328 328Q384 369 389 372T399 375Q412 375 423 365T435 338Q435 325 425 315Q420 312 357 282T289 250L355 219L425 184Q434 175 434 161Q434 146 425 136T401 125Q393 125 383 131T328 171L270 213Q283 79 283 63Q283 53 276 44T250 35Q231 35 224 44T216 63Q216 80 222 143T229 213L171 171Q115 130 110 127Q106 124 100 124Q87 124 76 134T64 161Q64 166 64 169T67 175T72 181T81 188T94 195T113 204T138 215T170 230T210 250L74 315Q65 324 65 338Q65 353 74 363T98 374Q106 374 116 368T171 328L229 286Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-35"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-30" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-2217" x="1223" y="0"></use><g transform="translate(1945,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-35"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1-MJMAIN-30" x="500" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1">50 * 50</script> 像素的灰度图片（一个像素只有亮度一个值），选择每个像素点作为特征，则特征总量 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-2-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.143ex" height="1.994ex" viewBox="0 -755.9 3936.6 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E2-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E2-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E2-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E2-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E2-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMATHI-6E" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-3D" x="878" y="0"></use><g transform="translate(1934,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-35" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E2-MJMAIN-30" x="1501" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-2">n=2500</script>（换成 RGB（一个像素有三个值），则 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-3-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="9.143ex" height="1.994ex" viewBox="0 -755.9 3936.6 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E3-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E3-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E3-MJMAIN-37" d="M55 458Q56 460 72 567L88 674Q88 676 108 676H128V672Q128 662 143 655T195 646T364 644H485V605L417 512Q408 500 387 472T360 435T339 403T319 367T305 330T292 284T284 230T278 162T275 80Q275 66 275 52T274 28V19Q270 2 255 -10T221 -22Q210 -22 200 -19T179 0T168 40Q168 198 265 368Q285 400 349 489L395 552H302Q128 552 119 546Q113 543 108 522T98 479L95 458V455H55V458Z"></path><path stroke-width="1" id="E3-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E3-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMATHI-6E" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-3D" x="878" y="0"></use><g transform="translate(1934,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-37"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-35" x="500" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-30" x="1001" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E3-MJMAIN-30" x="1501" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-3">n = 7500</script>），如果将其两两组合作为新特征，则特征数量将为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-4-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.578ex" height="3.044ex" viewBox="0 -906.7 7568.2 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E4-MJMATHI-43" d="M50 252Q50 367 117 473T286 641T490 704Q580 704 633 653Q642 643 648 636T656 626L657 623Q660 623 684 649Q691 655 699 663T715 679T725 690L740 705H746Q760 705 760 698Q760 694 728 561Q692 422 692 421Q690 416 687 415T669 413H653Q647 419 647 422Q647 423 648 429T650 449T651 481Q651 552 619 605T510 659Q484 659 454 652T382 628T299 572T226 479Q194 422 175 346T156 222Q156 108 232 58Q280 24 350 24Q441 24 512 92T606 240Q610 253 612 255T628 257Q648 257 648 248Q648 243 647 239Q618 132 523 55T319 -22Q206 -22 128 53T50 252Z"></path><path stroke-width="1" id="E4-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E4-MJMAIN-35" d="M164 157Q164 133 148 117T109 101H102Q148 22 224 22Q294 22 326 82Q345 115 345 210Q345 313 318 349Q292 382 260 382H254Q176 382 136 314Q132 307 129 306T114 304Q97 304 95 310Q93 314 93 485V614Q93 664 98 664Q100 666 102 666Q103 666 123 658T178 642T253 634Q324 634 389 662Q397 666 402 666Q410 666 410 648V635Q328 538 205 538Q174 538 149 544L139 546V374Q158 388 169 396T205 412T256 420Q337 420 393 355T449 201Q449 109 385 44T229 -22Q148 -22 99 32T50 154Q50 178 61 192T84 210T107 214Q132 214 148 197T164 157Z"></path><path stroke-width="1" id="E4-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E4-MJMAIN-2248" d="M55 319Q55 360 72 393T114 444T163 472T205 482Q207 482 213 482T223 483Q262 483 296 468T393 413L443 381Q502 346 553 346Q609 346 649 375T694 454Q694 465 698 474T708 483Q722 483 722 452Q722 386 675 338T555 289Q514 289 468 310T388 357T308 404T224 426Q164 426 125 393T83 318Q81 289 69 289Q55 289 55 319ZM55 85Q55 126 72 159T114 210T163 238T205 248Q207 248 213 248T223 249Q262 249 296 234T393 179L443 147Q502 112 553 112Q609 112 649 141T694 220Q694 249 708 249T722 217Q722 153 675 104T555 55Q514 55 468 76T388 123T308 170T224 192Q164 192 125 159T83 84Q80 55 69 55Q55 55 55 85Z"></path><path stroke-width="1" id="E4-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E4-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E4-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E4-MJMATHI-6C" d="M117 59Q117 26 142 26Q179 26 205 131Q211 151 215 152Q217 153 225 153H229Q238 153 241 153T246 151T248 144Q247 138 245 128T234 90T214 43T183 6T137 -11Q101 -11 70 11T38 85Q38 97 39 102L104 360Q167 615 167 623Q167 626 166 628T162 632T157 634T149 635T141 636T132 637T122 637Q112 637 109 637T101 638T95 641T94 647Q94 649 96 661Q101 680 107 682T179 688Q194 689 213 690T243 693T254 694Q266 694 266 686Q266 675 193 386T118 83Q118 81 118 75T117 65V59Z"></path><path stroke-width="1" id="E4-MJMATHI-6F" d="M201 -11Q126 -11 80 38T34 156Q34 221 64 279T146 380Q222 441 301 441Q333 441 341 440Q354 437 367 433T402 417T438 387T464 338T476 268Q476 161 390 75T201 -11ZM121 120Q121 70 147 48T206 26Q250 26 289 58T351 142Q360 163 374 216T388 308Q388 352 370 375Q346 405 306 405Q243 405 195 347Q158 303 140 230T121 120Z"></path><path stroke-width="1" id="E4-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-43" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-32" x="1094" y="488"></use><g transform="translate(715,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-35" x="500" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-30" x="1001" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-30" x="1501" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-2248" x="2508" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMAIN-33" x="3565" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6D" x="4315" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-69" x="5194" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6C" x="5539" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6C" x="5838" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-69" x="6136" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6F" x="6482" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E4-MJMATHI-6E" x="6967" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-4">C_{2500}^{2} \approx 3\ million</script>。</p><h2><a name='header-n14' class='md-header-anchor '></a>8.2 神经网络和大脑(Neurons and the Brain)</h2><p>脑科学家通过对动物实验，发现大脑中专用于处理听觉信号的脑皮层也能处理其他诸如视觉等信号，即如果切断其与耳朵的联系，将其与眼睛相连，则这块负责听觉的脑皮层区域也能接受并处理视觉信号，从而学会“看”。脑科学家通过这类换源实验，就推论假设大脑的学习算法只有一种(“one learning algorithm” hypothesis)。那么如果能找出这种学习算法并应用于计算机中，那梦想中和人一样的人工智能就成真了。</p><p>神经网络就源于<strong>模拟人类大脑</strong>，但其需要的计算量很大。随着计算机硬件性能的提高，神经网络逐渐从衰落变为流行，如今已广泛地被应用在各行各业中。</p><p>下图是根据研究做的一些应用（有兴趣可回顾视频）：</p><p><img src='image/20180115_101441.png' alt='' /></p><p>BrainPort  系统：帮助失明人士通过摄像头以及舌尖感官“看”东西</p><p><img src='image/20180115_101442.png' alt='' /></p><p>触觉皮带：在朝北时蜂鸣器会发出声响，可使人拥有方向感（声音信号转换为方向信号）。</p><h2><a name='header-n29' class='md-header-anchor '></a>8.3 模型表示1(Model Representation I)</h2><p>既然神经网络模仿的是大脑神经元，那就先看一下大脑的神经元长什么样吧：</p><p><img src='image/20141213201613758.jpg' alt='来源: http://blog.csdn.net/zzwu/article/details/574931' /></p><p>想象一下印刷厂中流水线的工人（机器人也算哦），每个工人都有特定的任务，比如装订，塑封，贴防伪标识等等，工人们看到书本并处理完自己的任务后，就回放回传送带，紧接着传送带就传给下一个环节的工人，如此不断重复从而完成一个又一个环节，直到一本书印制完成。</p><p>那么类比一下，把上图中的<strong>细胞核(nucleus)</strong>类比成工人，<strong>轴突(axon)</strong>类比传送带，<strong>树突(dendrite)</strong>则比类比成工人的双眼。一个又一个细胞体，从树突接收需要处理的信息，对其进行处理后，再经由轴突通过电信号把处理完的信息传递出去，直到理解信息的内容。当然啦，我们大脑的实际上还要更为复杂，而且一个人的神经元数目就比地球上所有流水线的工人之和还要多呢~</p><p>人工神经网络中，树突对应<strong>输入(input)</strong>，细胞核对应<strong>激活单元(activation unit)</strong>，轴突对应<strong>输出(output)</strong>。</p><p>我们一般把神经网络划分为三部分（注意，不是只有三层！），即输入层(input layer)，隐藏层(hidden layer)和输出层(output layer)。</p><p><img src='image/20180116_001543.png' alt='' /></p><p>图中的一个圈表示神经网络中的一个激活单元，输入层对应输入单元，隐藏层对应中间单元，输出层则对应输出单元。中间激活单元应用<strong>激活函数</strong>(<a href='https://en.wikipedia.org/wiki/Activation_function'>activation_function</a>)处理数据。</p><p>下面列出一些已有概念在神经网络中的别称：</p><ul><li><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-9-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.384ex" height="1.76ex" viewBox="0 -504.6 1026.4 757.9" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E12-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E12-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-30" x="809" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-9">x_0</script>: 偏置单元(bias unit)，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-9-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.384ex" height="1.76ex" viewBox="0 -504.6 1026.4 757.9" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E12-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E12-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E12-MJMAIN-30" x="809" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-9">x_0</script>=1</li><li><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-16-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.09ex" height="2.11ex" viewBox="0 -806.1 469.5 908.7" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E22-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E22-MJMATHI-3B8" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-16">\theta</script>: 权重(weight)，即参数。</li><li>激活函数: <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-18-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.116ex" height="1.877ex" viewBox="0 -504.6 480.5 808.1" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E25-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E25-MJMATHI-67" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-18">g</script>，即逻辑函数等。</li><li>输入层: 对应于训练集中的特征 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-5-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E5-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E5-MJMATHI-78" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-5">x</script>。</li><li>输出层: 对应于训练集中的结果 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-29-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.155ex" height="1.877ex" viewBox="0 -504.6 497.5 808.1" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E36-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E36-MJMATHI-79" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-29">y</script>。</li></ul><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-334-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.419ex" height="3.511ex" viewBox="0 -1107.7 1472 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E351-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E351-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E351-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E351-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E351-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E351-MJMATHI-69" x="748" y="-430"></use></g></svg></span><script type="math/tex" id="MathJax-Element-334">a^{(j)}_i</script>: 第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.985ex" height="2.461ex" viewBox="-11.5 -755.9 424 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E48-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-41">j</script> 层的第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-40-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.802ex" height="1.994ex" viewBox="0 -755.9 345.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E47-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E47-MJMATHI-69" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-40">i</script> 个激活单元</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-381-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.997ex" height="2.461ex" viewBox="0 -956.9 1721 1059.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E421-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E421-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E421-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E421-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-29" x="802" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-381">\Theta^{(j)}</script>: 从第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.985ex" height="2.461ex" viewBox="-11.5 -755.9 424 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E48-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-41">j</script> 层映射到第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-360-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.988ex" height="2.461ex" viewBox="-11.5 -755.9 2147.4 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E387-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E387-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E387-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMATHI-6A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-2B" x="634" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-31" x="1635" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-360">j+1</script> 层时的权重矩阵。</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-704-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.235ex" height="3.395ex" viewBox="0 -1107.7 1823.5 1461.5" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E885-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E885-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E885-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E885-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E885-MJMATHI-76" d="M173 380Q173 405 154 405Q130 405 104 376T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Q21 294 29 316T53 368T97 419T160 441Q202 441 225 417T249 361Q249 344 246 335Q246 329 231 291T200 202T182 113Q182 86 187 69Q200 26 250 26Q287 26 319 60T369 139T398 222T409 277Q409 300 401 317T383 343T365 361T357 383Q357 405 376 424T417 443Q436 443 451 425T467 367Q467 340 455 284T418 159T347 40T241 -11Q177 -11 139 22Q102 54 102 117Q102 148 110 181T151 298Q173 362 173 380Z"></path><path stroke-width="1" id="E885-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E885-MJMATHI-75" d="M21 287Q21 295 30 318T55 370T99 420T158 442Q204 442 227 417T250 358Q250 340 216 246T182 105Q182 62 196 45T238 27T291 44T328 78L339 95Q341 99 377 247Q407 367 413 387T427 416Q444 431 463 431Q480 431 488 421T496 402L420 84Q419 79 419 68Q419 43 426 35T447 26Q469 29 482 57T512 145Q514 153 532 153Q551 153 551 144Q550 139 549 130T540 98T523 55T498 17T462 -8Q454 -10 438 -10Q372 -10 347 46Q345 45 336 36T318 21T296 6T267 -6T233 -11Q189 -11 155 7Q103 38 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMAIN-29" x="802" y="0"></use></g><g transform="translate(778,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMATHI-76" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMAIN-2C" x="485" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E885-MJMATHI-75" x="764" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-704">\Theta^{(j)}_{v,u}</script>: 从第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.985ex" height="2.461ex" viewBox="-11.5 -755.9 424 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E48-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-41">j</script> 层的第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-510-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E595-MJMATHI-75" d="M21 287Q21 295 30 318T55 370T99 420T158 442Q204 442 227 417T250 358Q250 340 216 246T182 105Q182 62 196 45T238 27T291 44T328 78L339 95Q341 99 377 247Q407 367 413 387T427 416Q444 431 463 431Q480 431 488 421T496 402L420 84Q419 79 419 68Q419 43 426 35T447 26Q469 29 482 57T512 145Q514 153 532 153Q551 153 551 144Q550 139 549 130T540 98T523 55T498 17T462 -8Q454 -10 438 -10Q372 -10 347 46Q345 45 336 36T318 21T296 6T267 -6T233 -11Q189 -11 155 7Q103 38 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E595-MJMATHI-75" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-510">u</script> 个单元映射到第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-360-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.988ex" height="2.461ex" viewBox="-11.5 -755.9 2147.4 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E387-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E387-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E387-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMATHI-6A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-2B" x="634" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-31" x="1635" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-360">j+1</script> 层的第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-514-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.128ex" height="1.41ex" viewBox="0 -504.6 485.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E601-MJMATHI-76" d="M173 380Q173 405 154 405Q130 405 104 376T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Q21 294 29 316T53 368T97 419T160 441Q202 441 225 417T249 361Q249 344 246 335Q246 329 231 291T200 202T182 113Q182 86 187 69Q200 26 250 26Q287 26 319 60T369 139T398 222T409 277Q409 300 401 317T383 343T365 361T357 383Q357 405 376 424T417 443Q436 443 451 425T467 367Q467 340 455 284T418 159T347 40T241 -11Q177 -11 139 22Q102 54 102 117Q102 148 110 181T151 298Q173 362 173 380Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E601-MJMATHI-76" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-514">v</script> 个单元的权重</p></blockquote><p>注意：</p><ul><li>符号较多，记不住可随时回顾！</li><li><strong>每个单元会作用于下一层的所有单元</strong>（矩阵乘法运算）。</li><li>如果第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-41-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0.985ex" height="2.461ex" viewBox="-11.5 -755.9 424 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E48-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E48-MJMATHI-6A" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-41">j</script> 层有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-363-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2ex" height="1.994ex" viewBox="0 -504.6 861.2 858.4" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E391-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E391-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E391-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E391-MJMATHI-6A" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-363">s_j</script> 个单元，第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-360-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.988ex" height="2.461ex" viewBox="-11.5 -755.9 2147.4 1059.4" role="img" focusable="false" style="vertical-align: -0.705ex; margin-left: -0.027ex;"><defs><path stroke-width="1" id="E387-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E387-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E387-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMATHI-6A" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-2B" x="634" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E387-MJMAIN-31" x="1635" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-360">j+1</script> 层有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-375-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="4.101ex" height="1.994ex" viewBox="0 -504.6 1765.6 858.4" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E405-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E405-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E405-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E405-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E405-MJMATHI-73" x="0" y="0"></use><g transform="translate(469,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E405-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E405-MJMAIN-2B" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E405-MJMAIN-31" x="1191" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-375">s_{j+1}</script> 个单元，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-381-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.997ex" height="2.461ex" viewBox="0 -956.9 1721 1059.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E421-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E421-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E421-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E421-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E421-MJMAIN-29" x="802" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-381">\Theta^{(j)}</script> 是一个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-520-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="14.753ex" height="2.694ex" viewBox="0 -806.1 6352.1 1160" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E610-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E610-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E610-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E610-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E610-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E610-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E610-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMATHI-73" x="0" y="0"></use><g transform="translate(469,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-2B" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-31" x="1191" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-D7" x="1987" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-28" x="2988" y="0"></use><g transform="translate(3378,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-2B" x="4461" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-31" x="5462" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E610-MJMAIN-29" x="5962" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-520">s_{j+1} \times (s_j+1)</script> 维的权重矩阵。即每一层的权重矩阵大小都是非固定的。</li><li>其中，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-432-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.971ex" height="2.11ex" viewBox="0 -755.9 1279 908.7" role="img" focusable="false" style="vertical-align: -0.355ex;"><defs><path stroke-width="1" id="E491-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E491-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E491-MJMAIN-2B" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E491-MJMAIN-31" x="778" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-432">+1</script> 来自于偏置单元，这样意味着输出层不包含偏置单元，输入层和隐藏层需要增加偏置单元。</li></ul><p>&nbsp;</p><p>依据本节所给模型，有：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-930-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="52.58ex" height="3.044ex" viewBox="0 -956.9 22638.7 1310.7" role="img" focusable="false" style="vertical-align: -0.822ex;"><defs><path stroke-width="1" id="E1214-MJMATHI-53" d="M308 24Q367 24 416 76T466 197Q466 260 414 284Q308 311 278 321T236 341Q176 383 176 462Q176 523 208 573T273 648Q302 673 343 688T407 704H418H425Q521 704 564 640Q565 640 577 653T603 682T623 704Q624 704 627 704T632 705Q645 705 645 698T617 577T585 459T569 456Q549 456 549 465Q549 471 550 475Q550 478 551 494T553 520Q553 554 544 579T526 616T501 641Q465 662 419 662Q362 662 313 616T263 510Q263 480 278 458T319 427Q323 425 389 408T456 390Q490 379 522 342T554 242Q554 216 546 186Q541 164 528 137T492 78T426 18T332 -20Q320 -22 298 -22Q199 -22 144 33L134 44L106 13Q83 -14 78 -18T65 -22Q52 -22 52 -14Q52 -11 110 221Q112 227 130 227H143Q149 221 149 216Q149 214 148 207T144 186T142 153Q144 114 160 87T203 47T255 29T308 24Z"></path><path stroke-width="1" id="E1214-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E1214-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1214-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E1214-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1214-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1214-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1214-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1214-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1214-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E1214-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E1214-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E1214-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E1214-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1214-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1214-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-53" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-69" x="645" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-7A" x="991" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-65" x="1459" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-28" x="1926" y="0"></use><g transform="translate(2315,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-29" x="4098" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-3D" x="4766" y="0"></use><g transform="translate(5822,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-73" x="0" y="0"></use><g transform="translate(469,-150)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-6A" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-2B" x="412" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-31" x="1191" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-D7" x="7810" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-28" x="8810" y="0"></use><g transform="translate(9200,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-6A" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-2B" x="10283" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-31" x="11284" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-29" x="11784" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-3D" x="12452" y="0"></use><g transform="translate(13508,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-32" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-D7" x="14654" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-28" x="15654" y="0"></use><g transform="translate(16044,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-31" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-2B" x="17189" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-31" x="18190" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-29" x="18691" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-3D" x="19358" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-33" x="20414" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-D7" x="21137" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1214-MJMAIN-34" x="22138" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-930">Size(\Theta^{(1)})=s_{j+1} \times (s_j + 1) =s_2 \times (s_1 + 1) = 3 \times 4</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-927-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="34.729ex" height="2.928ex" viewBox="0 -956.9 14952.5 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1209-MJMATHI-53" d="M308 24Q367 24 416 76T466 197Q466 260 414 284Q308 311 278 321T236 341Q176 383 176 462Q176 523 208 573T273 648Q302 673 343 688T407 704H418H425Q521 704 564 640Q565 640 577 653T603 682T623 704Q624 704 627 704T632 705Q645 705 645 698T617 577T585 459T569 456Q549 456 549 465Q549 471 550 475Q550 478 551 494T553 520Q553 554 544 579T526 616T501 641Q465 662 419 662Q362 662 313 616T263 510Q263 480 278 458T319 427Q323 425 389 408T456 390Q490 379 522 342T554 242Q554 216 546 186Q541 164 528 137T492 78T426 18T332 -20Q320 -22 298 -22Q199 -22 144 33L134 44L106 13Q83 -14 78 -18T65 -22Q52 -22 52 -14Q52 -11 110 221Q112 227 130 227H143Q149 221 149 216Q149 214 148 207T144 186T142 153Q144 114 160 87T203 47T255 29T308 24Z"></path><path stroke-width="1" id="E1209-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E1209-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1209-MJMATHI-65" d="M39 168Q39 225 58 272T107 350T174 402T244 433T307 442H310Q355 442 388 420T421 355Q421 265 310 237Q261 224 176 223Q139 223 138 221Q138 219 132 186T125 128Q125 81 146 54T209 26T302 45T394 111Q403 121 406 121Q410 121 419 112T429 98T420 82T390 55T344 24T281 -1T205 -11Q126 -11 83 42T39 168ZM373 353Q367 405 305 405Q272 405 244 391T199 357T170 316T154 280T149 261Q149 260 169 260Q282 260 327 284T373 353Z"></path><path stroke-width="1" id="E1209-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1209-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1209-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1209-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1209-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1209-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E1209-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1209-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E1209-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E1209-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1209-MJMAIN-34" d="M462 0Q444 3 333 3Q217 3 199 0H190V46H221Q241 46 248 46T265 48T279 53T286 61Q287 63 287 115V165H28V211L179 442Q332 674 334 675Q336 677 355 677H373L379 671V211H471V165H379V114Q379 73 379 66T385 54Q393 47 442 46H471V0H462ZM293 211V545L74 212L183 211H293Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMATHI-53" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMATHI-69" x="645" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMATHI-7A" x="991" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMATHI-65" x="1459" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-28" x="1926" y="0"></use><g transform="translate(2315,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-29" x="4098" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-3D" x="4766" y="0"></use><g transform="translate(5822,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-33" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-D7" x="6967" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-28" x="7968" y="0"></use><g transform="translate(8358,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-32" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-2B" x="9503" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-31" x="10504" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-29" x="11005" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-3D" x="11672" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-31" x="12728" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-D7" x="13451" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1209-MJMAIN-34" x="14452" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-927">Size(\Theta^{(2)})=s_3 \times (s_2 + 1) = 1 \times 4</script></p><h2><a name='header-n94' class='md-header-anchor '></a>8.4 模型表示2(Model Representation II)</h2><p><img src='image/20180116_001543.png' alt='' /></p><p>对第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-215-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E223-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E223-MJMAIN-31" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-215">1</script> 层的所有激活单元应用激活函数，从而得到第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-542-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E639-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E639-MJMAIN-32" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-542">2</script> 层激活单元的值：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-439-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="44.952ex" height="11.449ex" viewBox="0 -2716 19354.3 4929.4" role="img" focusable="false" style="vertical-align: -5.141ex;"><defs><path stroke-width="1" id="E499-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E499-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E499-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E499-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E499-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E499-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E499-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E499-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E499-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E499-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E499-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E499-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,1561)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(5521,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="6770" y="0"></use><g transform="translate(7770,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(9554,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="10802" y="0"></use><g transform="translate(11803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(13586,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="14835" y="0"></use><g transform="translate(15836,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(17619,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="18645" y="0"></use></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(5521,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="6770" y="0"></use><g transform="translate(7770,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(9554,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="10802" y="0"></use><g transform="translate(11803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(13586,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="14835" y="0"></use><g transform="translate(15836,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(17619,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="18645" y="0"></use></g><g transform="translate(0,-1792)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="748" y="-434"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(5521,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-30" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="6770" y="0"></use><g transform="translate(7770,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(9554,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="10802" y="0"></use><g transform="translate(11803,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(13586,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-2B" x="14835" y="0"></use><g transform="translate(15836,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-307)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(17619,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-33" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E499-MJMAIN-29" x="18645" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-439">\begin{align*} a_1^{(2)} = g(\Theta_{10}^{(1)}x_0 + \Theta_{11}^{(1)}x_1 + \Theta_{12}^{(1)}x_2 + \Theta_{13}^{(1)}x_3) \newline a_2^{(2)} = g(\Theta_{20}^{(1)}x_0 + \Theta_{21}^{(1)}x_1 + \Theta_{22}^{(1)}x_2 + \Theta_{23}^{(1)}x_3) \newline a_3^{(2)} = g(\Theta_{30}^{(1)}x_0 + \Theta_{31}^{(1)}x_1 + \Theta_{32}^{(1)}x_2 + \Theta_{33}^{(1)}x_3) \newline \end{align*}</script></p><p>对第 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-542-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.162ex" height="1.994ex" viewBox="0 -755.9 500.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E639-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E639-MJMAIN-32" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-542">2</script> 层的所有激活单元应用激活函数，从而得到输出：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-440-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="58.016ex" height="3.511ex" viewBox="0 -1107.7 24979.1 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E501-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E501-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E501-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E501-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E501-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E501-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E501-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E501-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E501-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E501-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E501-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E501-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E501-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-3D" x="2856" y="0"></use><g transform="translate(3912,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-33" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-3D" x="5724" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-67" x="6780" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="7261" y="0"></use><g transform="translate(7650,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(9434,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-30" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-2B" x="11190" y="0"></use><g transform="translate(12191,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(13974,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-2B" x="15730" y="0"></use><g transform="translate(16731,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(18514,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-2B" x="20271" y="0"></use><g transform="translate(21272,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(23055,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-33" x="748" y="-434"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E501-MJMAIN-29" x="24589" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-440">h_\Theta(x) = a_1^{(3)} = g(\Theta_{10}^{(2)}a_0^{(2)} + \Theta_{11}^{(2)}a_1^{(2)} + \Theta_{12}^{(2)}a_2^{(2)} + \Theta_{13}^{(2)}a_3^{(2)})</script></p><p>上面的计算过程被称为<strong>前向传播(Forward propagation)</strong>，即从输入层开始，一层一层地向下计算并传递结果。</p><p>&nbsp;</p><p>再回顾一下逻辑回归：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-628-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="36.851ex" height="3.044ex" viewBox="0 -906.7 15866.6 1310.7" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E769-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E769-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E769-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E769-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E769-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E769-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E769-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E769-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E769-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E769-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E769-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E769-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E769-MJSZ1-28" d="M152 251Q152 646 388 850H416Q422 844 422 841Q422 837 403 816T357 753T302 649T255 482T236 250Q236 124 255 19T301 -147T356 -251T403 -315T422 -340Q422 -343 416 -349H388Q359 -325 332 -296T271 -213T212 -97T170 56T152 251Z"></path><path stroke-width="1" id="E769-MJSZ1-29" d="M305 251Q305 -145 69 -349H56Q43 -349 39 -347T35 -338Q37 -333 60 -307T108 -239T160 -136T204 27T221 250T204 473T160 636T108 740T60 807T35 839Q35 850 50 850H56H69Q197 743 256 566Q305 425 305 251Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="815" y="-219"></use><g transform="translate(1175,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-28" x="0" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-78" x="389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-29" x="962" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-3D" x="2804" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-67" x="3860" y="0"></use><g transform="translate(4507,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJSZ1-28"></use><g transform="translate(458,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-30" x="663" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-2B" x="1604" y="0"></use><g transform="translate(2604,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-31" x="663" y="-213"></use></g><g transform="translate(3528,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-2B" x="4776" y="0"></use><g transform="translate(5777,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-32" x="663" y="-213"></use></g><g transform="translate(6701,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-2B" x="7949" y="0"></use><g transform="translate(8950,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-3B8" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-33" x="663" y="-213"></use></g><g transform="translate(9873,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-32" x="809" y="488"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJMAIN-31" x="809" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E769-MJSZ1-29" x="10900" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-628">{h_\theta}\left( x \right)=g\left( {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}+{\theta_{3}}x_{1}^{2} \right)</script></p><p>是不是除了符号表示，其他都完全一样？其实神经网络就好似回归模型，只不过输入变成了中间单元 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-652-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="16.469ex" height="3.511ex" viewBox="0 -1107.7 7090.7 1511.8" role="img" focusable="false" style="vertical-align: -0.938ex;"><defs><path stroke-width="1" id="E809-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E809-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E809-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E809-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E809-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E809-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E809-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E809-MJMAIN-2026" d="M78 60Q78 84 95 102T138 120Q162 120 180 104T199 61Q199 36 182 18T139 0T96 17T78 60ZM525 60Q525 84 542 102T585 120Q609 120 627 104T646 61Q646 36 629 18T586 0T543 17T525 60ZM972 60Q972 84 989 102T1032 120Q1056 120 1074 104T1093 61Q1093 36 1076 18T1033 0T990 17T972 60Z"></path><path stroke-width="1" id="E809-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-31" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-2C" x="1472" y="0"></use><g transform="translate(1917,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-32" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-2C" x="3389" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-2026" x="3834" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-2C" x="5173" y="0"></use><g transform="translate(5618,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E809-MJMATHI-6E" x="748" y="-212"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-652">a_1^{(j)}, a_2^{(j)}, \dots, a_n^{(j)}</script>。从输入 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-5-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E5-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E5-MJMATHI-78" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-5">x</script> 开始，下一层的每个激活单元都包含了上一层的所有信息（单元值），通过最优化算法不断迭代计算，激活单元能得出关于输入 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-5-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.33ex" height="1.41ex" viewBox="0 -504.6 572.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E5-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E5-MJMATHI-78" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-5">x</script> 的更多信息，这就好像是在给假设函数加多项式。中间层的这些单元好似升级版的初始特征，从而能给出更好的预测。</p><p>&nbsp;</p><p><strong>向量化实现</strong></p><p>定义 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-790-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.316ex" height="12.383ex" viewBox="0 -2917 7455.3 5331.5" role="img" focusable="false" style="vertical-align: -5.608ex;"><defs><path stroke-width="1" id="E1022-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E1022-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1022-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1022-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1022-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1022-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1022-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1022-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1022-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1022-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1022-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E1022-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-3D" x="3718" y="0"></use><g transform="translate(4774,0)"><g transform="translate(0,2850)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-3446.188741721854) scale(1,2.8112582781456954)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A3" x="0" y="-4555"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,2050)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-30" x="809" y="-213"></use></g><g transform="translate(0,650)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-31" x="809" y="-213"></use></g><g transform="translate(0,-750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-32" x="809" y="-213"></use></g><g transform="translate(0,-2150)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJMAIN-33" x="809" y="-213"></use></g></g></g><g transform="translate(2012,2850)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-3446.188741721854) scale(1,2.8112582781456954)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1022-MJSZ4-23A6" x="0" y="-4555"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-790">a^{(1)}=x=\left[ \begin{matrix}x_0\\ x_1 \\ x_2 \\ x_3 \end{matrix} \right]</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-810-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="34.617ex" height="11.916ex" viewBox="0 -2816.5 14904.3 5130.4" role="img" focusable="false" style="vertical-align: -5.374ex;"><defs><path stroke-width="1" id="E1057-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1057-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1057-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1057-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1057-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1057-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1057-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1057-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1057-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1057-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E1057-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-3D" x="2061" y="0"></use><g transform="translate(3117,0)"><g transform="translate(0,2714)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-3175.9109848438047) scale(1,2.3630364591107873)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A3" x="0" y="-4285"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,1661)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(0,-1892)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-30" x="500" y="0"></use></g></g></g><g transform="translate(2768,0)"><g transform="translate(0,1661)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="500" y="0"></use></g></g><g transform="translate(0,-1892)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="500" y="0"></use></g></g></g><g transform="translate(5551,0)"><g transform="translate(0,1661)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32" x="500" y="0"></use></g></g><g transform="translate(0,-1892)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32" x="500" y="0"></use></g></g></g><g transform="translate(8334,0)"><g transform="translate(0,1661)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(0,-115)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-32"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33" x="500" y="0"></use></g></g><g transform="translate(0,-1892)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-29" x="890" y="0"></use></g><g transform="translate(778,-307)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJMAIN-33" x="500" y="0"></use></g></g></g></g><g transform="translate(11119,2714)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-3175.9109848438047) scale(1,2.3630364591107873)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1057-MJSZ4-23A6" x="0" y="-4285"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-810">\Theta^{(1)}=\left[\begin{matrix}\Theta^{(1)}_{10}& \Theta^{(1)}_{11}& \Theta^{(1)}_{12}& \Theta^{(1)}_{13}\\ \Theta^{(1)}_{20}& \Theta^{(1)}_{21}& \Theta^{(1)}_{22}& \Theta^{(1)}_{23}\\ \Theta^{(1)}_{30}& \Theta^{(1)}_{31}& \Theta^{(1)}_{32} & \Theta^{(1)}_{33}\end{matrix}\right]</script>，</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-658-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.752ex" height="11.216ex" viewBox="0 -2665.7 5921.1 4828.9" role="img" focusable="false" style="vertical-align: -4.874ex; margin-bottom: -0.15ex;"><defs><path stroke-width="1" id="E816-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E816-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E816-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E816-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E816-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E816-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E816-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E816-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E816-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,1545)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-31" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-31" x="658" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="5212" y="0"></use></g><g transform="translate(0,-116)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="748" y="-435"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="658" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="5212" y="0"></use></g><g transform="translate(0,-1776)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-33" x="748" y="-434"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-33" x="658" y="-434"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E816-MJMAIN-29" x="5212" y="0"></use></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-658">\begin{align*}a_1^{(2)} = g(z_1^{(2)}) \newline a_2^{(2)} = g(z_2^{(2)}) \newline a_3^{(2)} = g(z_3^{(2)}) \newline \end{align*}</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-811-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="13.788ex" height="11.682ex" viewBox="0 -2766.3 5936.5 5029.9" role="img" focusable="false" style="vertical-align: -5.258ex;"><defs><path stroke-width="1" id="E1059-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1059-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1059-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1059-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1059-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1059-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1059-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1059-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E1059-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-3D" x="1751" y="0"></use><g transform="translate(2808,0)"><g transform="translate(0,2691)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-3129.3192039205233) scale(1,2.28576982408047)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A3" x="0" y="-4238"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><g transform="translate(0,1638)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-31" x="658" y="-435"></use></g><g transform="translate(0,-123)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-31" x="658" y="-435"></use></g><g transform="translate(0,-1884)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-29" x="890" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJMAIN-31" x="658" y="-435"></use></g></g></g><g transform="translate(2460,2691)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-3129.3192039205233) scale(1,2.28576982408047)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1059-MJSZ4-23A6" x="0" y="-4238"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-811">z^{(2)}=\left[ \begin{matrix}z_1^{(2)}\\ z_1^{(2)} \\ z_1^{(2)}\end{matrix} \right]</script></p><p>则有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-846-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="26.74ex" height="2.928ex" viewBox="0 -956.9 11513 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1104-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E1104-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1104-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1104-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1104-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1104-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E1104-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1104-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1104-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="890" y="0"></use></g></g><g transform="translate(5521,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="7055" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-3D" x="7723" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-67" x="8779" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="9259" y="0"></use><g transform="translate(9649,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1104-MJMAIN-29" x="11123" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-846">a^{(2)}= g(\Theta^{(1)}a^{(1)})=g(z^{(2)})</script></p><p>预测结果即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-831-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="35.827ex" height="2.928ex" viewBox="0 -956.9 15425.6 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1084-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1084-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1084-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1084-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1084-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1084-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1084-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E1084-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1084-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E1084-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1084-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-3D" x="2856" y="0"></use><g transform="translate(3912,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-33" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-3D" x="5724" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-67" x="6780" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="7261" y="0"></use><g transform="translate(7650,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="890" y="0"></use></g></g><g transform="translate(9434,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="10968" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-3D" x="11635" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-67" x="12691" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="13172" y="0"></use><g transform="translate(13561,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-33" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1084-MJMAIN-29" x="15036" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-831">h_\Theta(x) = a^{(3)} = g(\Theta^{(2)}a^{(2)}) = g(z^{(3)})</script></p><p>&nbsp;</p><p>即有 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-738-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="52.474ex" height="3.745ex" viewBox="0 -1107.7 22592.8 1612.3" role="img" focusable="false" style="vertical-align: -1.172ex;"><defs><path stroke-width="1" id="E948-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E948-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E948-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E948-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E948-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E948-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E948-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E948-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E948-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E948-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E948-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E948-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E948-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E948-MJMAIN-22EF" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250ZM525 250Q525 274 542 292T585 310Q609 310 627 294T646 251Q646 226 629 208T586 190T543 207T525 250ZM972 250Q972 274 989 292T1032 310Q1056 310 1074 294T1093 251Q1093 226 1076 208T1033 190T990 207T972 250Z"></path><path stroke-width="1" id="E948-MJMATHI-6E" d="M21 287Q22 293 24 303T36 341T56 388T89 425T135 442Q171 442 195 424T225 390T231 369Q231 367 232 367L243 378Q304 442 382 442Q436 442 469 415T503 336T465 179T427 52Q427 26 444 26Q450 26 453 27Q482 32 505 65T540 145Q542 153 560 153Q580 153 580 145Q580 144 576 130Q568 101 554 73T508 17T439 -10Q392 -10 371 17T350 73Q350 92 386 193T423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 180T152 343Q153 348 153 366Q153 405 129 405Q91 405 66 305Q60 285 60 284Q58 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="802" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-69" x="658" y="-430"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-3D" x="1689" y="0"></use><g transform="translate(2746,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2C" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-30" x="624" y="0"></use></g></g><g transform="translate(5371,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-30" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2B" x="7970" y="0"></use><g transform="translate(8970,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><g transform="translate(778,-308)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2C" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="624" y="0"></use></g></g><g transform="translate(11596,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="748" y="-435"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2B" x="14194" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-22EF" x="15195" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2B" x="16590" y="0"></use><g transform="translate(17590,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><g transform="translate(778,-304)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-69" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2C" x="345" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6E" x="624" y="0"></use></g></g><g transform="translate(20216,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,521)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMAIN-29" x="2081" y="0"></use></g><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E948-MJMATHI-6E" x="748" y="-212"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-738">z^{(j)}_i = \Theta^{(j-1)}_{i,0}a^{(j-1)}_{0}+ \Theta^{(j-1)}_{i,1}a^{(j-1)}_{1}+\dots+ \Theta^{(j-1)}_{i,n}a^{(j-1)}_{n}</script>，</p><p> <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-669-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="17.995ex" height="2.461ex" viewBox="0 -956.9 7747.8 1059.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E827-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E827-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E827-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E827-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E827-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E827-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E827-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E827-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E827-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-29" x="802" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-3D" x="1689" y="0"></use><g transform="translate(2746,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-29" x="2081" y="0"></use></g></g><g transform="translate(5371,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E827-MJMAIN-29" x="2081" y="0"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-669">z^{(j)} = \Theta^{(j-1)}a^{(j-1)}</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-663-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="12.722ex" height="2.928ex" viewBox="0 -956.9 5477.5 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E821-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E821-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E821-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E821-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E821-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E821-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E821-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-29" x="802" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-3D" x="1749" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-67" x="2806" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-28" x="3286" y="0"></use><g transform="translate(3676,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-29" x="802" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E821-MJMAIN-29" x="5088" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-663">a^{(j)} = g(z^{(j)})</script>，通过该式即可计算神经网络中每一层的值。</p><p>结果即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-761-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="39.45ex" height="2.928ex" viewBox="0 -956.9 16985.4 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E982-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E982-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E982-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E982-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E982-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E982-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E982-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E982-MJMATHI-6A" d="M297 596Q297 627 318 644T361 661Q378 661 389 651T403 623Q403 595 384 576T340 557Q322 557 310 567T297 596ZM288 376Q288 405 262 405Q240 405 220 393T185 362T161 325T144 293L137 279Q135 278 121 278H107Q101 284 101 286T105 299Q126 348 164 391T252 441Q253 441 260 441T272 442Q296 441 316 432Q341 418 354 401T367 348V332L318 133Q267 -67 264 -75Q246 -125 194 -164T75 -204Q25 -204 7 -183T-12 -137Q-12 -110 7 -91T53 -71Q70 -71 82 -81T95 -112Q95 -148 63 -167Q69 -168 77 -168Q111 -168 139 -140T182 -74L193 -32Q204 11 219 72T251 197T278 308T289 365Q289 372 288 376Z"></path><path stroke-width="1" id="E982-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E982-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E982-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E982-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-3D" x="2856" y="0"></use><g transform="translate(3912,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="802" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-3D" x="5662" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-67" x="6718" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="7199" y="0"></use><g transform="translate(7588,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="2081" y="0"></use></g></g><g transform="translate(10214,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-2212" x="802" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-31" x="1580" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="2081" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="12590" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-3D" x="13257" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-67" x="14313" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="14794" y="0"></use><g transform="translate(15183,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMATHI-6A" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="802" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E982-MJMAIN-29" x="16595" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-761">h_\Theta(x) = a^{(j)} = g(\Theta^{(j-1)}a^{(j-1)}) = g(z^{(j)})</script></p><p>扩展到所有样本实例：</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-851-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="14.05ex" height="2.694ex" viewBox="0 -1057.4 6049.4 1160" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E1109-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1109-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1109-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1109-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1109-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1109-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1109-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1109-MJMATHI-58" d="M42 0H40Q26 0 26 11Q26 15 29 27Q33 41 36 43T55 46Q141 49 190 98Q200 108 306 224T411 342Q302 620 297 625Q288 636 234 637H206Q200 643 200 645T202 664Q206 677 212 683H226Q260 681 347 681Q380 681 408 681T453 682T473 682Q490 682 490 671Q490 670 488 658Q484 643 481 640T465 637Q434 634 411 620L488 426L541 485Q646 598 646 610Q646 628 622 635Q617 635 609 637Q594 637 594 648Q594 650 596 664Q600 677 606 683H618Q619 683 643 683T697 681T738 680Q828 680 837 683H845Q852 676 852 672Q850 647 840 637H824Q790 636 763 628T722 611T698 593L687 584Q687 585 592 480L505 384Q505 383 536 304T601 142T638 56Q648 47 699 46Q734 46 734 37Q734 35 732 23Q728 7 725 4T711 1Q708 1 678 1T589 2Q528 2 496 2T461 1Q444 1 444 10Q444 11 446 25Q448 35 450 39T455 44T464 46T480 47T506 54Q523 62 523 64Q522 64 476 181L429 299Q241 95 236 84Q232 76 232 72Q232 53 261 47Q262 47 267 47T273 46Q276 46 277 46T280 45T283 42T284 35Q284 26 282 19Q279 6 276 4T261 1Q258 1 243 1T201 2T142 2Q64 2 42 0Z"></path><path stroke-width="1" id="E1109-MJMATHI-54" d="M40 437Q21 437 21 445Q21 450 37 501T71 602L88 651Q93 669 101 677H569H659Q691 677 697 676T704 667Q704 661 687 553T668 444Q668 437 649 437Q640 437 637 437T631 442L629 445Q629 451 635 490T641 551Q641 586 628 604T573 629Q568 630 515 631Q469 631 457 630T439 622Q438 621 368 343T298 60Q298 48 386 46Q418 46 427 45T436 36Q436 31 433 22Q429 4 424 1L422 0Q419 0 415 0Q410 0 363 1T228 2Q99 2 64 0H49Q43 6 43 9T45 27Q49 40 55 46H83H94Q174 46 189 55Q190 56 191 56Q196 59 201 76T241 233Q258 301 269 344Q339 619 339 625Q339 630 310 630H279Q212 630 191 624Q146 614 121 583T67 467Q60 445 57 441T43 437H40Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-3D" x="1751" y="0"></use><g transform="translate(2808,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,432)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMAIN-29" x="890" y="0"></use></g></g><g transform="translate(4591,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMATHI-58" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1109-MJMATHI-54" x="1215" y="581"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-851">{{z}^{\left( 2 \right)}}={{\Theta }^{\left( 1 \right)}} {{X}^{T}}</script>，这时 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-894-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.424ex" height="2.461ex" viewBox="0 -956.9 1474.2 1059.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E1161-MJMATHI-7A" d="M347 338Q337 338 294 349T231 360Q211 360 197 356T174 346T162 335T155 324L153 320Q150 317 138 317Q117 317 117 325Q117 330 120 339Q133 378 163 406T229 440Q241 442 246 442Q271 442 291 425T329 392T367 375Q389 375 411 408T434 441Q435 442 449 442H462Q468 436 468 434Q468 430 463 420T449 399T432 377T418 358L411 349Q368 298 275 214T160 106L148 94L163 93Q185 93 227 82T290 71Q328 71 360 90T402 140Q406 149 409 151T424 153Q443 153 443 143Q443 138 442 134Q425 72 376 31T278 -11Q252 -11 232 6T193 40T155 57Q111 57 76 -3Q70 -11 59 -11H54H41Q35 -5 35 -2Q35 13 93 84Q132 129 225 214T340 322Q352 338 347 338Z"></path><path stroke-width="1" id="E1161-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1161-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1161-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1161-MJMATHI-7A" x="0" y="0"></use><g transform="translate(469,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1161-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1161-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1161-MJMAIN-29" x="890" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-894">z^{(2)}</script> 是一个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-914-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="7.025ex" height="1.76ex" viewBox="0 -554.9 3024.9 757.9" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E1193-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E1193-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1193-MJMAIN-D7" d="M630 29Q630 9 609 9Q604 9 587 25T493 118L389 222L284 117Q178 13 175 11Q171 9 168 9Q160 9 154 15T147 29Q147 36 161 51T255 146L359 250L255 354Q174 435 161 449T147 471Q147 480 153 485T168 490Q173 490 175 489Q178 487 284 383L389 278L493 382Q570 459 587 475T609 491Q630 491 630 471Q630 464 620 453T522 355L418 250L522 145Q606 61 618 48T630 29Z"></path><path stroke-width="1" id="E1193-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1193-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1193-MJMAIN-32" x="663" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1193-MJMAIN-D7" x="1145" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1193-MJMATHI-6D" x="2146" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-914">s_2 \times m</script> 维向量。</p><blockquote><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-110-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.04ex" height="1.41ex" viewBox="0 -504.6 878.5 607.1" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E118-MJMATHI-6D" d="M21 287Q22 293 24 303T36 341T56 388T88 425T132 442T175 435T205 417T221 395T229 376L231 369Q231 367 232 367L243 378Q303 442 384 442Q401 442 415 440T441 433T460 423T475 411T485 398T493 385T497 373T500 364T502 357L510 367Q573 442 659 442Q713 442 746 415T780 336Q780 285 742 178T704 50Q705 36 709 31T724 26Q752 26 776 56T815 138Q818 149 821 151T837 153Q857 153 857 145Q857 144 853 130Q845 101 831 73T785 17T716 -10Q669 -10 648 17T627 73Q627 92 663 193T700 345Q700 404 656 404H651Q565 404 506 303L499 291L466 157Q433 26 428 16Q415 -11 385 -11Q372 -11 364 -4T353 8T350 18Q350 29 384 161L420 307Q423 322 423 345Q423 404 379 404H374Q288 404 229 303L222 291L189 157Q156 26 151 16Q138 -11 108 -11Q95 -11 87 -5T76 7T74 17Q74 30 112 181Q151 335 151 342Q154 357 154 369Q154 405 129 405Q107 405 92 377T69 316T57 280Q55 278 41 278H27Q21 284 21 287Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E118-MJMATHI-6D" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-110">m</script>: 训练集中的样本实例数量</p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-918-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.145ex" height="1.644ex" viewBox="0 -504.6 923.4 707.6" role="img" focusable="false" style="vertical-align: -0.472ex;"><defs><path stroke-width="1" id="E1198-MJMATHI-73" d="M131 289Q131 321 147 354T203 415T300 442Q362 442 390 415T419 355Q419 323 402 308T364 292Q351 292 340 300T328 326Q328 342 337 354T354 372T367 378Q368 378 368 379Q368 382 361 388T336 399T297 405Q249 405 227 379T204 326Q204 301 223 291T278 274T330 259Q396 230 396 163Q396 135 385 107T352 51T289 7T195 -10Q118 -10 86 19T53 87Q53 126 74 143T118 160Q133 160 146 151T160 120Q160 94 142 76T111 58Q109 57 108 57T107 55Q108 52 115 47T146 34T201 27Q237 27 263 38T301 66T318 97T323 122Q323 150 302 164T254 181T195 196T148 231Q131 256 131 289Z"></path><path stroke-width="1" id="E1198-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1198-MJMATHI-73" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1198-MJMAIN-32" x="663" y="-213"></use></g></svg></span><script type="math/tex" id="MathJax-Element-918">s_2</script>: 第二层神经网络中激活单元的数量</p></blockquote><p>&nbsp;</p><p>当然，神经网络不仅限于三层，每层的激活单元数量也并不固定：</p><p><img src='image/20180116_105545.png' alt='' /></p><h2><a name='header-n152' class='md-header-anchor '></a>8.5 例子和直观理解1(Examples and Intuitions I)</h2><p>为了更好的理解神经网络，举例单层神经网络进行逻辑运算的例子。</p><p>下面的例子中，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1095-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.802ex" height="1.76ex" viewBox="0 -504.6 2498 757.9" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E1465-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1465-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1465-MJMAIN-2C" d="M78 35T78 60T94 103T137 121Q165 121 187 96T210 8Q210 -27 201 -60T180 -117T154 -158T130 -185T117 -194Q113 -194 104 -185T95 -172Q95 -168 106 -156T131 -126T157 -76T173 -3V9L172 8Q170 7 167 6T161 3T152 1T140 0Q113 0 96 17Z"></path><path stroke-width="1" id="E1465-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1465-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1465-MJMAIN-31" x="809" y="-213"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1465-MJMAIN-2C" x="1026" y="0"></use><g transform="translate(1471,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1465-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1465-MJMAIN-32" x="809" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1095">x_1,x_2</script> 为二进制数。</p><p>逻辑与(AND)运算（都为真值则结果才为真）神经网络：</p><p><img src='image/20180117_000612.png' alt='' /></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1042-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="22.703ex" height="2.928ex" viewBox="0 -956.9 9774.9 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1401-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1401-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1401-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1401-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1401-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1401-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1401-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E1401-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1401-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1401-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1401-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-3D" x="2061" y="0"></use><g transform="translate(3117,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-5B" x="0" y="0"></use><g transform="translate(445,0)"><g transform="translate(-15,0)"><g transform="translate(0,-50)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-2212" x="0" y="0"></use><g transform="translate(778,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-33"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-30" x="500" y="0"></use></g></g></g><g transform="translate(2764,0)"><g transform="translate(0,-50)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(4765,0)"><g transform="translate(0,-50)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-30" x="500" y="0"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1401-MJMAIN-5D" x="6379" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1042">\Theta^{(1)} =\begin{bmatrix}-30 & 20 & 20\end{bmatrix}</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1066-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="31.244ex" height="2.577ex" viewBox="0 -806.1 13452.2 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1430-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1430-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1430-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1430-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1430-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1430-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1430-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E1430-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E1430-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1430-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1430-MJMAIN-2B" d="M56 237T56 250T70 270H369V420L370 570Q380 583 389 583Q402 583 409 568V270H707Q722 262 722 250T707 230H409V-68Q401 -82 391 -82H389H387Q375 -82 369 -68V230H70Q56 237 56 250Z"></path><path stroke-width="1" id="E1430-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1430-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-3D" x="2856" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMATHI-67" x="3912" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-28" x="4393" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-2212" x="4782" y="0"></use><g transform="translate(5561,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-33"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-30" x="500" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-2B" x="6784" y="0"></use><g transform="translate(7784,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-30" x="500" y="0"></use></g><g transform="translate(8785,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-31" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-2B" x="10034" y="0"></use><g transform="translate(11035,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-30" x="500" y="0"></use></g><g transform="translate(12036,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-32" x="809" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1430-MJMAIN-29" x="13062" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-1066">h_\Theta(x) = g(-30+20x_1+20x_2)</script>。</p><p>回顾 sigmoid 函数图像，根据输入则有上图中右边的表格，即 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1032-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="19.771ex" height="2.577ex" viewBox="0 -806.1 8512.4 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1390-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1390-MJMATHI-3B8" d="M35 200Q35 302 74 415T180 610T319 704Q320 704 327 704T339 705Q393 701 423 656Q462 596 462 495Q462 380 417 261T302 66T168 -10H161Q125 -10 99 10T60 63T41 130T35 200ZM383 566Q383 668 330 668Q294 668 260 623T204 521T170 421T157 371Q206 370 254 370L351 371Q352 372 359 404T375 484T383 566ZM113 132Q113 26 166 26Q181 26 198 36T239 74T287 161T335 307L340 324H145Q145 321 136 286T120 208T113 132Z"></path><path stroke-width="1" id="E1390-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1390-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1390-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1390-MJMAIN-2248" d="M55 319Q55 360 72 393T114 444T163 472T205 482Q207 482 213 482T223 483Q262 483 296 468T393 413L443 381Q502 346 553 346Q609 346 649 375T694 454Q694 465 698 474T708 483Q722 483 722 452Q722 386 675 338T555 289Q514 289 468 310T388 357T308 404T224 426Q164 426 125 393T83 318Q81 289 69 289Q55 289 55 319ZM55 85Q55 126 72 159T114 210T163 238T205 248Q207 248 213 248T223 249Q262 249 296 234T393 179L443 147Q502 112 553 112Q609 112 649 141T694 220Q694 249 708 249T722 217Q722 153 675 104T555 55Q514 55 468 76T388 123T308 170T224 192Q164 192 125 159T83 84Q80 55 69 55Q55 55 55 85Z"></path><path stroke-width="1" id="E1390-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1390-MJMAIN-41" d="M255 0Q240 3 140 3Q48 3 39 0H32V46H47Q119 49 139 88Q140 91 192 245T295 553T348 708Q351 716 366 716H376Q396 715 400 709Q402 707 508 390L617 67Q624 54 636 51T687 46H717V0H708Q699 3 581 3Q458 3 437 0H427V46H440Q510 46 510 64Q510 66 486 138L462 209H229L209 150Q189 91 189 85Q189 72 209 59T259 46H264V0H255ZM447 255L345 557L244 256Q244 255 345 255H447Z"></path><path stroke-width="1" id="E1390-MJMAIN-4E" d="M42 46Q74 48 94 56T118 69T128 86V634H124Q114 637 52 637H25V683H232L235 680Q237 679 322 554T493 303L578 178V598Q572 608 568 613T544 627T492 637H475V683H483Q498 680 600 680Q706 680 715 683H724V637H707Q634 633 622 598L621 302V6L614 0H600Q585 0 582 3T481 150T282 443T171 605V345L172 86Q183 50 257 46H274V0H265Q250 3 150 3Q48 3 33 0H25V46H42Z"></path><path stroke-width="1" id="E1390-MJMAIN-44" d="M130 622Q123 629 119 631T103 634T60 637H27V683H228Q399 682 419 682T461 676Q504 667 546 641T626 573T685 470T708 336Q708 210 634 116T442 3Q429 1 228 0H27V46H60Q102 47 111 49T130 61V622ZM593 338Q593 439 571 501T493 602Q439 637 355 637H322H294Q238 637 234 628Q231 624 231 344Q231 62 232 59Q233 49 248 48T339 46H350Q456 46 515 95Q561 133 577 191T593 338Z"></path><path stroke-width="1" id="E1390-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMATHI-3B8" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMAIN-28" x="1008" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMATHI-78" x="1397" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMAIN-29" x="1970" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMAIN-2248" x="2637" y="0"></use><g transform="translate(3694,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMAIN-31" x="809" y="-213"></use></g><g transform="translate(4970,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMAIN-41"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMAIN-4E" x="750" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMAIN-44" x="1501" y="0"></use></g><g transform="translate(7485,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMATHI-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1390-MJMAIN-32" x="809" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1032">h_\theta(x)\approx x_1\ \text{AND}\ x_2</script>。这样就实现了一个能够进行与运算的神经网络。 </p><p><img src='image/2413fbec8ff9fa1f19aaf78265b8a33b_Logistic_function.png' alt='sigmoid function' /></p><p>&nbsp;</p><p>再举一例，逻辑或(OR)运算（有一个真值则结果就为真）神经网络：</p><p><img src='image/20180117_000349.png' alt='' /></p><p>&nbsp;</p><h2><a name='header-n169' class='md-header-anchor '></a>8.6 例子和直观理解2(Examples and Intuitions II)</h2><p>下面逐步构建复杂一点的神经网络</p><p><img src='image/20180117_004820.png' alt='' /></p><p>如上图，我们分别构建了三个单层神经网络，将这三个网络组合起来，可得到一个新的神经网络，其可完成逻辑运算中的异或(XNOR)操作：</p><p><img src='image/20180116_235545.png' alt='' /></p><p>这里的组合即为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1035-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="54.065ex" height="2.577ex" viewBox="0 -806.1 23278 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1394-MJMAIN-58" d="M270 0Q252 3 141 3Q46 3 31 0H23V46H40Q129 50 161 88Q165 94 244 216T324 339Q324 341 235 480T143 622Q133 631 119 634T57 637H37V683H46Q64 680 172 680Q297 680 318 683H329V637H324Q307 637 286 632T263 621Q263 618 322 525T384 431Q385 431 437 511T489 593Q490 595 490 599Q490 611 477 622T436 637H428V683H437Q455 680 566 680Q661 680 676 683H684V637H667Q585 634 551 599Q548 596 478 491Q412 388 412 387Q412 385 514 225T620 62Q628 53 642 50T695 46H726V0H717Q699 3 591 3Q466 3 445 0H434V46H440Q454 46 476 51T499 64Q499 67 463 124T390 238L353 295L350 292Q348 290 343 283T331 265T312 236T286 195Q219 88 218 84Q218 70 234 59T272 46H280V0H270Z"></path><path stroke-width="1" id="E1394-MJMAIN-4E" d="M42 46Q74 48 94 56T118 69T128 86V634H124Q114 637 52 637H25V683H232L235 680Q237 679 322 554T493 303L578 178V598Q572 608 568 613T544 627T492 637H475V683H483Q498 680 600 680Q706 680 715 683H724V637H707Q634 633 622 598L621 302V6L614 0H600Q585 0 582 3T481 150T282 443T171 605V345L172 86Q183 50 257 46H274V0H265Q250 3 150 3Q48 3 33 0H25V46H42Z"></path><path stroke-width="1" id="E1394-MJMAIN-4F" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM467 647Q426 665 388 665Q360 665 331 654T269 620T213 549T179 439Q174 411 174 354Q174 144 277 61Q327 20 385 20H389H391Q474 20 537 99Q603 188 603 354Q603 411 598 439Q577 592 467 647Z"></path><path stroke-width="1" id="E1394-MJMAIN-52" d="M130 622Q123 629 119 631T103 634T60 637H27V683H202H236H300Q376 683 417 677T500 648Q595 600 609 517Q610 512 610 501Q610 468 594 439T556 392T511 361T472 343L456 338Q459 335 467 332Q497 316 516 298T545 254T559 211T568 155T578 94Q588 46 602 31T640 16H645Q660 16 674 32T692 87Q692 98 696 101T712 105T728 103T732 90Q732 59 716 27T672 -16Q656 -22 630 -22Q481 -16 458 90Q456 101 456 163T449 246Q430 304 373 320L363 322L297 323H231V192L232 61Q238 51 249 49T301 46H334V0H323Q302 3 181 3Q59 3 38 0H27V46H60Q102 47 111 49T130 61V622ZM491 499V509Q491 527 490 539T481 570T462 601T424 623T362 636Q360 636 340 636T304 637H283Q238 637 234 628Q231 624 231 492V360H289Q390 360 434 378T489 456Q491 467 491 499Z"></path><path stroke-width="1" id="E1394-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1394-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1394-MJMAIN-78" d="M201 0Q189 3 102 3Q26 3 17 0H11V46H25Q48 47 67 52T96 61T121 78T139 96T160 122T180 150L226 210L168 288Q159 301 149 315T133 336T122 351T113 363T107 370T100 376T94 379T88 381T80 383Q74 383 44 385H16V431H23Q59 429 126 429Q219 429 229 431H237V385Q201 381 201 369Q201 367 211 353T239 315T268 274L272 270L297 304Q329 345 329 358Q329 364 327 369T322 376T317 380T310 384L307 385H302V431H309Q324 428 408 428Q487 428 493 431H499V385H492Q443 385 411 368Q394 360 377 341T312 257L296 236L358 151Q424 61 429 57T446 50Q464 46 499 46H516V0H510H502Q494 1 482 1T457 2T432 2T414 3Q403 3 377 3T327 1L304 0H295V46H298Q309 46 320 51T331 63Q331 65 291 120L250 175Q249 174 219 133T185 88Q181 83 181 74Q181 63 188 55T206 46Q208 46 208 23V0H201Z"></path><path stroke-width="1" id="E1394-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1394-MJMAIN-41" d="M255 0Q240 3 140 3Q48 3 39 0H32V46H47Q119 49 139 88Q140 91 192 245T295 553T348 708Q351 716 366 716H376Q396 715 400 709Q402 707 508 390L617 67Q624 54 636 51T687 46H717V0H708Q699 3 581 3Q458 3 437 0H427V46H440Q510 46 510 64Q510 66 486 138L462 209H229L209 150Q189 91 189 85Q189 72 209 59T259 46H264V0H255ZM447 255L345 557L244 256Q244 255 345 255H447Z"></path><path stroke-width="1" id="E1394-MJMAIN-44" d="M130 622Q123 629 119 631T103 634T60 637H27V683H228Q399 682 419 682T461 676Q504 667 546 641T626 573T685 470T708 336Q708 210 634 116T442 3Q429 1 228 0H27V46H60Q102 47 111 49T130 61V622ZM593 338Q593 439 571 501T493 602Q439 637 355 637H322H294Q238 637 234 628Q231 624 231 344Q231 62 232 59Q233 49 248 48T339 46H350Q456 46 515 95Q561 133 577 191T593 338Z"></path><path stroke-width="1" id="E1394-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1394-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1394-MJMAIN-54" d="M36 443Q37 448 46 558T55 671V677H666V671Q667 666 676 556T685 443V437H645V443Q645 445 642 478T631 544T610 593Q593 614 555 625Q534 630 478 630H451H443Q417 630 414 618Q413 616 413 339V63Q420 53 439 50T528 46H558V0H545L361 3Q186 1 177 0H164V46H194Q264 46 283 49T309 63V339V550Q309 620 304 625T271 630H244H224Q154 630 119 601Q101 585 93 554T81 486T76 443V437H36V443Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-58"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4E" x="750" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4F" x="1501" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-52" x="2279" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-3D" x="3293" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-28" x="4350" y="0"></use><g transform="translate(4739,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-31" x="747" y="-213"></use></g><g transform="translate(5888,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-41"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4E" x="750" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-44" x="1501" y="0"></use></g><g transform="translate(8320,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-32" x="747" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-29" x="9303" y="0"></use><g transform="translate(9859,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4F"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-52" x="778" y="0"></use></g><g transform="translate(11541,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4E"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4F" x="750" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-54" x="1529" y="0"></use></g><g transform="translate(2807,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-31" x="747" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-29" x="3790" y="0"></use></g><g transform="translate(4735,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-41"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4E" x="750" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-44" x="1501" y="0"></use></g><g transform="translate(7167,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-28" x="0" y="0"></use><g transform="translate(389,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4E"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-4F" x="750" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-54" x="1529" y="0"></use></g><g transform="translate(2807,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-78" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-32" x="747" y="-213"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-29" x="3790" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1394-MJMAIN-29" x="11347" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1035">\text{XNOR}=( \text{x}_1\, \text{AND}\, \text{x}_2 )\, \text{OR} \left( \left( \text{NOT}\, \text{x}_1 \right) \text{AND} \left( \text{NOT}\, \text{x}_2 \right) \right)</script></p><p><span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1046-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="27.481ex" height="5.846ex" viewBox="0 -1509.8 11831.9 2517" role="img" focusable="false" style="vertical-align: -2.339ex;"><defs><path stroke-width="1" id="E1406-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1406-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1406-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1406-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1406-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1406-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1406-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E1406-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1406-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1406-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1406-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E1406-MJSZ3-5B" d="M247 -949V1450H516V1388H309V-887H516V-949H247Z"></path><path stroke-width="1" id="E1406-MJSZ3-5D" d="M11 1388V1450H280V-949H11V-887H218V1388H11Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-3D" x="2061" y="0"></use><g transform="translate(3117,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJSZ3-5B"></use><g transform="translate(695,0)"><g transform="translate(-15,0)"><g transform="translate(0,650)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-2212" x="0" y="0"></use><g transform="translate(778,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-33"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(389,-750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(2764,0)"><g transform="translate(389,650)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-30" x="500" y="0"></use></g><g transform="translate(0,-750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-2212" x="0" y="0"></use><g transform="translate(778,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-30" x="500" y="0"></use></g></g></g><g transform="translate(5544,0)"><g transform="translate(389,650)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-30" x="500" y="0"></use></g><g transform="translate(0,-750)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-2212" x="0" y="0"></use><g transform="translate(778,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJMAIN-30" x="500" y="0"></use></g></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1406-MJSZ3-5D" x="8186" y="-1"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1046">\Theta^{(1)} =\begin{bmatrix}-30 & 20 & 20 \newline 10 & -20 & -20\end{bmatrix}</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1049-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="22.703ex" height="2.928ex" viewBox="0 -956.9 9774.9 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1409-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1409-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1409-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1409-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1409-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1409-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1409-MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="E1409-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1409-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1409-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-3D" x="2061" y="0"></use><g transform="translate(3117,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-5B" x="0" y="0"></use><g transform="translate(445,0)"><g transform="translate(-15,0)"><g transform="translate(0,-50)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-2212" x="0" y="0"></use><g transform="translate(778,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-31"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-30" x="500" y="0"></use></g></g></g><g transform="translate(2764,0)"><g transform="translate(0,-50)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-30" x="500" y="0"></use></g></g><g transform="translate(4765,0)"><g transform="translate(0,-50)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-32"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-30" x="500" y="0"></use></g></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1409-MJMAIN-5D" x="6379" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1049">\Theta^{(2)} =\begin{bmatrix}-10 & 20 & 20\end{bmatrix}</script>，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1053-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="19.713ex" height="10.048ex" viewBox="0 -2414.4 8487.3 4326.3" role="img" focusable="false" style="vertical-align: -4.279ex; margin-bottom: -0.161ex;"><defs><path stroke-width="1" id="E1413-MJMATHI-61" d="M33 157Q33 258 109 349T280 441Q331 441 370 392Q386 422 416 422Q429 422 439 414T449 394Q449 381 412 234T374 68Q374 43 381 35T402 26Q411 27 422 35Q443 55 463 131Q469 151 473 152Q475 153 483 153H487Q506 153 506 144Q506 138 501 117T481 63T449 13Q436 0 417 -8Q409 -10 393 -10Q359 -10 336 5T306 36L300 51Q299 52 296 50Q294 48 292 46Q233 -10 172 -10Q117 -10 75 30T33 157ZM351 328Q351 334 346 350T323 385T277 405Q242 405 210 374T160 293Q131 214 119 129Q119 126 119 118T118 106Q118 61 136 44T179 26Q217 26 254 59T298 110Q300 114 325 217T351 328Z"></path><path stroke-width="1" id="E1413-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1413-MJMAIN-32" d="M109 429Q82 429 66 447T50 491Q50 562 103 614T235 666Q326 666 387 610T449 465Q449 422 429 383T381 315T301 241Q265 210 201 149L142 93L218 92Q375 92 385 97Q392 99 409 186V189H449V186Q448 183 436 95T421 3V0H50V19V31Q50 38 56 46T86 81Q115 113 136 137Q145 147 170 174T204 211T233 244T261 278T284 308T305 340T320 369T333 401T340 431T343 464Q343 527 309 573T212 619Q179 619 154 602T119 569T109 550Q109 549 114 549Q132 549 151 535T170 489Q170 464 154 447T109 429Z"></path><path stroke-width="1" id="E1413-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1413-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1413-MJMATHI-67" d="M311 43Q296 30 267 15T206 0Q143 0 105 45T66 160Q66 265 143 353T314 442Q361 442 401 394L404 398Q406 401 409 404T418 412T431 419T447 422Q461 422 470 413T480 394Q480 379 423 152T363 -80Q345 -134 286 -169T151 -205Q10 -205 10 -137Q10 -111 28 -91T74 -71Q89 -71 102 -80T116 -111Q116 -121 114 -130T107 -144T99 -154T92 -162L90 -164H91Q101 -167 151 -167Q189 -167 211 -155Q234 -144 254 -122T282 -75Q288 -56 298 -13Q311 35 311 43ZM384 328L380 339Q377 350 375 354T369 368T359 382T346 393T328 402T306 405Q262 405 221 352Q191 313 171 233T151 117Q151 38 213 38Q269 38 323 108L331 118L384 328Z"></path><path stroke-width="1" id="E1413-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1413-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1413-MJMAIN-22C5" d="M78 250Q78 274 95 292T138 310Q162 310 180 294T199 251Q199 226 182 208T139 190T96 207T78 250Z"></path><path stroke-width="1" id="E1413-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1413-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path><path stroke-width="1" id="E1413-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><g transform="translate(167,0)"><g transform="translate(-15,0)"><g transform="translate(0,1398)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-31" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-22C5" x="5743" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-78" x="6244" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="6816" y="0"></use></g><g transform="translate(0,-97)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-33" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="890" y="0"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-3D" x="1812" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-67" x="2868" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="3348" y="0"></use><g transform="translate(3738,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-398" x="0" y="0"></use><g transform="translate(778,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-22C5" x="5743" y="0"></use><g transform="translate(6244,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-32" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="890" y="0"></use></g></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="7778" y="0"></use></g><g transform="translate(0,-1592)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-3D" x="2856" y="0"></use><g transform="translate(3912,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMATHI-61" x="0" y="0"></use><g transform="translate(529,412)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-33" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1413-MJMAIN-29" x="890" y="0"></use></g></g></g></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-1053">\begin{align*}& a^{(2)} = g(\Theta^{(1)} \cdot x) \newline& a^{(3)} = g(\Theta^{(2)} \cdot a^{(2)}) \newline& h_\Theta(x) = a^{(3)}\end{align*}</script></p><p>可见，特征值能不断升级，并抽取出更多信息，直到计算出结果。而如此不断组合，我们就可以逐渐构造出越来越复杂、强大的神经网络，比如用于手写识别的神经网络。</p><h2><a name='header-n263' class='md-header-anchor '></a>8.7 多类别分类(Multiclass Classification)</h2><p>之前讨论的都是预测结果为单值情况下的神经网络，要实现多类别分类，其实只要修改一下输出层，让输出层包含多个输出单元即可。</p><p>举一个 4 分类问题的实例：</p><p><img src='image/20180117_010904.png' alt='' /></p><p>有四种分类情况，那么就让输出层包含 4 个输出单元即可，则 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1064-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="2.85ex" height="2.344ex" viewBox="0 -755.9 1227 1009.2" role="img" focusable="false" style="vertical-align: -0.588ex;"><defs><path stroke-width="1" id="E1427-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1427-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1427-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1427-MJMAIN-398" x="815" y="-219"></use></g></svg></span><script type="math/tex" id="MathJax-Element-1064">h_\Theta</script> 为 4 维向量。 </p><p>神经网络中的多分类算法算是对 one-vs-all 思想的扩展，定义预测结果一共有 4 种情况：</p><p><img src='image/20180117_011331.png' alt='' /></p><p>如果预测结果 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1056-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="14.091ex" height="12.383ex" viewBox="0 -2917 6067.1 5331.5" role="img" focusable="false" style="vertical-align: -5.608ex;"><defs><path stroke-width="1" id="E1416-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1416-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1416-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1416-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1416-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1416-MJMAIN-3D" d="M56 347Q56 360 70 367H707Q722 359 722 347Q722 336 708 328L390 327H72Q56 332 56 347ZM56 153Q56 168 72 173H708Q722 163 722 153Q722 140 707 133H70Q56 140 56 153Z"></path><path stroke-width="1" id="E1416-MJMAIN-5B" d="M118 -250V750H255V710H158V-210H255V-250H118Z"></path><path stroke-width="1" id="E1416-MJMAIN-30" d="M96 585Q152 666 249 666Q297 666 345 640T423 548Q460 465 460 320Q460 165 417 83Q397 41 362 16T301 -15T250 -22Q224 -22 198 -16T137 16T82 83Q39 165 39 320Q39 494 96 585ZM321 597Q291 629 250 629Q208 629 178 597Q153 571 145 525T137 333Q137 175 145 125T181 46Q209 16 250 16Q290 16 318 46Q347 76 354 130T362 333Q362 478 354 524T321 597Z"></path><path stroke-width="1" id="E1416-MJMAIN-31" d="M213 578L200 573Q186 568 160 563T102 556H83V602H102Q149 604 189 617T245 641T273 663Q275 666 285 666Q294 666 302 660V361L303 61Q310 54 315 52T339 48T401 46H427V0H416Q395 3 257 3Q121 3 100 0H88V46H114Q136 46 152 46T177 47T193 50T201 52T207 57T213 61V578Z"></path><path stroke-width="1" id="E1416-MJMAIN-5D" d="M22 710V750H159V-250H22V-210H119V710H22Z"></path><path stroke-width="1" id="E1416-MJSZ4-23A1" d="M319 -645V1154H666V1070H403V-645H319Z"></path><path stroke-width="1" id="E1416-MJSZ4-23A3" d="M319 -644V1155H403V-560H666V-644H319Z"></path><path stroke-width="1" id="E1416-MJSZ4-23A2" d="M319 0V602H403V0H319Z"></path><path stroke-width="1" id="E1416-MJSZ4-23A4" d="M0 1070V1154H347V-645H263V1070H0Z"></path><path stroke-width="1" id="E1416-MJSZ4-23A6" d="M263 -560V1155H347V-644H0V-560H263Z"></path><path stroke-width="1" id="E1416-MJSZ4-23A5" d="M263 0V602H347V0H263Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMAIN-29" x="2188" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMAIN-3D" x="2856" y="0"></use><g transform="translate(3912,0)"><g transform="translate(0,2850)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJSZ4-23A1" x="0" y="-1155"></use><g transform="translate(0,-3446.188741721854) scale(1,2.8112582781456954)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJSZ4-23A2"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJSZ4-23A3" x="0" y="-4555"></use></g><g transform="translate(834,0)"><g transform="translate(-15,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMAIN-30" x="0" y="2050"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMAIN-30" x="0" y="650"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMAIN-31" x="0" y="-750"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJMAIN-30" x="0" y="-2150"></use></g></g><g transform="translate(1487,2850)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJSZ4-23A4" x="0" y="-1155"></use><g transform="translate(0,-3446.188741721854) scale(1,2.8112582781456954)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJSZ4-23A5"></use></g><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1416-MJSZ4-23A6" x="0" y="-4555"></use></g></g></g></svg></span><script type="math/tex" id="MathJax-Element-1056">h_\Theta(x) =\begin{bmatrix}0 \newline 0 \newline 1 \newline 0 \newline\end{bmatrix}</script>，</p><p>那么表示 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1077-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="7.043ex" height="2.577ex" viewBox="0 -806.1 3032.4 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1442-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1442-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1442-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1442-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1442-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path><path stroke-width="1" id="E1442-MJMAIN-33" d="M127 463Q100 463 85 480T69 524Q69 579 117 622T233 665Q268 665 277 664Q351 652 390 611T430 522Q430 470 396 421T302 350L299 348Q299 347 308 345T337 336T375 315Q457 262 457 175Q457 96 395 37T238 -22Q158 -22 100 21T42 130Q42 158 60 175T105 193Q133 193 151 175T169 130Q169 119 166 110T159 94T148 82T136 74T126 70T118 67L114 66Q165 21 238 21Q293 21 321 74Q338 107 338 175V195Q338 290 274 322Q259 328 213 329L171 330L168 332Q166 335 166 348Q166 366 174 366Q202 366 232 371Q266 376 294 413T322 525V533Q322 590 287 612Q265 626 240 626Q208 626 181 615T143 592T132 580H135Q138 579 143 578T153 573T165 566T175 555T183 540T186 520Q186 498 172 481T127 463Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1442-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1442-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1442-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1442-MJMATHI-78" x="1616" y="0"></use><g transform="translate(2188,0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1442-MJMAIN-29" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1442-MJMAIN-33" x="550" y="-213"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1077">h_\Theta(x)_3</script>，即分为第 3 类，对应于图中的摩托车(Motorcycle)。</p><p><strong>总结一下</strong>，要分为 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-258-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E266-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E266-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-258">k</script> 类，就在输出层放置 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-258-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E266-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E266-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-258">k</script> 个输出单元，对于单个样本实例，<span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1109-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="5.989ex" height="2.577ex" viewBox="0 -806.1 2578.5 1109.7" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1480-MJMATHI-68" d="M137 683Q138 683 209 688T282 694Q294 694 294 685Q294 674 258 534Q220 386 220 383Q220 381 227 388Q288 442 357 442Q411 442 444 415T478 336Q478 285 440 178T402 50Q403 36 407 31T422 26Q450 26 474 56T513 138Q516 149 519 151T535 153Q555 153 555 145Q555 144 551 130Q535 71 500 33Q466 -10 419 -10H414Q367 -10 346 17T325 74Q325 90 361 192T398 345Q398 404 354 404H349Q266 404 205 306L198 293L164 158Q132 28 127 16Q114 -11 83 -11Q69 -11 59 -2T48 16Q48 30 121 320L195 616Q195 629 188 632T149 637H128Q122 643 122 645T124 664Q129 683 137 683Z"></path><path stroke-width="1" id="E1480-MJMAIN-398" d="M56 340Q56 423 86 494T164 610T270 680T388 705Q521 705 621 601T722 341Q722 260 693 191T617 75T510 4T388 -22T267 3T160 74T85 189T56 340ZM610 339Q610 428 590 495T535 598T463 651T384 668Q332 668 289 638T221 566Q168 485 168 339Q168 274 176 235Q189 158 228 105T324 28Q356 16 388 16Q415 16 442 24T501 54T555 111T594 205T610 339ZM223 263V422H263V388H514V422H554V263H514V297H263V263H223Z"></path><path stroke-width="1" id="E1480-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1480-MJMATHI-78" d="M52 289Q59 331 106 386T222 442Q257 442 286 424T329 379Q371 442 430 442Q467 442 494 420T522 361Q522 332 508 314T481 292T458 288Q439 288 427 299T415 328Q415 374 465 391Q454 404 425 404Q412 404 406 402Q368 386 350 336Q290 115 290 78Q290 50 306 38T341 26Q378 26 414 59T463 140Q466 150 469 151T485 153H489Q504 153 504 145Q504 144 502 134Q486 77 440 33T333 -11Q263 -11 227 52Q186 -10 133 -10H127Q78 -10 57 16T35 71Q35 103 54 123T99 143Q142 143 142 101Q142 81 130 66T107 46T94 41L91 40Q91 39 97 36T113 29T132 26Q168 26 194 71Q203 87 217 139T245 247T261 313Q266 340 266 352Q266 380 251 392T217 404Q177 404 142 372T93 290Q91 281 88 280T72 278H58Q52 284 52 289Z"></path><path stroke-width="1" id="E1480-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1480-MJMATHI-68" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1480-MJMAIN-398" x="815" y="-219"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1480-MJMAIN-28" x="1226" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1480-MJMATHI-78" x="1616" y="0"></use><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1480-MJMAIN-29" x="2188" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-1109">h_\Theta(x)</script> 则是一个 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-258-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.211ex" height="1.994ex" viewBox="0 -755.9 521.5 858.4" role="img" focusable="false" style="vertical-align: -0.238ex;"><defs><path stroke-width="1" id="E266-MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E266-MJMATHI-6B" x="0" y="0"></use></g></svg></span><script type="math/tex" id="MathJax-Element-258">k</script> 维结果向量，最后依据结果向量，得出属于哪个类 <span class="MathJax_Preview"></span><span class="MathJax_SVG" id="MathJax-Element-1118-Frame" tabindex="-1" style="font-size: 100%; display: inline-block;"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="3.24ex" height="2.928ex" viewBox="0 -956.9 1394.8 1260.5" role="img" focusable="false" style="vertical-align: -0.705ex;"><defs><path stroke-width="1" id="E1494-MJMATHI-79" d="M21 287Q21 301 36 335T84 406T158 442Q199 442 224 419T250 355Q248 336 247 334Q247 331 231 288T198 191T182 105Q182 62 196 45T238 27Q261 27 281 38T312 61T339 94Q339 95 344 114T358 173T377 247Q415 397 419 404Q432 431 462 431Q475 431 483 424T494 412T496 403Q496 390 447 193T391 -23Q363 -106 294 -155T156 -205Q111 -205 77 -183T43 -117Q43 -95 50 -80T69 -58T89 -48T106 -45Q150 -45 150 -87Q150 -107 138 -122T115 -142T102 -147L99 -148Q101 -153 118 -160T152 -167H160Q177 -167 186 -165Q219 -156 247 -127T290 -65T313 -9T321 21L315 17Q309 13 296 6T270 -6Q250 -11 231 -11Q185 -11 150 11T104 82Q103 89 103 113Q103 170 138 262T173 379Q173 380 173 381Q173 390 173 393T169 400T158 404H154Q131 404 112 385T82 344T65 302T57 280Q55 278 41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E1494-MJMAIN-28" d="M94 250Q94 319 104 381T127 488T164 576T202 643T244 695T277 729T302 750H315H319Q333 750 333 741Q333 738 316 720T275 667T226 581T184 443T167 250T184 58T225 -81T274 -167T316 -220T333 -241Q333 -250 318 -250H315H302L274 -226Q180 -141 137 -14T94 250Z"></path><path stroke-width="1" id="E1494-MJMATHI-69" d="M184 600Q184 624 203 642T247 661Q265 661 277 649T290 619Q290 596 270 577T226 557Q211 557 198 567T184 600ZM21 287Q21 295 30 318T54 369T98 420T158 442Q197 442 223 419T250 357Q250 340 236 301T196 196T154 83Q149 61 149 51Q149 26 166 26Q175 26 185 29T208 43T235 78T260 137Q263 149 265 151T282 153Q302 153 302 143Q302 135 293 112T268 61T223 11T161 -11Q129 -11 102 10T74 74Q74 91 79 106T122 220Q160 321 166 341T173 380Q173 404 156 404H154Q124 404 99 371T61 287Q60 286 59 284T58 281T56 279T53 278T49 278T41 278H27Q21 284 21 287Z"></path><path stroke-width="1" id="E1494-MJMAIN-29" d="M60 749L64 750Q69 750 74 750H86L114 726Q208 641 251 514T294 250Q294 182 284 119T261 12T224 -76T186 -143T145 -194T113 -227T90 -246Q87 -249 86 -250H74Q66 -250 63 -250T58 -247T55 -238Q56 -237 66 -225Q221 -64 221 250T66 725Q56 737 55 738Q55 746 60 749Z"></path></defs><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"><use xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1494-MJMATHI-79" x="0" y="0"></use><g transform="translate(499,362)"><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1494-MJMAIN-28" x="0" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1494-MJMATHI-69" x="389" y="0"></use><use transform="scale(0.707)" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="#E1494-MJMAIN-29" x="734" y="0"></use></g></g></svg></span><script type="math/tex" id="MathJax-Element-1118">y^{(i)}</script>。</p><p>&nbsp;</p></div>
 </body>
 </html>
\ No newline at end of file
diff --git a/week4.md b/week4.md
index 3f73455..e45a6d3 100644
--- a/week4.md
+++ b/week4.md
@@ -74,14 +74,12 @@ BrainPort  系统：帮助失明人士通过摄像头以及舌尖感官“看”
 
 依据本节所给模型，有：
 
-$Size(\Theta^{(1)})=s_{j+1} \times (s_j + 1) = 3 \times 4$
+$Size(\Theta^{(1)})=s_{j+1} \times (s_j + 1) =s_2 \times (s_1 + 1) = 3 \times 4$
 
-$Size(\Theta^{(2)})=s_{j+1} \times (s_j + 1) = 1 \times 4$
+$Size(\Theta^{(2)})=s_3 \times (s_2 + 1) = 1 \times 4$
 
 ## 8.4 模型表示2(Model Representation II)
 
-> 神经网络中的符号较多，易乱，建议多看几遍多回顾。
-
 ![](image/20180116_001543.png)
 
 对第 $1$ 层的所有激活单元应用激活函数，从而得到第 $2$ 层激活单元的值：
@@ -100,9 +98,7 @@ $h_\Theta(x) = a_1^{(3)} = g(\Theta_{10}^{(2)}a_0^{(2)} + \Theta_{11}^{(2)}a_1^{
 
 ${h_\theta}\left( x \right)=g\left( {\theta_0}+{\theta_1}{x_1}+{\theta_{2}}{x_{2}}+{\theta_{3}}x_{1}^{2} \right)$
 
-是不是除了符号表示，其他都完全一样？其实神经网络就好似回归模型，只不过输入变成了中间单元 $a_1^{(j)}, a_2^{(j)}, \dots, a_n^{(j)}$。中间单元从输入向量 $x$ 开始，下一层的每个单元对所有输入的信息通过最优化算法不断迭代计算，每个单元因为包含了前一层的所有单元值，那么每个单元都能依赖于权重与输入得出关于输入向量的更多信息，就好像是在给假设函数加多项式。
-
-中间单元就好像是包含了更多信息的升级版输入参数，使用包含更多信息的中间单元，也能产生更好地预测。
+是不是除了符号表示，其他都完全一样？其实神经网络就好似回归模型，只不过输入变成了中间单元 $a_1^{(j)}, a_2^{(j)}, \dots, a_n^{(j)}$。从输入 $x$ 开始，下一层的每个激活单元都包含了上一层的所有信息（单元值），通过最优化算法不断迭代计算，激活单元能得出关于输入 $x$ 的更多信息，这就好像是在给假设函数加多项式。中间层的这些单元好似升级版的初始特征，从而能给出更好的预测。
 
 
 
@@ -140,6 +136,61 @@ ${{z}^{\left( 2 \right)}}={{\Theta }^{\left( 1 \right)}} {{X}^{T}}$，这时 $z^
 
 ## 8.5 例子和直观理解1(Examples and Intuitions I)
 
+为了更好的理解神经网络，举例单层神经网络进行逻辑运算的例子。
+
+下面的例子中，$x_1,x_2$ 为二进制数。
+
+逻辑与(AND)运算（都为真值则结果才为真）神经网络：
+
+![](image/20180117_000612.png)
+
+$\Theta^{(1)} =\begin{bmatrix}-30 & 20 & 20\end{bmatrix}$，$h_\Theta(x) = g(-30+20x_1+20x_2)$。
+
+回顾 sigmoid 函数图像，根据输入则有上图中右边的表格，即 $h_\theta(x)\approx x_1\ \text{AND}\ x_2$。这样就实现了一个能够进行与运算的神经网络。 
+
+![sigmoid function](image/2413fbec8ff9fa1f19aaf78265b8a33b_Logistic_function.png)
+
+
+
+再举一例，逻辑或(OR)运算（有一个真值则结果就为真）神经网络：
+
+![](image/20180117_000349.png)
+
+
+
 ## 8.6 例子和直观理解2(Examples and Intuitions II)
 
-## 8.7 多类别分类(Multiclass Classification)
\ No newline at end of file
+下面逐步构建复杂一点的神经网络
+
+![](image/20180117_004820.png)
+
+如上图，我们分别构建了三个单层神经网络，将这三个网络组合起来，可得到一个新的神经网络，其可完成逻辑运算中的异或(XNOR)操作：
+
+![](image/20180116_235545.png)
+
+这里的组合即为 $\text{XNOR}=( \text{x}_1\, \text{AND}\, \text{x}_2 )\, \text{OR} \left( \left( \text{NOT}\, \text{x}_1 \right) \text{AND} \left( \text{NOT}\, \text{x}_2 \right) \right)$
+
+$\Theta^{(1)} =\begin{bmatrix}-30 & 20 & 20 \newline 10 & -20 & -20\end{bmatrix}$，$\Theta^{(2)} =\begin{bmatrix}-10 & 20 & 20\end{bmatrix}$，$\begin{align*}& a^{(2)} = g(\Theta^{(1)} \cdot x) \newline& a^{(3)} = g(\Theta^{(2)} \cdot a^{(2)}) \newline& h_\Theta(x) = a^{(3)}\end{align*}$
+
+可见，特征值能不断升级，并抽取出更多信息，直到计算出结果。而如此不断组合，我们就可以逐渐构造出越来越复杂、强大的神经网络，比如用于手写识别的神经网络。
+
+## 8.7 多类别分类(Multiclass Classification)
+
+之前讨论的都是预测结果为单值情况下的神经网络，要实现多类别分类，其实只要修改一下输出层，让输出层包含多个输出单元即可。
+
+举一个 4 分类问题的实例：
+
+![](image/20180117_010904.png)
+
+有四种分类情况，那么就让输出层包含 4 个输出单元即可，则 $h_\Theta$ 为 4 维向量。 
+
+神经网络中的多分类算法算是对 one-vs-all 思想的扩展，定义预测结果一共有 4 种情况：
+
+![](image/20180117_011331.png)
+
+如果预测结果 $h_\Theta(x) =\begin{bmatrix}0 \newline 0 \newline 1 \newline 0 \newline\end{bmatrix}$，
+
+那么表示 $h_\Theta(x)_3$，即分为第 3 类，对应于图中的摩托车(Motorcycle)。
+
+**总结一下**，要分为 $k$ 类，就在输出层放置 $k$ 个输出单元，对于单个样本实例，$h_\Theta(x)$ 则是一个 $k$ 维结果向量，最后依据结果向量，得出属于哪个类 $y^{(i)}$。
+