VpfM)ddlmZddlZddlmZddlmZddlmZddlm Z m Z ddl Z gdZ dZd Ziejde je jde jejde je jde je jde je jde je jde jejde je jde je jde je jde je jde jejd e jejd e jejd e jej d e jej!d e jej"d e je j#d e je j$d e je j%de je j&d e je j'diZ(ej)9ej*Jde(e jej)<de(e jej*<dZ+e jejd e jejd e jejd e jej d e jej!d e jej"d e je j#d e je j$de je j%de je j&d e je j'di Z,dZ-d%dZ.d&dZ/d%dZ0d%dZ1dZ2dZ3dZ4dZ5ee e5ej6Z6ee e5ej7Z7ee dZ8ee e5e j9Z9dZ:dZ;efdZddedfd"Z? d'd$Z@dS)()partialN)api)config)dtypes)tree_map tree_reduce) check_grads check_jvp check_vjpg-C6?ct|dr|jSt|tjvr1t jtjt|St j|jS)Ndtype)hasattrr type_dtypespython_scalar_dtypesnpasarray)xs Y/var/www/html/nettyfy-visnx/env/lib/python3.11/site-packages/jax/_src/public_test_util.py_dtyper#s^ Q 7N Aww'... 8G0a9 : :: :a== g?g{Gz?gMbP?gư>gV瞯ct|tj o't|ttt t fSr) isinstancergenericboolintfloatcomplex)vals ris_python_scalarr%]s0 RZ ( ( ( YZdCPW=X-Y-YYrc |j|jcxkrtjkr'nn$tj|||dStjtjtjtj tj tj gfd}||}||}i}|r||d<|r||d<tj d5tjj ||fi|d|iddddS#1swxYwYdS)Nerr_msgc|jvr|tjS|jtjvrM|t j|jjdkr tjn tj S|S)Nr) r astyperfloat32r _intn_dtypesiinfominint8uint8)rcustom_float_dtypess r maybe_upcastz,_assert_numpy_allclose..maybe_upcastmsow%%% XXbj ! !! w'&&& XXqw!7!7!;a!?!?bggRX N NN Hratolrtolignoreinvalidr))r rfloat0rtestingassert_array_equalfloat8_e4m3b11fnuz float8_e4m3fnfloat8_e4m3fnuz float8_e5m2float8_e5m2fnuzbfloat16errstateassert_allclose)abr4r5r)r3kwr2s @r_assert_numpy_allcloserG`srW))))7>)))))J!!!Q!888 F            l1oo!l1oo! " 2f: 2f: {8$$$<<Jq!;;r;;7;;;;<<<<<<<<<<<<<<<<<i|]\}}tj||Sr)rr ).0keyvalues r ztolerance..s&<<<*#u#<<._assert_dtypes_matchsy 5 AYY&)) # # # # # #(33(33444444rr)r\r]res r_check_dtypes_matchrgs,555  R(((((rcZd}ttjt|||S)Nctjtjtj|d|dS)N)rrealdotconjreshapercs rcontractzinner_prod..contracts> 726"'!**,,R00!))B--@@ A AAr)rraddr)r\r]ros r inner_prodrqs2BBB RVXhB77 8 88rc tjd5tjtj||tjd|tj|||cdddS#1swxYwYdS)z1Subtraction that with `inf - inf == 0` semantics.r6r7rr N)rrBwhereequalarraysubtract)rrdr s r_safe_subtractrxs {8$$$44 8BHQNNBHQ$6$6K1E222 4 4444444444444444444sAA44A8;A8cfd}|S)Nct|d}tj||}td|Dr|}|S)Nrrsc34K|]}t|VdSr)r%)rJargs r z9_preserve_input_types..wrapped..s+ 1 1S C 1 1 1 1 1 1r)rrrvallitem)argsr resultfs rwrappedz&_preserve_input_types..wrappeds] 47OOE Xaahe , , ,F 1 1D 1 1 111{{}}f Mrr)rrs` r_preserve_input_typesrs# .rc@t||t|SNrs)rxrrcs rrsq!6!99 E E Erc.fd}t||S)Nct|}tj|tj||}t |r|n|Sr)rrmultiplyrvr%r)rr rrDs rmulzscalar_mul..mulsR 1IIE [BHQe444E B B BF,Q// ;6;;===V;rrf)r\rDrs ` r scalar_mulrs.<<<<< #r  rcPtj|t|fd}tjtjr,|d|zz}n |}t|r|n|S)Nc@tjjSr)rrrandn)r rngrWsrrzrand_like..s"*YSY.e<<<ry?) rrWrr issubdtypecomplexfloatingrr%r)rrrrr rWs` @@r rand_likers (1++% ))% < < < < < <% r122 UWWuzz$''%%''1 1FF UWWF*1-- 969rct||}|t||}|t||}tt||d|z S)Ng?)rrpsubsafe_sub)rprimalstangentsepsdeltaf_posf_negs r numerical_jvprs[ Xs # #% !S% !% !S% !% HUE**C#I 6 66rc||St|ts|S|}|D]\}}||t j|<|Sr)rrNcopyrOrr )rRdefaultoutkvs r_merge_tolerancerse[ N C   J #iikkdaC  *rct|t}t|t}tjd}t t t||}|||\} } t| | ||} t| | t||||} t| | |||r|dndt| | |||r|dnddS)Nrr primalprimalrVz tangenttangent) rdefault_gradient_tolerancerrandom RandomStaterrrrgrr_) rf_jvprr4r5rr)rrv_outt_outv_out_expectedt_out_expecteds rr r s& $ : ; ;$ $ : ; ;$ a  # WY,,d 3 3'tW%%,%eU###1d8.e^,,, D's;;;.e^$T-4B))))(DDDD e^$T.5D****9FFFFFFrc4t|t}t|t}tttjd}||\}} ||} t|| |||r|dndt||} t||| |} t||} t| t| }t| |}t| | }t|||||r|dnddS)NrrrrVrz cotangent projectionzcotangent projection) rrrrrrrr_rrrmrq)rf_vjprr4r5rr) _rand_likervjpfunrr tangent_out cotangent cotangent_outip ip_expecteds rr r sK $ : ; ;$ $ : ; ;$y")"7"7":":;;*%,-%1d8. e^$T-4B))))(DDDD Z & &'awC888+z5)))vvd9oo..//-'=))"; 22+ b+Dt!>'8888'=@@@@@@rfwdrevc t|}|pt}tt|||tt||| d fd |||dS)aCheck gradients from automatic differentiation against finite differences. Gradients are only checked in a single randomly chosen direction, which ensures that the finite difference calculation does not become prohibitively expensive even for large input/output spaces. Args: f: function to check at ``f(*args)``. args: tuple of argument values. order: forward and backwards gradients up to this order are checked. modes: lists of gradient modes to check ('fwd' and/or 'rev'). atol: absolute tolerance for gradient equality. rtol: relative tolerance for gradient equality. eps: step size used for finite differences. Raises: AssertionError: if gradients do not match. )r4r5rr&c|d vra|rd|nd}ttj|||dkr+ttj||f|dz |d vrN|rd|nd} ttj|||dkrfd }|||dz |dSdSdS) NrzJVP of JVPr(rzVJP of VJPcDtjg|R\}}||Sr)rvjp)r out_primal_pyvjp_pyrs rrz0check_grads.._check_grads..f_vjp1s/"%'!"3d"3"3"3 - && &r)rrjvpr) rrorderr)fwd_msgrev_msgr _check_grads _check_jvp _check_vjpmodess ` rrz!check_grads.._check_grads&s ~~'.9#'###EgjGCGQ''w????  WSWa((4, 7KKK ~~'.9#'###EgjGCGQ''w????  ' ' ' ' '  UD%!)W55555~ rN)r&)tupleEPSrr r ) rrrrr4r5rrrrs ` @@@rr r s( t$ s#yt$C@@@*yt$C@@@*666666666 ,q$r)NNr&r)rNNN)A functoolsroperatorjax._srcrrrrjax._src.tree_utilrrnumpyr__all__rrr9r bool_int4r0int16int32int64uint4r1uint16uint32uint64r<r=r>r?r@rAfloat16r,float64 complex64 complex128rint2uint2rrr%rGrSrZr_rgrqrxrrprrrmrrrrr r r rrrrs&&&&&&44444444 4 3 3  NA BHRX BHW\A BHRWq   BHRX   BHRX  BHRX BHW]Q BHRX BHRY BHRY BHRY BHW '(($ BHW "##T BHW $%%t  BHW !!4!" BHW $%%t#$ BHW  BHRZ$ BHRZ$ BHRZ% BHR\D BHR]U/4 <  " " "/0XRXgl++,01XRXgm,,-  "(7 %&& "(7 !!4 "(7 "##T "(7  "(7 "##T "(7 d "(2: "(2: "(2: "(2<$ "(2=4 ZZZ < < <