Vpf'>dZddlmZddlmZmZddlmZddlZddl Z ddl Z ddl Z ddl m Z mZddlmZddlmZdd lmZdd lmZejecZZejecZZd#d Zd$dZdfd%dZd#dZd#dZd#dZ d#dZ!eej"dfZ#d#dZ$d#dZ%d&dZ&d'd!Z'd(d"Z(dS))zUtilities for the Jaxpr IR.) annotations)Counter defaultdict)CallableN)AnyUnion)core)util)source_info_util) xla_clientjaxpr core.Jaxprc#K|jD]}||fV tj|D]}t|Ed{VdSN)eqnsr subjaxprsall_eqns)r eqnsubjaxprs S/var/www/html/nettyfy-visnx/env/lib/python3.11/site-packages/jax/_src/jaxpr_util.pyrr$sp Zc #,.''""h!!!!!!!!!!""keyrctt}t|D])\}}||||*t |Sr)rlistrappenddict)r rd_rs r collect_eqnsr*sV$!facc#hhKs a.rc|Sr)xs rr#1sArkey_fmtcdt||}fd|DS)NcHi|]\}}|t|Sr!len).0kvr$s r zhistogram..3s- 3 3 3A''!**c!ff 3 3 3r)ritems)r rr$rs ` r histogramr.0s45#! 3 3 3 3 3 3 33rc$t|dS)Nc|jjSr) primitivenamers rr#zprimitives..6s cm&8rr.)r s r primitivesr55s 588 9 99rc4d}t||djS)NcPtj|j}|jj|fSrr summarize source_infor1r2)rsrcs rrz!primitives_by_source..key9s$  $S_ 5 5C M  $$r @ r.joinr rs rprimitives_by_sourcer@8s'%%% 5#uz * **rc@dfd}t||djS)Nclt|tjrdn|jS)N*) isinstancer DropVaraval str_short)vars r shape_fmtz&primitives_by_shape..shape_fmt?s+S$,// I33SX5G5G5I5IIrcl|jjdt|jfS)N )r1r2r>mapoutvars)rrIs rrz primitives_by_shape..keyAs+ M Y )D)D E E FFrz :: r=)r rrIs @rprimitives_by_shaperN>sGJJJGGGGG 5#v{ + ++rc(d}t||S)Nc4tj|jSr)r r9r:r3s rrzsource_locations..keyFs  %co 6 66rr4r?s rsource_locationsrQEs!777 5#  rc ii d  fd }d  fd }|jD]}||d|jD]}||d|jD].}|jD]}||||jD]}|||/|jD]}||d fd D}t t t j|}|r||fg|n||fS) Na core.AtomrMaybeEqnct|tjs9|vs J||vs J|||dSdSr)rDr Literalr)rSrdefsrefss rreadzvar_defs_and_refs..readPsc a & & $YYYYYY $YYYYYY 1gnnSrr+core.Varc|vs J||vs J|t|tjs ||<g|<dSdSr)rDr rE)r+rrXrYs rwritez var_defs_and_refs..writeVs] D===!=== D===!=== a & &d1gd1gggrc2g|]}|||fSr!r!)r)r+rXrYs r z%var_defs_and_refs..ks(---1!T!Wd1g ---r)rSrTrrU)r+r[rrU) constvarsinvarsrrMrLvar_defs_and_refsr r) r rZr]r+rrSressubsrXrYs @@rrbrbLsn#%$)+$  ?a E!TNNNN <a E!TNNNN Zc Z d1cllll [ eAsmmmm =aDDMMMM--------# u 5 5 6 6$"& 85#,   UCL8rcLdfdfdt|DS)Ncj||dStj|j}|d|jjd|S)Nz <- invarz <- r<r8)rHrr;s rfmt_keyzvars_by_fanout..fmt_keypsI {     &s 7 7c 5 5+ 5 5 5 55rc fd|DS)NcLi|] \}}}||t|!Sr!r')r)rHvar_defvar_refsrgs rr,z0vars_by_fanout..hist..xsC 1 1 1&Wh GC ! !3x== 1 1 1rr!)r readsrgs rhistzvars_by_fanout..histws. 1 1 1 1*/ 1 1 11rc2g|]\}}|||fSr!r!)r)jrlrms rr_z"vars_by_fanout..{s, G G G(!U1dd1enn  G G Gr)rb)r rgrms @@rvars_by_fanoutrposR66611111 H G G G.?.F.F G G GGrr.dict[Any, int]c6td|D}dt|zdz}d|D}t |dD](\}}t |||)dS)Nc3NK|] }tt|V!dSr)r(str)r)r+s r z"print_histogram..~s.<zd}cg|] \}}||f Sr!r!)r)r*r+s rr_z#print_histogram..s 0 0 0daAq6 0 0 0rT)reverse)maxvaluesrtr-sortedprintformat)r. count_width count_fmtpairscountr2s rprint_histogramr}s<<)9)9););<<<<<+c+&&&-) 0 0ioo// 0 0 0%E4000))keT )  5 ! !4(((())rprofile=dict[tuple[xla_client.Traceback | None, core.Primitive], int]returnbytescj ttjdjttjdj ttjdj dd<d}g}|D]_\\}}}|g}n)t |} fd|D}|||g||jdgd` fd  D}fd  D} d d d g} tj t || | |d} tjtj| S)zConverts a profile into a compressed pprof protocol buffer. The input profile is a map from (traceback, primitive) pairs to counts. rr1Nc\g|](\}}tj|j||f)Sr!)r is_user_filename co_filename)r)codelastilocs rr_z"_pprof_profile..sOHHH{tU#4T5EFFHT5M"HHHr)rrt) location_idvaluelabelcvg|]5\\}}}||tj||dgd6S)) function_idline)idr)r Tracebackcode_addr2line)r)rrloc_idfuncs rr_z"_pprof_profile..sn -4 $T #-<.s\ $  oT%&( **r equationsr)typeunit) string_tablelocationfunction sample_typesample)r itertoolsr__next__r-zip raw_framesrr2jsondumpsrkeysgzipcompressr _xlajson_to_pprof_profile)r primitive_keysamplestbr1rframesr locations functionsr json_profilerrrs @@@r_pprof_profilers)/!$$-..! Y_Q''0 1 1$IOA&&/00# !B%K.- ' ' or9u zff (jHHHHjHHHf NN).!   $'99;; )   ::<< )K.!G*==>+NN , z<<\JJ K KKrcltdt|D}t|S)asGenerates a pprof profile that maps jaxpr equations to Python stack traces. By visualizing the profile using pprof, one can identify Python code that is responsible for yielding large numbers of jaxpr equations. Args: jaxpr: a Jaxpr. Returns: A gzip-compressed pprof Profile protocol buffer, suitable for passing to pprof tool for visualization. c3BK|]\}}|jj|jfVdSr)r: tracebackr1)r)rrs rruz)pprof_equation_profile..sF !S  #-0r)rrr)r rs rpprof_equation_profilersEUOO!   r)r r)r rrr)r rrrr$r)r.rq)rrrr)r rrr))__doc__ __future__r collectionsrrcollections.abcrrrrtypestypingrrjax._srcr r r jax._src.libr safe_maprL unsafe_mapsafe_zipr unsafe_ziprrr.r5r@rNrQJaxprEqnrUrbrprrrr!rrrs "!"""""",,,,,,,,$$$$$$  %%%%%%######-Z-Z"""" #.+44444 ::::++++ ,,,, $ %!9!9!9!9F H H H H)))):L:L:L:Lzr