Vpf\4ddlmZddlZddlZddlmZddlmZddlm Z ddlm Z ddl m Z ddl m Z dd lmZdd lmZejZe jZed ejfZe Zd Zd ejdejfdZdejfdZd e jdedefdZd ejde jfdZd e jdefdZ ej!dee eeddZ"ej#e"dejfdZ$d e jdedefdZ%d e jde jfdZ&d e jdefdZ'ej!d e$e'e%e&d!d"Z(ej#e(d#edefd$Z)e)ej*Z*e)ej+Z+e)ej,Z, d,d%ed&ejd'ed(ed)ed*e-e j.d fdzdejfd+Z/dS)-)CallableN)numpy)random)blocked_sampler)typing) prng_seedprng_random_bits) primitives)prng.keyreturnc|j}tj|}tjt j}tj|jt|d|krtd|dtj ||dzdd|f}tj ||t jz}tj |dS)zEHelper function for converting non-Pallas PRNG keys into Pallas keys.NzKey data must be at least z bytes.). pallas_tpuimpl) shapejax_api_randomkey_datanpprod tpu_key_impl key_shapelen ValueErrorjnpreshape wrap_key_data)r batch_dimsrpallas_key_sizepallas_key_datas ]/var/www/html/nettyfy-visnx/env/lib/python3.11/site-packages/jax/_src/pallas/mosaic/random.py to_pallas_keyr%&sy*  $S ) )(GL233/WX^C OO,, -..@@ J/JJJ K KKK U"$$$')9/)9$9;/K *\-C CEE/  %oL I I IIseedctjtjtj}||ztjS)Ndtype)rzerosrrint32astypeuint32)r' seed_datas r$ _seed_funcr03s6i .ci@@@) d  " "3: . ..r& bit_widthrch|dkrtdt|t|SN zBit width must be 32)rrr rr1rs r$ _random_bitsr67s3"__ + , ,, C... %  r&datactj}t|t|tfzt j}t|t|tfzt j}|dtdz f|dtdz fz }|j|ksJtj |dS)N.rr) rrrr FOLD_IN_ROUNDSr-rr.rjaxrr )rr7r data_bitskey_bitsmixeds r$_fold_inr?=s $) D///>##%%%+VCJ%7%7  C... >##%%%+VCJ%7%7  3q(( )Ic>!;K6K,L L%  ! ! ! !  ! !%l ! ; ;;r&c"~~tNNotImplementedErrorrrs r$_splitrEP 5r&)r9r9rpl)rr'split random_bitsfold_innametagcD~tjdtjS)Nr))remptyr,)r's r$_pl_stateful_seed_funcrPis 2SY ' ' ''r&cB~|dks Jdt|Sr3r r5s r$_pl_stateful_random_bitsrRns' b0 %  r&c"~~trArB)rr7s r$_pl_stateful_fold_inrTss 4r&c"~~trArBrDs r$_pl_stateful_splitrVwrFr&rN_pallas_internal_stateful _pl_statefulsamplercfd}jrCtdjd}d||_|S)zConverts a jax.random sampling function to a stateful version. Args: sampler: A sampling function that consumes a key and returns random samples. Returns: A stateful sampling function with the key argument removed. cRtjdt}|g|Ri|S)Nrr)rrtpu_internal_stateful_impl)argskwargsplaceholder_keyrYs r$ new_samplerz+_make_stateful_sampler..new_samplers;%(1KLLLO 7? 4T 4 4 4V 4 44r&c d|vS)Nzkey:rN)lines r$z(_make_stateful_sampler..s V4'r& )__doc__filterrHjoin)rYr` doc_liness` r$_make_stateful_samplerrisk55555 _/'')>)>t)D)DFFI))I..K r& sampler_fn global_key block_size tile_size total_size block_indexc jt|t|kr0tdt|dt|d|5t|}tdt|D}t j|||||}t j||||fi|S)a]Samples a block of random values with invariance guarantees. `sample_block` allows the sampling of identical blocks of random values across kernels with different block shapes and iteration orders. Each call to `sample_block` returns a `block_size`-shaped array of random samples corresponding to the `block_index`. `tile_size` should be chosen such that it is a divisor to all block sizes one needs to be invariant to. The larger the `tile_size`, the more efficient the sampling process wil be and therefore the best choice is typically the greatest common divisor between all possible block sizes. Args: sampler_fn: A sampling function that consumes a key and returns random samples. global_key: The global key to use for sampling. block_size: The shape of an individual block. tile_size: The shape of a `tile`, which is the smallest unit at which samples are generated. This should be selected to be a divisor of all block sizes one needs to be invariant to. total_size: The total size of the array to sample. block_index: The index denoting which block to generate keys for. Defaults to the program_id for each block axis. **kwargs: Additional arguments to pass to the sampler_fn. Returns: A `block_size` shaped array of samples for the current block corresponding to `block_index`. z block_size (z) and tile_size (z) must have the same length.Nc3>K|]}tj|VdSrA)r program_id).0axiss r$ zsample_block..s>??&*jD!!??????r&)rrtuplerangerblocked_fold_in sample_block) rjrkrlrmrnror^num_axeskeyss r$ryrysH __I&& FC OOFFYFFF G GG:H??.3Hoo?????K  (*j)[ B B$  %$ I 9 917 9 99r&rA)0collections.abcrr;rrrrrjax._srcrr!jax._src.pallas.mosaic.primitivesrr jax._src.pallasr r jax_prngShapeSampleFn SampleFnTypeArrayKeylessSampleFnTypeset_seedr: PRNGKeyArrayr%r,r0intr6r?rEPRNGImplr register_prngrPrRrTrVr\ribitsuniform bernoullirv ArrayLikeryrNr&r$rs%$$$$$ (((((($$$$$$777777>>>>>>&&&&&&%%%%%% ' sCI~.  Jx, J1F J J J J/SY////!fl!s!5!!!! <('#; < < EI 0909\09%209"09"09# 09 $F$4c$9:TA 09 "i 090909090909r&