Vpf6 ddlmZddlmZmZddlZddlmZddlm Z m Z ddlm Z eZ ejZGddeZd eed ed ed eed ef dZdejd ed eded ee d e f dZdede d eded ej f dZdS))Sequence)AnyProtocolN)random)Array ArrayLike)numpyc,eZdZdejdedefdZdS)SampleFnkeyshapereturncdSN)selfr r argskwargss X/var/www/html/nettyfy-visnx/env/lib/python3.11/site-packages/jax/_src/blocked_sampler.py__call__zSampleFn.__call__sCN)__name__ __module__ __qualname__r KeyArrayLikeShaperrrrrr r sA&-U!rr iteration_index total_size block_size block_indexrct|}d}d}t|dz ddD]/}||||||zz}|||zz }|||z}0|S)Nr)lenrange) rrrr ndimsdim_size total_idxidim_idxs r_compute_scalar_indexr+s{ o  % () q"b ! !a!nq1JqMAAG 8##I 1 HH r global_key tile_sizectdt||DfddtS)aNComputes a grid of keys for block-invariant sampling. Suppose we wished to construct a 16x512 array of random numbers, using block sizes of 16x128 and 16x256. We could select an tile size of 8x128 (which divides both 16x128 and 16x256) and divide the total array in tiles as: --------------------------------- | 8x128 | 8x128 | 8x128 | 8x128 | --------------------------------- | 8x128 | 8x128 | 8x128 | 8x128 | --------------------------------- We generate a key for each tile as: tile_key = fold_in(global_key, tile_idx) Where the tile_idx is the row-major raveled index of each element: ----------------- | 0 | 1 | 2 | 3 | ----------------- | 4 | 5 | 6 | 7 | ----------------- We then compute and return the keys required to sample the tiles that make up the current block (specified via `block_index`). With a 16x256 block size, each block requires 4 (2x2) tile keys: --------------- | 0, 1 | 2, 3 | | 4, 5 | 6, 7 | --------------- Therefore, we return a grid of 2x2 keys for each block (2 blocks total). With a 16x128 block size, each block requires 2 (2x1) tile keys: ----------------- | 0 | 1 | 2 | 3 | | 4 | 5 | 6 | 7 | ----------------- Therefore, we return a grid of 2x1 keys for each block (4 blocks total). Args: global_key: The global key shared between all blocks. total_size: The shape of the array being generated. block_size: The shape of an individual block. tile_size: The shape of a `tile`, which is the smallest unit at which samples are generated. This should be selected to be a divisor of all block sizes one needs to be invariant to. block_index: The index denoting which block to generate keys for. Returns: An N-dimensional nested list of keys required to sample the tiles corresponding to the block specified by `block_index`. c3&K|] \}}||zV dSrr.0_shape_elements r z"blocked_fold_in..fsDMM-VXfMMMMMMrc |tkr2tjt  |}|Sg}t |D](}||dz||fz)|S)Nr")r$jaxrfold_inr+r%append) axisprefix subtile_keykeysr) _keygen_loopr r,size_in_blocksrs rr=z%blocked_fold_in.._keygen_loopis s>""""J&& +:~v??@@k d^D)**77! LLa556666 krr)tuplezip)r,rrr-r r=r>s`` `@@rblocked_fold_inrA-srMM14Z1K1KMMMMM.          a ! !!r sampler_fnr<c Xtdt|Ddtjdtt dtjffd dt dtt dfdtjffd d tS) aQDraws random samples for a single block. This function is intended to be used in conjunction with `blocked_fold_in`: ``` key_list = blocked_fold_in(global_key, total_size, block_size, tile_size, block_index) samples = sample_block(jax.random.uniform, key_list, block_size, tile_size) ``` Args: sampler_fn: A random sampling function, e.g. jax.random.uniform. keys: A grid of keys generated by `blocked_fold_in`. block_size: The shape of an individual block. tile_size: The shape of a `tile`, which is the smallest unit at which samples are generated. This should be selected to be a divisor of all block sizes one needs to be invariant to. args: varargs for sampler_fn. kwargs: kwargs for sampler_fn. Returns: An array of random samples drawn using sampler_fn. c3&K|] \}}||zV dSrrr0s rr4zsample_block..sDMM-VXfMMMMMMrarridxrct|dkr||dS||d|ddS)Nr"r)r$)rErF _nested_indexs rrHz#sample_block.._nested_indexsB 3xx1}} Q[ =SVc!""g . ..rr9r:.c|t kr |gRd iSg}t |D](}||dz||fz)tj||S)Nr r")r9)r$r%r8jnp concatenate) r9r:samplesr)rH _sample_looprr<rrB size_in_tilesr-s rrMz"sample_block.._sample_loops s=!!!! Z dF333d333'3+1333g]4())::!||DFFA4K889999 _W4 0 0 00rr)r?r@r6rrint) rBr<rr-rrrHrMrNs `` ```@@@r sample_blockrPws<MM14Z1K1KMMMMM-//#/39////// 11eCHo1#)1111111111111 a ! !!r)collections.abcrtypingrrr6jax._srcrjax._src.typingrrr rJ NdKeyListrr rOr+rrArPrrrrVs%$$$$$ ,,,,,,,,   x 8C= &+ &+ (0} :=    G"!G"G"G" G"  " G"  G"G"G"G"T."." ."." ." y."."."."."."r