Vpf dZddlmZddlmZddlZddlmZmZddl Z ddl m Z ddl m Z ddl mZdd lmZdd lmZdd lmZmZdd lmZdd lmZddlmZddlmZddlmZddlmZddl m!Z!m"Z"m#Z#ej$dZ%de%_&d2dZ'e%j(dZ)e%j*dZ+dZ,dZ-dZ.e,ej/e%<e-ej0e%<e.ej1e%<ej2e%ej3e)d d3d4d+Z4 d5d6d1Z5dS)7aJAX primitives related to sparse operations. This is experimental work to explore sparse support in JAX. The primitives defined here are deliberately low-level: each primitive implements a common sparse operation (sparse to dense, dense to sparse, sparse matrix/vector product, sparse matrix/matrix product) for two common sparse representations (CSR and COO). These routines have reference implementations defined via XLA scatter/gather operations that will work on any backend, although they are not particularly performant. On GPU runtimes built against CUDA 11.0/ROCm 5.0 or newer, each operation is computed efficiently via cusparse/hipsparse. Further down are some examples of potential high-level wrappers for sparse objects. (API should be considered unstable and subject to change). ) annotations)partialN)OptionalUnion) tree_util) JAXSparse)BCOO)BCSR)COO)CSRCSC) _coo_extract)mlir)core)dtypes)ad)batching)Array DTypeLikeShapetodenseFarrJAXSparse | ArrayreturnrcRtj|\}}tj|d|iS)zIConvert input to a dense matrix. If input is already dense, pass through.tree)r tree_flatten todense_pbind)rbufsrs [/var/www/html/nettyfy-visnx/env/lib/python3.11/site-packages/jax/experimental/sparse/api.pyrr>s+%c***$  )D ) ))ctj||}t|tr|n|SN)rtree_unflatten isinstancerrrr rs r! _todense_implr(Cs5 t,,#$S)44 =#=r"ctj||}t|tjr|Stj|j|jtj|j S)N) weak_type) rr%r&r ShapedArrayshapedtyperis_weakly_typeddatar's r!_todense_abstract_evalr0HsY t,,#T%&& J #)SY&:PQTQY:Z:Z [ [ [[r"ct|dtjrJtd|ddDsJt j|d|i}t j|dg|ddRd|i}||fS)Nrc3JK|]}t|tjVdSr$)r&rZero).0ts r! z_todense_jvp..Qs. : :Z27 # # : : : : : :r"r)r&rr3allrr)primalstangentsr primals_out tangents_outs r! _todense_jvpr=Os  RW - ---- : :Xabb\ : : : : ::::3d33+ EgabbkEEEEE, l ""r"cLtj|dsJtd|ddDrJt}t j||gt |z}ddlm}m }ddl m }ddl m }||ur|fSt||r|\} } || || fSt||r|\} } } || | || | fSt|tr|\} } } t!| | || | fSt#dt%|)Nrc3>K|]}tj|VdSr$)ris_undefined_primal)r4bufs r!r6z%_todense_transpose..Xs-AA',,AAAAAAr"r7)r r ) _bcoo_extract) bcsr_extractztodense_transpose for )rr@anyobjectrr%lenjax.experimental.sparser r jax.experimental.sparse.bcoorBjax.experimental.sparse.bcsrrCr&r rNotImplementedErrortype)ctrr standinobjr r rBrC_indicesindptrrowcols r!_todense_transposerTVs} Q ( (((( AAQRRAAA A AAAA HH' y3t99'<==#00000000888888777777G^^ 5L#t DJAw =" % %w ..#tDAw < , ,gv ==#sDKAsC S" % %sC // BtCyyBB C CCr"c^tjtt|||dfS)N)rr)jaxvmaprr() batched_args batch_dimsrs r!_todense_batching_rulerZms. @'-d333Z @ @, OQR RRr")multiple_resultsint32bcoor,rr-DTypeLike | None index_dtyper sparse_formatstrrc tttttd}||vr4t d|dt |||}|j|f||d|S)a~Create an empty sparse array. Args: shape: sequence of integers giving the array shape. dtype: (optional) dtype of the array. index_dtype: (optional) dtype of the index arrays. format: string specifying the matrix format (e.g. ['bcoo']). **kwds: additional keywords passed to the format-specific _empty constructor. Returns: mat: empty sparse matrix. )bcsrr]coocsrcsczsparse_format=z not recognized; must be one of )r-r_) r r r r r ValueErrorlistkeys_empty)r,r-r_r`kwdsformatsclss r!emptyrnws4C L L''!! >m>>'+GLLNN';';>> ? ?? # E HK H H4 H HHr"NintM int | Nonekc 0ttttd}||}t jt j|}t jt j|}t jt j|}||}|jd|||||d|S)aCreate 2D sparse identity matrix. Args: N: int. Number of rows in the output. M: int, optional. Number of columns in the output. If None, defaults to `N`. k: int, optional. Index of the diagonal: 0 (the default) refers to the main diagonal, a positive value refers to an upper diagonal, and a negative value to a lower diagonal. dtype: data-type, optional. Data-type of the returned array. index_dtype: (optional) dtype of the index arrays. format: string specifying the matrix format (e.g. ['bcoo']). **kwds: additional keywords passed to the format-specific _empty constructor. Returns: I: two-dimensional sparse matrix with ones along the k-th diagonal. )r]rdrerfN)rqrorsr-r_) r r r r rconcrete_or_erroroperatorindex_eye) rorqrsr-r_r`rkrlrms r!eyerzs$#c# > >'Y A X^Q//! X^Q//! X^Q//! #  NAau+ N N N NNr")rrrr)Nr\r]) r,rr-r^r_rr`rarr)NrNr\r])rorprqrrrsrpr-r^r_rr`rarr)6__doc__ __future__r functoolsrrwtypingrrrVrjax.experimental.sparse._baserrHr rIr jax.experimental.sparse.coor jax.experimental.sparse.csrr r jax.experimental.sparse.utilrjax.interpretersrjax._srcrrjax._src.interpretersrrjax._src.typingrrr Primitiverr[rdef_implr(def_abstract_evalr0r=rTrZprimitive_jvpsprimitive_transposesprimitive_batchersregister_lowering lower_funrnrzrur"r!rs$#""""""""""""" 333333------------++++++00000000555555!!!!!!$$$$$$******3333333333 DN9 % % " ****  >>> \\\ ###DDD.SSS ,)%7 ")?I&y.$.E#+#+#+,,,PW%IIIII*MQ?EOOOOOOOr"