Vpf^_dZddlmZddlmZddlZddlmZddlZddl Z ddl Z ddl m Z ddlmZddlmZmZmZmZdd lmZmZmZdd l mZdd l mZdd lmZdd lmZddlmZddl m!Z!ddl"m#Z#ddl$m%Z%ddl&m'Z'm(Z(m)Z)ddl*m Z+e,e-dfZ.ej/GddeZ0ej/GddeZ1ej2dZ3dUdZ4dVd"Z5d#Z6e3j7d$Z8e j9e6d%&Z:d'Z;d(Ze3eZTdYdZdBZUd%dCdDZVdEZWeTj7dFZXe j9eWd%&ZYdGZZdHZ[dIZ\dJZ]ej>eTe[dde\e]ej?eT<e j@eTeYejAeTe#jBr"e j@eTeeZe#j^d*+e#jDr"e j@eTeeZe#j_d,+ej2dKZ`d%dCd[dMZad%dCd\dNZbdOZce`j7dPZde j9ecd%&ZedQZfdRZgdSZhdTZiej>e`egddeheiej?e`<e j@e`eeejAe`e#rTe#jBr"e j@e`eefe#jjd*+e#jDr&e j@e`eefe#jkd,+dSdSdS)]zDCSR (compressed sparse row) matrix object and associated primitives.) annotations)partialN)Optional)mlir) JAXSparse) _coo_matmat _coo_matvec _coo_todenseCOOInfo) _csr_to_coo _csr_extractCuSparseEfficiencyWarning)lax) tree_util)core)dispatch)ad)_const) gpu_sparse)promote_dtypes)Array ArrayLike DTypeLike.c(eZdZUdZded<ded<ded<ded<edZed Zed Zfd Z e d e j d dZ e d dddZe d dddZdZddZdZdZe dZxZS)CSRaExperimental CSR matrix implemented in JAX. Note: this class has minimal compatibility with JAX transforms such as grad and autodiff, and offers very little functionality. In general you should prefer :class:`jax.experimental.sparse.BCOO`. Additionally, there are known failures in the case that `nse` is larger than the true number of nonzeros in the represented matrix. This situation is better handled in BCOO. jax.Arraydataindicesindptrtuple[int, int]shapec|jjSNrsizeselfs [/var/www/html/nettyfy-visnx/env/lib/python3.11/site-packages/jax/experimental/sparse/csr.pyz CSR.= dinc|jjSr#rdtyper&s r(r)z CSR.>  r+c*|j|j|jfSr#)rrrr&s r(r)z CSR.?sDL$+ Fr+cttj|\|_|_|_t ||dSNr!mapjnpasarrayrrrsuper__init__r'argsr! __class__s r(r9z CSR.__init__AD+.s{D+A+A(DIt|T[ GGT'''''r+Nnse index_dtypecZ||dk}t|||SNrr>)sum csr_fromdenseclsmatr?r@s r( fromdensez CSR.fromdenseEs/ { AXNN  c #; ? ? ??r+int32r.r@ct|}t|dkrtd|tjd|}tjd|}tj|ddz|}||||f|S)z>Create an empty CSR instance. Public method is sparse.empty().z CSR must have ndim=2; got shape=rr3tuplelen ValueErrorr6emptyzerosrFr!r.r@rrrs r(_emptyz CSR._emptyK %LLE 5zzQ .er+cSr#rZksr(r)zCSR._eye..ear+cSr#rZr[sr(r)zCSR._eye..hr]r+cSr#rZr_sr(r)zCSR._eye..hrar+rMlengthr3)minrUr6onesarangerraddcondastypesubrSatsetcumsumbincount)rFNMr`r.r@ diag_sizeridxcolrrowrr\s ` @r(_eyezCSR._eyeVs1uuaQ--iia!eQ--iA~~ ZZAeZ E EE 8IU + + +D *Yk 2 2 2C #q>>DsAA '#sxQ iiii@@ A ACjj%%G '#sxQ iiii@@ A AC Yq1uK 0 0 0 3ABB 7 ; ; 3<A...55kBBCCEEF 3gv&q!f 5 5 55r+c t|Sr#) csr_todenser&s r(todensez CSR.todensems t  r+cl|Jt|j|j|jf|jdddSNr3)CSCrrrr!r'axess r( transposez CSR.transposep8 <<<  4<5TZ"=M N N NNr+ct|trtdtj|}t |j|\}}|jdkr#t||j |j ||j S|jdkr#t||j |j ||j Std|j )N"matmul between two sparse objects.rMr3rLmatmul with object of shape isinstancerNotImplementedErrorr6r7rrndim _csr_matvecrrr! _csr_matmatr'otherrs r( __matmul__zCSR.__matmul__ts%##F  D E EE K  E E22KD% zQ t|T[%tz R R RR q t|T[%tz R R RR  Lu{ L L M MMr+c<|j|j|jfd|jifSNr!rrrr!r&s r( tree_flattenzCSR.tree_flatten! It|T[ 1GTZ3H HHr+ct|}|\|_|_|_|dhkrt d||jjdi||S)Nr!z%CSR.tree_unflatten: invalid aux_data=rZ object__new__rrrkeysrQ__dict__updaterFaux_datachildrenobjs r(tree_unflattenzCSR.tree_unflattenq ..  C(0%CHck3:}}7)## AhAA B BBCL##(### Jr+r#)__name__ __module__ __qualname____doc____annotations__propertyr?r._bufsr9 classmethodnprIrHrUrwrzrrrr __classcell__r<s@r(rr-s  ///,,--# (// 0 0% (FF G G%(((((!%28@@@@;@ "&G5555;5"&G6666;6,OOOO N N NIII;r+rceZdZUdZded<ded<ded<ded<edZed Zfd Ze d e j d d Z e d dddZ e d dddZdZddZdZdZe dZxZS)r~zBExperimental CSC matrix implemented in JAX; API subject to change.rrrrr r!c|jjSr#r$r&s r(r)z CSC.r*r+c|jjSr#r-r&s r(r)z CSC.r/r+cttj|\|_|_|_t ||dSr2r4r:s r(r9z CSC.__init__r=r+Nr>cn||dk}t|j||jSrB)rCrDTrEs r(rHz CSC.fromdenses4 { AXNN  c C[ A A A CCr+rIrJct|}t|dkrtd|tjd|}tjd|}tj|ddz|}||||f|S)z>Create an empty CSC instance. Public method is sparse.empty().rLz CSC must have ndim=2; got shape=rrMr3rNrTs r(rUz CSC._emptyrVr+cLt||| ||jS)NrJ)rrwr)rFrqrrr`r.r@s r(rwzCSC._eyes# 88Aq1"E{8 C C EEr+c4t|jjSr#)ryrr&s r(rzz CSC.todenses tv    r+cl|Jt|j|j|jf|jdddSr|)rrrrr!rs r(rz CSC.transposerr+c t|trtdtj|}t |j|\}}|jdkr-t||j |j ||j ddddS|jdkr-t||j |j ||j ddddStd|j )NrrMr}Tr!rrLrrrs r(rzCSC.__matmul__s%##F  D E EE K  E E22KD% zQ t|T[%#z$$B$/4AAAA q t|T[%#z$$B$/4AAAA Lu{ L L M MMr+c<|j|j|jfd|jifSrrr&s r(rzCSC.tree_flattenrr+ct|}|\|_|_|_|dhkrt d||jjdi||S)Nr!z%CSC.tree_unflatten: invalid aux_data=rZrrs r(rzCSC.tree_unflattenrr+r#)rrrrrrr?r.r9rrrIrHrUrwrzrrrrrrs@r(r~r~sJJ///,,--# (// 0 0%(((((!%28DDDD;D "&G5555;5"&GFFFF;F!!!OOOO N N NIII;r+r~ryrGreturnrcPt|j|j|j|jS)zConvert a CSR-format sparse matrix to a dense matrix. Args: mat : CSR matrix Returns: mat_dense: dense version of ``mat`` r3) _csr_todenserrrr!)rGs r(ryrys# ch SZsy I I IIr+rrrr!Shapec>t||||S)a_Convert CSR-format sparse matrix to a dense matrix. Args: data : array of shape ``(nse,)``. indices : array of shape ``(nse,)`` indptr : array of shape ``(shape[0] + 1,)`` and dtype ``indices.dtype`` shape : length-2 tuple representing the matrix shape Returns: mat : array with specified shape and dtype matching ``data`` r3) csr_todense_pbindrs r(rrs!   D'6  ? ??r+cZt|gt||Rdt|iS)Nspinfor3)r r r rs r(_csr_todense_implrs6 d W[&99 W W W'PUBVBVBV W WWr+c|j|jcxkr|jcxkrdksnJ|j|jksJ|j|jksJ|jd|ddzksJtj||jS)NrMr)rr.r!r ShapedArrayrs r(_csr_todense_abstract_evalrs gl 6 6 6 6fk 6 6 6 6Q 6 6 6 6 6 6 &, & & & & w} $ $ $ $ aE!HqL ( ( ( ( % , ,,r+F)multiple_resultsc4|j\}}}|j} tj| tjsQtj| tjs2t jd| dtt|||||S|||||| |jgS)Nz@csr_todense cusparse/hipsparse lowering not available for dtype=). Falling back to default implementation.r3)r! data_dtyper@) avals_inr.r issubdtypefloatingcomplexfloatingwarningswarnr_csr_todense_lowering) csr_todense_hloctxrrrr! data_aval indices_aval_r.s r(_csr_todense_gpu_loweringrs"|)\1 /% -r{ + +Jr}UBDV/W/WJ Mv(F(FH F G GG U      v{0 0 0 0 0 TY_ $ $ $ $ gvr * *GV ;;r+cuda)platformrocmrDTr>r? int | Noner@rc|%t|dk}tjtj|d}t t||||jS)aECreate a CSR-format sparse matrix from a dense matrix. Args: mat : array to be converted to CSR. nse : number of specified entries in ``mat``. If not specified, it will be computed from the input matrix. index_dtype : dtype of sparse indices Returns: mat_coo : CSR representation of the matrix. Nrzcoo_fromdense nse argumentr>r3) intrCrconcrete_or_erroroperatorindexr_csr_fromdenser!)rGr?r@nse_ints r(rDrD/s_ [ saxnn  C  "8>38T U U' ^CW+ F F Fci X X XXr+)r@rtuple[Array, Array, Array]ctj|}tjtj|d}t ||tj |S)aCreate CSR-format sparse matrix from a dense matrix. Args: mat : array to be converted to CSR. nse : number of specified entries in ``mat`` index_dtype : dtype of sparse indices Returns: data : array of shape ``(nse,)`` and dtype ``mat.dtype``. indices : array of shape ``(nse,)`` and dtype ``index_dtype`` indptr : array of shape ``(mat.shape[0] + 1,)`` and dtype ``index_dtype`` znse argument of csr_fromdense()r>) r6r7rrrrcsr_fromdense_prrr.)rGr?r@s r(rr@sO C# x~s4UVV#   cs8M8M  N NNr+cptj|}|jdksJ|jd}tj||\}}|||f}tj||dkk}tj||d}tj|||}||}tj |dz|j dd tj tj |||} ||| fS)NrLr)r%rMrXrd)r6r7rr!nonzerorhrCwhererkrSrmrnrorp) rGr?r@mrvrur true_nonzerosrrs r(_csr_fromdense_implrQs C# Q il! [3 ' ' '(#s S#X$*S//SAXNN$4$44- =$ * *$ -a((# JJ{ # #' 9QU+ . . . 1!"" 5 9 9 jc!,,,33K@@AA C C& w r+ctj|f|j}tj|f|}tj|jddzf|}|||fS)NrrM)rrr.r!)rGr?r@rrrs r(_csr_fromdense_abstract_evalrasY 3&#) , ,$  cV[ 1 1'  SYq\A-/ = =& w r+c |jdj}tj|tjsPtj|tjs1t jd|dtt||||S|||tj||tj tj|\}}}|||gS)NrzBcsr_fromdense cusparse/hipsparse lowering not available for dtype=rr>)nnzr@r index_type) rr.rrrrrrr_csr_fromdense_loweringrdtype_to_ir_type) csr_fromdense_hlorrGr?r@r.rrrs r(_csr_fromdense_gpu_loweringrks ,q/ % -r{ + +Or}UBDV/W/WO M)rtyperZero from_valuer ) primalstangentsr?r@rrMdot primals_outrrrr tangents_outs r(_csr_fromdense_jvprws"! %$qc{CCC+%$ $ZZ27w!!$''HHGVT22HBG..w779K9KF9S9ST, l ""r+cZ|\}}}t||ksJ|j|jcxkr|ksnJt|tjst|tjrt dtj|sJt||||jj S)Nrr3) rPr.rrrrQrrrr!)rrrr?r@rrrs r(_csr_fromdense_transposer s$ Tc     &, 5 5 5 5+ 5 5 5 5 5 5!!HZ%@%@H F G GG  " """" dGV16< @ @ @@r+ csr_matvecvrboolcL|j\}}}t|||||j|S)aProduct of CSR sparse matrix and a dense vector. Args: mat : CSR matrix v : one-dimensional array of size ``(shape[0] if transpose else shape[1],)`` and dtype ``mat.dtype`` transpose : boolean specifying whether to transpose the sparse matrix before computing. Returns: y : array of shape ``(mat.shape[1] if transpose else mat.shape[0],)`` representing the matrix vector product. r)rrr!)rGr rrrrs r(r r /)$ T7FASY) T T TTr+)rcBt||||||S)aNProduct of CSR sparse matrix and a dense vector. Args: data : array of shape ``(nse,)``. indices : array of shape ``(nse,)`` indptr : array of shape ``(shape[0] + 1,)`` and dtype ``indices.dtype`` v : array of shape ``(shape[0] if transpose else shape[1],)`` and dtype ``data.dtype`` shape : length-2 tuple representing the matrix shape transpose : boolean specifying whether to transpose the sparse matrix before computing. Returns: y : array of shape ``(shape[1] if transpose else shape[0],)`` representing the matrix vector product. r) csr_matvec_prrrrr r!rs r(rrs%"   4&!5I  V VVr+c`t|gt|||Rt||dSNr3)rr)r r r rs r(_csr_matvec_implr> T nK88 n! n nGRWDXDXDXdm n n nnr+ct|dksJ|j|jcxkr|jcxkr|jcxkrdksnJ|j|jksJ|j|jksJ|j|jksJ|jd|ddzksJ|r|dn|d}|jd|r|dn|dksJt j|f|jSNrLrMrrPrr!r.rr)rrrr r!r out_shapes r(_csr_matvec_abstract_evalrs Uq 49 @ @ @ @ @ @ @ @ @ @ @ @q @ @ @ @ @ @ w} $ $ $ $ qw     &, & & & & aE!HqL ( ( ( (#1eAhhq) I;a58 < < < < 9, 3 33r+c .|j\}} } } |j} | tjtjtjtjfvr4tjd| dtt|||||||S|||||||| | j| j gS)Nz?csr_matvec cusparse/hipsparse lowering not available for dtype=rr)r!rrr@x_dtype) rr.rfloat32float64 complex64 complex128rrr_csr_matvec_lowering) csr_matvec_hlorrrrr r!rrrrv_avalr.s r(_csr_matvec_gpu_loweringr$s'*|$)\1f /% 2:rz2<GGG M >>r+c 8|j\}} } } |j} | tjtjtjtjfvr4tjd| dtt|||||||S|||||||| j|j| j gS)Nz?csr_matmat cusparse/hipsparse lowering not available for dtype=rr)r!rr@rB_dtype) rr.rrrrr rrr_csr_matmat_lowering) csr_matmat_hlorrrrr1r!rrrrB_avalr.s r(_csr_matmat_gpu_loweringr?Hs'*|$)\1f /% 2:rz2<GGG Mrks KJ"""""" !!!!!!333333WWWWWWWWWWWW]]]]]]]]]]$$$$$$############......7777777777 c3h %\\\\\)\\&%\~ %AAAAA)AA&%AN}-- JJJJ @ @ @ @XXX --! -'/// ' ' '>>> < < <  -)4666)? &}&;<<<]### $ g')DEE$ g')DEE!$.11#' 37RTRZYYYYYY"FHXOOOOOO" "#" )$.)<:>@@@ ! ! !### AAA&8/"+C((?@@@_%%% $ g):+HII$ g):+HIIt~l++ UUUUU"?DWWWWW&ooo 4 4  4&t~&6OOO O O OUUUUUU 0 0 0  ,+T49LMMM(= %|%9:::\""" $ g& (BCC$ g& (BCCt~l++ 8=UUUUUU$49WWWWWW(ooo ? ?  ?&t~&6OOO   UUUUUU 9 9 9  ,,dD:OPPP(= %|%9:::\""" !D(**DEE!D(**DEE   r+