VpfHdZddlmZddlmZddlmZddlZddlm Z m Z ddl Z ddl Z ddlZddlm ZddlmZddlmZdd lmZdd lmZdd lmZmZmZmZmZmZmZdd lm Z m!Z!dd l"m#Z#ddl"m$Z$ddl"m%Z%ddl"m&Z&ddl'm(Z(m)Z)ddl*m+Z+ddl,m-Z-ddl.m/Z/ddl.m0Z0ddl.m1Z1ddl2m3Z3m4Z4m5Z5dddZ6dddZ7ddZ8Gd d!e Z9dd&Z:dd+Z;dd-Zd/dd4Z?e%j@d5ZAd6eA_Bd7ZCdddej>d8dd=ZDddej>d>dd@ZEeAjFdAZGeAjHdBZIdCZJdDZKdEZLeKe/jMeA<eLe/jNeA<eJe0jOeA<e1jPeAe1jQeGd6Fe%j@dGZRddHZSddKZTeRjFdLZUeRjHdMZVdNZWdOZXdPZYe/jZeReXddeYe/jNeR<eWe0jOeR<e1jPeRe1jQeUdQFe%j@dRZ[ddSZ\e[jFdTZ]e[jHdUZ^dVZ_dWZ`dXZae/jZe[dde_e`e/jNe[<eae0jOe[<e1jPe[e1jQe]dQFe%j@dYZbdddZddcZcddiZddjZeebjHdkZfdlZgdmZhdnZidoZje/jZebegddeheie/jNeb<eje0jOeb<dpZke1jQekd6FZlddqZme1jQeedQFZne1jPebene&joebe+jpr(e1jPebeeme+jqe+jrdrse+jsr(e1jPebeeme+jte+judtsddwZvdd{ZwejxGd|deZyd}Zzd~Z{e0j|eye}e}eze{ddS)zEBCSR (Bached compressed row) matrix object and associated primitives.) annotations)Sequence)partialN)Any NamedTuple)lax) tree_util) JAXSparse)bcoo) nfold_vmap_count_stored_elements _csr_to_coo_dot_general_validated_shapeCuSparseEfficiencyWarning SparseInfoShape) split_listsafe_zip)api_util)config)core)dispatch)DotDimensionNumbers_dot_general_batch_dim_nums) gpu_sparse)hlo)ad)batching)mlir)Array ArrayLike DTypeLikematBCSRnse int | Nonereturncttj||S)z'Eliminate zeros in BCSR representation.r%)r$ from_bcoor bcoo_eliminate_zerosto_bcoor#r%s \/var/www/html/nettyfy-visnx/env/lib/python3.11/site-packages/jax/experimental/sparse/bcsr.pybcsr_eliminate_zerosr/3s, 1#++--SIII J JJcttj||S)aSums duplicate indices within a BCSR array, returning an array with sorted indices. Args: mat : BCSR array nse : integer (optional). The number of specified elements in the output matrix. This must be specified for bcoo_sum_duplicates to be compatible with JIT and other JAX transformations. If not specified, the optimal nse will be computed based on the contents of the data and index arrays. If specified nse is larger than necessary, data and index arrays will be padded with standard fill values. If smaller than necessary, data elements will be dropped from the output matrix. Returns: mat_out : BCSR array with sorted indices and no duplicate indices. r))r$r*r bcoo_sum_duplicatesr,r-s r.bcsr_sum_duplicatesr38s. 0CHHH I IIr0c|\}}}|\}}} |jdz t|duztfd|Dstd|ddd||f||f|| ffD\} } } |'t dt ||D}t |g|jR|j|j } | | | | fS) Nc3@K|]}|dupd|cxkokncVdSNr).0bn_batchs r. z,_bcsr_batch_dims_to_front..NsH ? ?qQ$Y *!q****7**** ? ? ? ? ? ?r0zEbatch_dims must be None or satisfy 0 < dim < n_batch. Got batch_dims=z for n_batch=.c3xK|]5\}}|tj|dgntj||dV6dSr7)r expand_dimsjnpmoveaxis)r9argbdims r.r<z,_bcsr_batch_dims_to_front..Qsg3\3\ #t$(.Us2eeSUXUdSYs^UdUdUdUdeer0indices_sortedunique_indices) ndimintallNotImplementedErrormaxziprrGrJrK) batched_args batch_dimsspinfo batch_sizedataindicesindptr data_bdim indices_bdim indptr_bdim batched_databatched_indicesbatched_indptrbatched_spinfor;s @r._bcsr_batch_dims_to_frontr`JsO&$)3&)\; L1 s<4#788 8' ? ? ? ?J ? ? ? ? ?D C%/CC7>CCC D DD3\3\y)G\+BV[DYZ3\3\3\/,eeC j4Q4QeeeeeJz9FL99-3-B-3-BDDD.  FFr0c.eZdZUded<ded<ded<dS)BCSRPropertiesrMr;n_denser%N)__name__ __module__ __qualname____annotations__r8r0r.rbrb\s+,,,,,, (((((r0rbshape1 Sequence[int]shape2boolcPtdt||DS)Nc3(K|] \}}|d|fvVdS)r5Nr8)r9s1s2s r.r<z_compatible..cs. B Bvr2RAr7] B B B B B Br0)rNr)rhrjs r. _compatiblerpbs) B B&&)A)A B B B B BBr0rW jax.ArrayrXrGctj|jtjsJtj|jtjsJt |}|jd}|jdz }t||z dz }|dksJt|jd||d|std|jd|t|jd||d|std|jd||j|d||dzfkrtdt||| S) Nr5rz:indices batch dimensions not compatible for indices.shape=, shape=z8indptr batch dimensions not compatible for indptr.shape=z0indptr shape must match the matrix shape plus 1.)r;rcr%) r@ issubdtypedtypeintegertuplerGrLlenrp ValueErrorrb)rWrXrGr%r;rcs r._validate_bcsr_indicesr|fsU  s{ 3 3333  ck 2 2222 ,,% b# L1 ' JJ 1 $' A W]8G8,eHWHo > >` ^GM^^V[^^ _ __ V\(7(+U8G8_ = =^ \6<\\TY\\ ] ]] \'((g 2444 G H HH c B B BBr0rVc t|||}t|}|j|j|j}}}t ||z |z }|dkrt d|dt|jd||d|st d|jd||j|dz d|f||dzdzkr t d|jd|d |d ||S) Nrtz*BCSR array must have 2 sparse dimensions; z is given.z4data batch dimensions not compatible for data.shape=rur5zInvalid data.shape=z for nse= , n_batch= , n_dense=) r|ryr;rcr%rzr{rprG) rVrWrXrGpropsr;rcr%n_sparses r._validate_bcsrr{s& &% 8 8% ,,%- C7' ZZ' !G +( ]] - --- . .. TZ)5'? ; ;Z XXXPUXX Y YY Z'A+ SFU7Q;<<-@$@@@ P PP#PP'PPgPP Q QQ ,r0ct|||\}}}tt|}tj||||jS)z4Given BCSR (indices, indptr), return BCOO (indices).)axis)r|r rr@stackrL)rWrXrGr;_ csr_to_coos r. _bcsr_to_bcoorsM)&%@@-'1a+w//* ::gv..W\ B B BBr0) index_dtyper rr"tuple[Array, Array]ctj||\}}}}|dkrtd||tt|dfd}|d||dfS)zGiven BCOO (indices), return BCSR (indices, indptr). Note: this assumes that ``indices`` are lexicographically sorted within each batch. rtz6Must have 2 sparse dimensions to be converted to BCSR.F)N broadcastedctjdz}|jddtjtj|S)Nr5)length)r@zerosatsetcumsumbincountastype)irXrn_rowss r.get_ptrz_bcoo_to_bcsr..get_ptrsh Yvz; / /F 9QRR=  SZ Qv&&&--k::<< = ==r0).r5).r)r _validate_bcoo_indicesr{rr )rWrGrr;rrrrs ` @r. _bcoo_to_bcsrrs !7GG'8Q ]] M N NN >& :e444=====54= '''&/22 22r0bcsr_fromdenseTz The error arose for the nse argument of bcsr_fromdense. In order for BCSR.fromdense() to be used in traced/compiled code, you must pass a concrete value to the nse (number of stored elements) argument. r%r;rcrr!r;rMrcc tj|}|}|t|||}tjt j|t}tt||||||j S)aCreate BCSR-format sparse matrix from a dense matrix. Args: mat : array to be converted to BCOO. nse : number of stored elements in each batch n_batch : number of batch dimensions (default: 0) n_dense : number of dense dimensions (default: 0) index_dtype : dtype of sparse indices (default: int32) Returns: mat_bcsr: BCSR representation of the matrix. NrrF) r@asarrayr rconcrete_or_erroroperatorindex_TRACED_NSE_ERRORr$_bcsr_fromdenserG)r#r%r;rcr mat_arraynse_arrnse_ints r.rrsk#) #' _$YAAG'ARSS' oiWg&-;HHHO % % %%r0)r;rcrtuple[Array, Array, Array]ctj|}tjtj|t }t|||||S)aCreate BCSR-format sparse matrix from a dense matrix. Args: mat : array to be converted to BCSR, with ``ndim = n_batch + n_sparse + n_dense``. nse : number of stored elements in each batch. n_batch : number of batch dimensions (default: 0) n_dense : number of dense dimensions (default: 0) index_dtype : dtype of sparse indices (default: int32) Returns: data : array of shape ``mat.shape[:n_batch] + (nse,) + mat.shape[mat.ndim - n_dense:]`` and dtype ``mat.dtype`` indices : array of shape ``mat.shape[:n_batch] + (nse,)`` and dtype of ``index_type``. indptr: array of shape ``mat.shape[:n_batch] + (mat.shape[n_batch] + 1,)`` and dtype of ``index_type``. r) r@rrrrrrbcsr_fromdense_pbind)r#r%r;rcrs r.rrsR* C# x~s4EFF#   sWg+6  8 88r0ctj|}|j|z |z }|dkrtdt j|||||}t |j|j\}}|j ||fS)Nrt.bcsr_fromdense: must have 2 sparse dimensions.r%rrcr;rF) r@rrLr{r bcoo_fromdenserrWrGrV) r#r%r;rcrrbcoo_matrWrXs r._bcsr_fromdense_implrs C# X ' )( ]] E F FF  #;)0'CCC(!("2#)DDD/'6  ''r0c|j|z |z }|dkrtd|jd||fz|j||zdz}|jd||fz}|jd||j|dzfz}tj||jtj||tj||fS)Nrtrr5)rLr{rGr ShapedArrayrw) r#r%r;rcrr data_shape index_shape indptr_shapes r._bcsr_fromdense_abstract_evalrs X ' )( ]] E F FFy'"cV+ci(8J8K8K.LL* (7(#sf,+8G8$ '(:Q(>'@@,  :sy 1 1  ; 4 4  < 5 5 77r0c|\}|\}d|cxkr|ksntd|d|t|||dz|||||ffS)Nrz'Expected 0 < bdim <= n_batch; got bdim=r~r5r)r{r)rRrSr%r;rcrMrCs r._bcsr_fromdense_batching_rulers{"! %$ t    w     M$MM7MM N NN Wq['Wb c c cfjlprvew wwr0cd|\}|\}t|||||}|\} } } t|tjur tj| } nt | | |} | tj| tj| f} || fS)Nr)rtyperZero from_value bcsr_extract)primalstangentsr%r;rcrrMdot primals_outrVrWrXdata_dot tangents_outs r._bcsr_fromdense_jvpr s"! %$sGWZefff+%$ $ZZ27w!!$''HHGVT22HBG..w779K9KF9S9ST, l ""r0cZ|\}}}|j|z |z } |j|jd||fz|j|| zdzksJ|j|jd|| |fzksJ|j|jd||j|dzfzksJ|j|ksJ|j|ksJt|tjst|tjrt dt j|sJt|||t|j jS)Nr5/Cannot transpose with respect to sparse indicesrT) rLrGrw isinstancerrr{is_undefined_primal _bcsr_todenseraval) ctrr%r;rcrrVrWrXrs r._bcsr_fromdense_transposersL$ Vg  '( qwxx(C61AGGh.B-DD D D D D + % % % %  $ $ $ $!!HZ%@%@H F G GG  " """" tWfZ 5M5M N N NNr0)multiple_results bcsr_todensecPt|j|j|j|jS)zConvert batched sparse matrix to a dense matrix. Args: mat: BCSR matrix. Returns: The dense version of ``mat``. r)rrVrWrX_info)r#s r.rr6s# sxcj K K KKr0rTrcttj|tj|tj||S)a Convert batched sparse matrix to a dense matrix. Args: data : array of shape ``batch_dims + (nse,) + dense_dims``. indices : array of shape ``batch_dims + (nse,)``. indptr : array of shape ``batch_dims + (shape[len(batch_dims)] + 1,). spinfo : SparseInfo. In particular, this includes the shape of the matrix, which is equal to ``batch_dims + 2(sparse_dims) + block_dims`` where ``len(sparse_dims) == 2``. Returns: mat : array with specified shape and dtype matching ``data`` r)bcsr_todense_prr@r)rVrWrXrTs r.rrBsK   S[.. G0D0D [00  A AAr0c|j}t|||}tj||f|SNrF)rGrr BCOOtodense)rVrWrXrTrG bcoo_indicess r._bcsr_todense_implrUsC ,%we<<<, )T<( 6 6 6 ? ? A AAr0ch|j}t||||tj||jSrE)rGrrrrw)rVrWrXrTrGs r._bcsr_todense_abstract_evalr\s2 ,%w... % , ,,r0cXt|||\}}}}t||||dfS)Nrr)r`r)rRrSrTrVrWrXs r._bcsr_todense_batching_rulercs9";L*V\"]"]$ tWfV < < v(F(FH F G GG U     TY_ $ $ $ $ gvr * *GV ;;r0Frc:t|||S)zExtract values from a dense matrix at given BCSR (indices, indptr). Args: indices: An ndarray; see BCSR indices. indptr: An ndarray; see BCSR indptr. mat: A dense matrix. Returns: An ndarray; see BCSR data. )bcsr_extract_pr)rWrXr#s r.rrs   Wfc 2 22r0ctj|}t|||j}t j||Sr)r@rrrGr _bcoo_extract)rWrXr#rs r._bcsr_extract_implrs: C#wci@@@, L# . ..r0ct|||j\}}}|jd||fz|j|j|z dz}tj||jSrE)r|rGrLrrrw)rWrXr#r;rcr% out_shapes r._bcsr_extract_abstract_evalrsa0&#)LL'7Ci!SF*SYsx'7I7J7J-KK) )SY / //r0cH|j|jksJt|||SrE)rGr)arr_dotrWrXarrs r._bcsr_extract_jvprs) #) # # # # gvw / //r0c $tj|sJtj|stj|rtd|j|jjksJ||t |||t |jjfS)Nrr)rrr{rwrrrrG)rrWrXrs r._bcsr_extract_transposers  $ $$$$G$$H(>v(F(FH F G GG SX^ # # # # &-GVJsx~D^D^___ __r0c2|\}}}d|D}t|dkrtdtt|}|dt j||f}|dt j||f}|dLt |j}|||j|t j |||f}|j dz }||krtd|d|t||||fS)Nch|]}||SrEr8)r9r:s r. z._bcsr_extract_batching_rule..s 5 5 5Aq}a}}}r0r5z+bcoo_extract with unequal batch dimensions.rrtz batch_dims=z' out of range for indices with n_batch=) rzrOnextiterrr?listrGinsertbroadcast_in_dimrLr{r) rRrSrWrXrbdim_setrC result_shaper;s r._bcsr_extract_batching_rulers#%'63 5 5 5 5 5(]]a K L LL d8nn  $]ogw//G] _VdW - -F] ??LgmD1222 sL4' : :C L1 ' W__ N NNGNN O OO gvs + +T 11r0bcsr_dot_general) precisionpreferred_element_typelhs BCSR | Arrayrhsdimension_numbersrrNonerc `~t|tjtjfryt|tjtjfrt j||||St|tr&|j\}}}t|||||||j Std)a<A general contraction operation. Args: lhs: An ndarray or BCSR-format sparse array. rhs: An ndarray or BCSR-format sparse array.. dimension_numbers: a tuple of tuples of the form `((lhs_contracting_dims, rhs_contracting_dims), (lhs_batch_dims, rhs_batch_dims))`. precision: unused preferred_element_type: unused Returns: An ndarray or BCSR-format sparse array containing the result. If both inputs are sparse, the result will be sparse, of type BCSR. If either input is dense, the result will be dense, of type ndarray. rrrr lhs_spinfozDbcsr_dot_general currently implemented for BCSR lhs and ndarray rhs.) rnpndarrayjaxr r dot_generalr$_bufs_bcsr_dot_generalrrO)rrrrrlhs_data lhs_indices lhs_indptrs r.rrs(bj#),-- 5# CI.//L _S#9J4JLLLL#t5*-)'h Z xj#1B6L*-)5555 3 4 44r0rrrrrc |\\}}\} } tj|tj|f} tj| tj| f} tt j|t j|t j|t j|| | f||SNr)r_ensure_index_tuplebcsr_dot_general_prr@r) rrrrrrr lhs_contract rhs_contract lhs_batch rhs_batchcdimsbdimss r.r r s :K6< 6I  ' 5 5  ' 5 5 7%  ' 2 2  ' 2 2 4%  X!6!6!$[!9!9!$Z!8!8#+c:J:J495>8N,6 ! 8 88r0ctj|}tj|}tj|}tj|}t|||j} t j|| ||||SNrFr)r@rrrGr _bcoo_dot_general_impl) rrrrrrrlhs_bcsr_indiceslhs_bcsr_indptrlhs_bcoo_indicess r._bcsr_dot_general_implr!s [ " "([--K ++/ C#"#3_)3)9;;; $X/?7H.&s/99Aema 999999r0z4bcsr_dot_general: contracting over dense dimensions.)r|rGr  eval_shaperrr ShapeDtypeStructrwrPr;rOanyrr) rrrrrrrlhs_contractingrrout_avalrs @r._bcsr_dot_general_abstract_evalr*s!*;&?AA j*:J K K% ^ CO/#9;;;)8>::CI.. 00(-3y>>U]22 , ,, =,, - --  999999999V T U UU (.(. 9 99r0c 0~t|||||||Srr ) lhs_data_dotrrrrrrrs r._bcsr_dot_general_jvp_lhsr.,s- <j#->2H&0 2 2 22r0c 0~t|||||||Srr,)rhs_dotrrrrrrrs r._bcsr_dot_general_jvp_rhsr15s- 8[*g->2H&0 2 2 22r0c zt|||j}tj|||||||\} } } | ||| fSr)rrGr _bcoo_dot_general_transpose) rrrrrrrrr data_outrrhs_outs r._bcsr_dot_general_transposer6>sg#:#35559($c=N3 LLL(Aw ; G 33r0c|^}}|^}}t||||dn |j|^} } tt|j|jfd|f|\} } t g| |R| | |d} | | fS)N)rUr)rrr)r`rGrrzrLr )rRrSrrrlhs_argsrlhs_dimsrhs_bdim new_lhs_argsnew_lhs_spinfonew_dimension_numbersresult_batch_dim batched_outs r._bcsr_dot_general_batch_ruler@Is .8S"8X"; h 'ttSYx-@#B#B#B<-H : ch'!X8I-K-K))!Q<QQQ4I9OQQQ+ & &&r0ct||||}|jrDtt|||jd}t ||j|||S|d}t j|j|jd}tj ||k|d}t j|j|jd} tj | |k|d}||gS)N)rrGrsr) rr;r"_bcsr_correct_out_of_bound_indicesr rbroadcasted_iotarwrGr@where) rVrWrXrrGrfextenti_data i_indicess r.rBrB_s w 6 6% ]?25CXYYYA ':a ' 'gv > >> ":&   dj! < <& 6F?D! , ,$"6<BB) Ii&('1 5 5' r0c tjjst|||||||| S|\\} } \} } |j\}}}}t |||| j}d}|j}| s| rd}n|j|jkrd}n|||jkrd}nt| jdks |j dvrd}nx|j s|j rd}ngt| dgkrd}nP|tjtjtjtjfvr t%jd|dt(d}|rt|||||||| St+|||||| j \}}|j dkr|}d }n^|j dkr;|}d }| d dkr*t-j|t1jdd g }nt5d|j d|||||f| jd|j|jd||jigS)NrFTrt)r5rtr5zEbcsr_dot_general cusparse/hipsparse lowering not available for dtype=z). Falling back to default implementation.rFx_dtypeB_dtyper) permutationzrhs has to be 1d or 2d; get zd.)rG transpose data_dtyper)rbcoo_cusparse_loweringvalue"_bcsr_dot_general_default_loweringavals_inrrGrwrzrLr;rcrrfloat32float64 complex64 complex128warningswarnr*_bcsr_correct_out_of_bound_indices_loweredrrMrdense_int_arrayr{)csr_matvec_loweringcsr_matmat_loweringctxrrrrrrrrrrr lhs_data_avallhs_indices_avallhs_indptr_avalrhs_avalruse_default_loweringrwdot_general_fnrJs r._bcsr_dot_general_gpu_loweringrdns  & , - 8[*c)3     :K6< 6I?B|<-!?H % 8H J J%  % ) x~--).D H[.[.[ : !!X]&%@%@ }     LaS   RZR\2=III MKKKK+---  - 8[*c)3    E; Cz7GIII(K]a(NGG}(NGA! M#4+?A+G+G H H Hc EHMEEE F FF .; C 6)/5$1$7%5%; 6 6$X^4  6 6 77r0cuda)platformrocmrbroadcast_dimensionsctj|||}t|S)N)rGrh)r bcoo_broadcast_in_dimr,r$r*)r#rGrh result_bcoos r.bcsr_broadcast_in_dimrls>*KKMM5IKKK+  $ $$r0operandsSequence[BCSR] dimensioncrttjd|D|S)aPSparse implementation of :func:`jax.lax.concatenate` Args: operands : Sequence of BCSR arrays to concatenate. The arrays must have equal shapes, except in the `dimension` axis. Additionally, the arrays must have have equivalent batch, sparse, and dense dimensions. dimension : Positive integer specifying the dimension along which to concatenate the arrays. The dimension must be among batch or sparse dimensions of the input; concatenation along dense dimensions is not supported. Returns: A BCSR array containing the concatenation of the inputs. c6g|]}|Sr8)r,)r9r#s r. z$bcsr_concatenate..s ===S3;;=====r0)ro)r$r*r bcoo_concatenate)rmros r.bcsr_concatenaterts? ==H===SSS U UUr0ceZdZUdZded<ded<ded<ded<edZed Zed Zed Z ed Z d ed<d ed<edZ edZ edZ dddd1fdZdZdZdZedZedddddd d!Zd2d3d'Zedejddd(d)Zd*Zd4d,Zed5d.Zedddd/d0ZxZS)6r$z3Experimental batched CSR matrix implemented in JAX.rqrVrWrXrrGc&|jjdS)Nrs)rWrGselfs r.z BCSR.sdl04r0c|jjSrE)rVrwrws r.ryz BCSR.s  r0c |jjdz S)Nr5)rWrLrws r.ryz BCSR.s$,"3a"7r0cdSNrtr8)rs r.ryz BCSR.sr0c4|jj|jjz SrE)rVrLrWrws r.ryz BCSR.s$).4<3D"Dr0rkrJrKc*|j|j|jfSrE)rVrWrXrws r.ryz BCSR.sDL$+ Fr0cBt|j|j|jSrE)rrGrJrKrws r.ryz BCSR.s! 4:t7J+/+>!@!@r0cTt|j|j|jdzSr})ryrGr;rws r. _sparse_shapezBCSR._sparse_shapes% DL)99: ; ;;r0FrIargsrricttj|\|_|_|_||_||_t ||t|j|j|j|j dSr) mapr@rrVrWrXrJrKsuper__init__rrG)rxrrGrJrK __class__s r.rz BCSR.__init__sp+.s{D+A+A(DIt|T[(D(D GGT'''49dlDKDDDDDr0cr|jj} |j}|j}|j}|j}t |j}d|}|r|d|z }|r|d|z }|d|||d}n#t$r|d}YnwxYwt|j tj rt|j jd|d}|S) N, nse=r~r()z ()[])rrdr%r;rcrwrrG ExceptionrrVrTracerr) rxnamer%r;rcrwrGextrarepr_s r.__repr__z BCSR.__repr__s > "D / Hc g gje4:e3kke *%???*% *%???*%...u.e...ee ###"""eee#$)T[))5di)44E444e Ls0A$$A65A6c td)NzTranspose is not implemented.)rO)rxrkwargss r.rMzBCSR.transposes = > >>r0c\|j|j|jf|jfSrE)rVrWrXr_asdictrws r. tree_flattenzBCSR.tree_flattens( It|T[ 14:3E3E3G3G GGr0ct|}|\|_|_|_|hdkrt d||jjdi||S)N>rGrJrKz&BCSR.tree_unflatten: invalid aux_data=r8) object__new__rVrWrXkeysr{__dict__update)clsaux_datachildrenobjs r.tree_unflattenzBCSR.tree_unflattensv ..  C(0%CHck3:}}GGGGG BxBB C CCCL##(### Jr0Nint32r)rwrrcr;r%c t|}|dks |dks|dkrtd|d|d|d|t||z |z }|dkrtdt|||g\}} } t jg||| R|} t jg||Rt j| d|} t jg|| ddzR|} || | | f| S) z?Create an empty BCSR instance. Public method is sparse.empty().rzInvalid inputs: shape=rr~rrtz1BCSR sparse.empty: must have 2 sparse dimensions.r5rF)ryr{rzrr@rfullarray)rrGrwrrcr;r%r batch_shape sparse_shape dense_shaperVrWrXs r._emptyz BCSR._empty$sB %LLE{{gkkS1WW R%RRGRRRRCRR S SS5zzG#g-H1}} J K KK-79@(8K.M.M*K{ 96{6C6+66 > >Dh**c**CIl1o,F,F"$$G Y::l1o&9::K H HF 3gv&e 4 4 44r0Tr%r& remove_zerosr'cJ|rt||St||S)aqReturn a copy of the array with duplicate indices summed. Additionally, this operation will result in explicit zero entries removed, and indices being sorted in lexicographic order. Because the size of the resulting representation depends on the values in the arrays, this operation is not compatible with JIT or other transforms. To use ``sum_duplicates`` in such cases, you may pass a value to `nse` to specify the desired size of the output representation. Args: nse : integer (optional), if specified, gives the number of specified elements in the output sparse representation; if it is larger than the number required, data will be padded with zeros and indices will be padded with out-of-bounds values. If it is smaller than the number required, data will be silently discarded. remove_zeros : bool (default=True). If True, remove explicit zeros from the data as part of summing duplicates. If False, then explicit zeros at unique indices will remain among the specified elements. Note: remove_zeros=True is incompatible with autodiff. r))r/r3)rxr%rs r.sum_duplicateszBCSR.sum_duplicates6s2*0 !$C 0 0 00 3 / / //r0rc*t|||||S)z2Create a BCSR array from a (dense) :class:`Array`.r)r)rr#r%rrcr;s r. fromdensezBCSR.fromdensePs& #3K")7 < < <rsy LK""""""$$$$$$"""""""" 333333((((((222222222222222222*)))))))MMMMMMMM######******$$$$$$******&&&&&&7777777777KKKKK JJJJJ$GGGG$     Z   CCCCCCCC*     CCCC,/93333330"4>"233$(!9=Q!"SY%%%%%%0ABRS-0Y8888886(((# 7 7$# 7xxx###" O O O':"#,E()0M,-'4*1*1*1222  // L L L LAAAA&BBB !--"!- @@@ AAA <<<  .+T4888*A'.IN+~~t~(0(0(0111  // 3 3 3 3/// !00"!0 000 ```222*  .$&7888*A'.IN+~~t~(0(0(0111$T^$677 (,48"4"4"4"4"4"4J8888$ < < <%::&%:.222222444 ' ' '   7t #%%%.I*+2N./   .>$* ++++ +$+!'"@","<","<>>$* ++++%%%% UUUU" %Q9Q9Q9Q9Q99Q9Q9&%Q9j = = = H H HD#sL.$OOOOOr0