Vpf+ddlmZddlmZddlmZddlmZddl m Z ddl m Z ddl m Z ddlmZdd lmZmZdd lmZd Zd Zeejejejejejejejejej ej!ej"ej#ej$ej%ej&hZ' d"d#dZ( d$d%dZ)dZ* d&d'dZ+ d&d'dZ, d&d(d!Z-d S))) annotations)Any) device_put)numpy)array) xla_bridge) _array_copy) xla_client)Array DLDeviceType)Sharding)r)rNxr streamint | Any | None src_devicexla_client.Device | Nonedevicecopy bool | NonecD||\}|r@|||kr8|%|s#td|dt|dt||}n|rt |n|}t j|d|S)NSpecified device=2 which requires a copy since the source device is T, however copy=False. Set copy=True or copy=None to perform the requested operation.rr) devices ValueErrorreprrr r _xlabuffer_to_dlpack_managed_tensoraddressable_data)rrrrrarrs O/var/www/html/nettyfy-visnx/env/lib/python3.11/site-packages/jax/_src/dlpack.py _to_dlpackr%,s ))++KJ (#v';';   8V 8 8: 8 8 8   q& ! !cc '+a...aC  8 8F 9   dl_devicetuple[DLDeviceType, int] | None max_versiontuple[int, int] | Nonec4t|tjstdt |d}|r|nd\}}|rx t jdt jdt jdi|} tj | } | |}n!#t$rtd|dwxYw| |tkrt||||| S|tkrt||||| Std td |d ) atReturns a DLPack tensor that encapsulates a :class:`~jax.Array` ``x``. Args: x: a :class:`~jax.Array`, on either CPU or GPU. stream: optional platform-dependent stream to wait on until the buffer is ready. This corresponds to the `stream` argument to ``__dlpack__`` documented in https://dmlc.github.io/dlpack/latest/python_spec.html. src_device: either a CPU or GPU :class:`~jax.Device`. dl_device: a tuple of ``(dl_device_type, local_hardware_id)`` in DLPack format e.g. as produced by ``__dlpack_device__``. max_version: the maximum DLPack version that the consumer (i.e. caller of ``__dlpack__``) supports in the form of a 2-tuple of ``(major, minor)``. This function is not guaranteed to return a capsule of version ``max_version``. copy: a boolean indicating whether or not to copy the input. If ``copy=True`` then the function must always copy. When ``copy=False`` then the function must never copy, and must raise an error when a copy is deemed necessary. If ``copy=None`` then the function must avoid a copy if possible but may copy if needed. Returns: A DLPack PyCapsule object. Note: While JAX arrays are always immutable, ``DLPackManagedTensor`` buffers cannot be marked as immutable, and it is possible for processes external to JAX to mutate them in-place. If a DLPack buffer derived from a JAX array is mutated, it may lead to undefined behavior when using the associated JAX array. When JAX eventually supports ``DLManagedTensorVersioned`` (DLPack 1.0), it will be possible to specify that a buffer is read-only. z/Argument to to_dlpack must be a jax.Array, got NNNcpucudarocmz`The device specification passed to to_dlpack contains an unsupported device type (DLDeviceType: ))rrrrz'JAX does not support any version below z but version (z) was requested.) isinstancer ArrayImpl TypeErrortyper kDLCPUkDLCUDAkDLROCMr get_backenddevice_from_local_hardware_id BufferErrorDLPACK_VERSIONr%MIN_DLPACK_VERSION) rrrr'r)rrdl_device_typelocal_hardware_iddl_device_platformbackends r$ to_dlpackrABsH Au ' '& %77%% & && &3<&Nii,#.#; ;  u       &'9::g445FGGff ;;;  :(6 : : : ; ;;;K>99        (((        00B00000  s ABB<c|r=||kr7|%|s#td|dt|dt||S|rtj|dS|S)NrrrT)r)rrrjnpr)_arrr dlpack_devicers r$ _place_arrayrFs & ''   8V 8 8=!! 8 8 8   f % %% & 9T % % %% +r&c t|dd}|r|dkrd|jjvrdnd}tjd}d}|dvrj tj|}nT#t $rGt dt|dt|d wxYw|N tjd}n#t $rYnwxYw|& tjd}n#t $rYnwxYwtj tj |||}|\}t||||S) Nplatformgpur.r/r->r.r/zA z" device was specified, however no z backend was found.)getattrclientplatform_versionrr8 RuntimeErrorr3strupperrCasarrayr r dlpack_managed_tensor_to_bufferrrF)dlpackrrpreferred_platform cpu_backend gpu_backendrDrEs r$_legacy_from_dlpackrVsvz488 X"e++#)V]-K#K#KQW&u--+++++*+=>>kk   >SYY) * * > > 99' ( ( > > >    *622kk     d   ,V44       Z_DD k;(( ) )$<<>>.- dFM4 8 88s1AAB-3C CCC00 C=<C=ch|\}} tjdtjdtjdi|}n##t $rt d|d|wxYwt j|}||} | }n1#tj $r} dt| vrd}nYd} ~ nd} ~ wwxYw| |} tjtj| ||} t%| |||S)Nr-r.r/zIArray passed to from_dlpack is on unsupported device type (DLDeviceType: z , array: UNIMPLEMENTEDr)__dlpack_device__r r5r6r7r3rr8r9$get_stream_for_external_ready_eventsr XlaRuntimeErrorrN __dlpack__rCrPr rQrF) external_arrayrrr= device_idr?r@rErerrrRrDs r$ _from_dlpackr`s,>>@@.) EUff  EEE  D( D D3A D D E EEE  "#5 6 6'77 BB-  ? ? A AFF  #   #c((""ff  ffff  $ $F $ 3 3& Z_DD mV%% & &$ dFM4 8 88s#,A A&B((C7CC#xla_client.Device | Sharding | Nonec t|tr>|j}t|dkr t dt|d|\}t |drt |||St|||S)a Returns a :class:`~jax.Array` representation of a DLPack tensor. The returned :class:`~jax.Array` shares memory with ``external_array`` if no device transfer or copy was requested. Args: external_array: An array object that has __dlpack__ and __dlpack_device__ methods, or a DLPack tensor on either CPU or GPU (legacy API). device: The (optional) :py:class:`Device`, representing the device on which the returned array should be placed. If given, then the result is committed to the device. If unspecified, the resulting array will be unpacked onto the same device it originated from. Setting ``device`` to a device different from the source of ``external_array`` will require a copy, meaning ``copy`` must be set to either ``True`` or ``None``. copy: An (optional) boolean, controlling whether or not a copy is performed. If ``copy=True`` then a copy is always performed, even if unpacked onto the same device. If ``copy=False`` then the copy is never performed and will raise an error if necessary. When ``copy=None`` then a copy may be performed if needed for a device transfer. Returns: A jax.Array Note: While JAX arrays are always immutable, dlpack buffers cannot be marked as immutable, and it is possible for processes external to JAX to mutate them in-place. If a jax Array is constructed from a dlpack buffer and the buffer is later modified in-place, it may lead to undefined behavior when using the associated JAX array. zXfrom_dlpack can only unpack a dlpack tensor onto a singular device, but a Sharding with z devices was provided.r\)r1r device_setlenrhasattrr`rV)r]rrrds r$ from_dlpackrgsF!!"J :  Cz?? C C C  GF ^\**6  5 55 ^VT : ::r&)NNN) rr rrrrrrrr)NNNNN) rr rrrrr'r(r)r*rrr,)rrrr)rrarr). __future__rtypingr jax._src.apirjaxrrCjax._srcrrjax._src.lax.laxr jax._src.libr jax._src.typingr r jax._src.shardingr r;r< frozensetint8int16int32int64uint8uint16uint32uint64float16bfloat16float32float64 complex64 complex128bool_SUPPORTED_DTYPESr%rArFrVr`rgr&r$rs#"""""######((((((######////////&&&&&&9HciCIsy#*J CKs{K ;<<7;26#',4859;?48#' SSSSSj   DH,0!9!9!9!9!9FEI%)99999@?C$(/;/;/;/;/;/;/;r&