HDK
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Groups Pages
Ort::Experimental::Value Struct Reference

#include <experimental_onnxruntime_cxx_api.h>

+ Inheritance diagram for Ort::Experimental::Value:

Public Member Functions

 Value (OrtValue *p)
 
- Public Member Functions inherited from Ort::Value
 Value (std::nullptr_t)
 Create an empty Value object, must be assigned a valid one to be used. More...
 
 Value (OrtValue *p)
 Used for interop with the C API. More...
 
 Value (Value &&)=default
 
Valueoperator= (Value &&)=default
 
ConstValue GetConst () const
 
UnownedValue GetUnowned () const
 
- Public Member Functions inherited from Ort::detail::ValueImpl< OrtValue >
RGetTensorMutableData ()
 Returns a non-const typed pointer to an OrtValue/Tensor contained buffer No type checking is performed, the caller must ensure the type matches the tensor type. More...
 
voidGetTensorMutableRawData ()
 Returns a non-typed non-const pointer to a tensor contained data. More...
 
RAt (const std::vector< int64_t > &location)
 
void FillStringTensor (const char *const *s, size_t s_len)
 Set all strings at once in a string tensor More...
 
void FillStringTensorElement (const char *s, size_t index)
 Set a single string in a string tensor More...
 
void UseCooIndices (int64_t *indices_data, size_t indices_num)
 Supplies COO format specific indices and marks the contained sparse tensor as being a COO format tensor. Values are supplied with a CreateSparseTensor() API. The supplied indices are not copied and the user allocated buffers lifespan must eclipse that of the OrtValue. The location of the indices is assumed to be the same as specified by OrtMemoryInfo argument at the creation time. More...
 
void UseCsrIndices (int64_t *inner_data, size_t inner_num, int64_t *outer_data, size_t outer_num)
 Supplies CSR format specific indices and marks the contained sparse tensor as being a CSR format tensor. Values are supplied with a CreateSparseTensor() API. The supplied indices are not copied and the user allocated buffers lifespan must eclipse that of the OrtValue. The location of the indices is assumed to be the same as specified by OrtMemoryInfo argument at the creation time. More...
 
void UseBlockSparseIndices (const Shape &indices_shape, int32_t *indices_data)
 Supplies BlockSparse format specific indices and marks the contained sparse tensor as being a BlockSparse format tensor. Values are supplied with a CreateSparseTensor() API. The supplied indices are not copied and the user allocated buffers lifespan must eclipse that of the OrtValue. The location of the indices is assumed to be the same as specified by OrtMemoryInfo argument at the creation time. More...
 
void FillSparseTensorCoo (const OrtMemoryInfo *data_mem_info, const OrtSparseValuesParam &values_param, const int64_t *indices_data, size_t indices_num)
 The API will allocate memory using the allocator instance supplied to the CreateSparseTensor() API and copy the values and COO indices into it. If data_mem_info specifies that the data is located at difference device than the allocator, a X-device copy will be performed if possible. More...
 
void FillSparseTensorCsr (const OrtMemoryInfo *data_mem_info, const OrtSparseValuesParam &values, const int64_t *inner_indices_data, size_t inner_indices_num, const int64_t *outer_indices_data, size_t outer_indices_num)
 The API will allocate memory using the allocator instance supplied to the CreateSparseTensor() API and copy the values and CSR indices into it. If data_mem_info specifies that the data is located at difference device than the allocator, a X-device copy will be performed if possible. More...
 
void FillSparseTensorBlockSparse (const OrtMemoryInfo *data_mem_info, const OrtSparseValuesParam &values, const Shape &indices_shape, const int32_t *indices_data)
 The API will allocate memory using the allocator instance supplied to the CreateSparseTensor() API and copy the values and BlockSparse indices into it. If data_mem_info specifies that the data is located at difference device than the allocator, a X-device copy will be performed if possible. More...
 
- Public Member Functions inherited from Ort::detail::ConstValueImpl< OrtValue >
void GetOpaqueData (const char *domain, const char *type_name, R &) const
 Obtains a pointer to a user defined data for experimental purposes More...
 
bool IsTensor () const
 Returns true if Value is a tensor, false for other types like map/sequence/etc. More...
 
bool HasValue () const
 
size_t GetCount () const
 < Return true if OrtValue contains data and returns false if the OrtValue is a None More...
 
Value GetValue (int index, OrtAllocator *allocator) const
 
size_t GetStringTensorDataLength () const
 This API returns a full length of string data contained within either a tensor or a sparse Tensor. For sparse tensor it returns a full length of stored non-empty strings (values). The API is useful for allocating necessary memory and calling GetStringTensorContent(). More...
 
void GetStringTensorContent (void *buffer, size_t buffer_length, size_t *offsets, size_t offsets_count) const
 The API copies all of the UTF-8 encoded string data contained within a tensor or a sparse tensor into a supplied buffer. Use GetStringTensorDataLength() to find out the length of the buffer to allocate. The user must also allocate offsets buffer with the number of entries equal to that of the contained strings. More...
 
const RGetTensorData () const
 Returns a const typed pointer to the tensor contained data. No type checking is performed, the caller must ensure the type matches the tensor type. More...
 
const voidGetTensorRawData () const
 Returns a non-typed pointer to a tensor contained data. More...
 
TypeInfo GetTypeInfo () const
 The API returns type information for data contained in a tensor. For sparse tensors it returns type information for contained non-zero values. It returns dense shape for sparse tensors. More...
 
TensorTypeAndShapeInfo GetTensorTypeAndShapeInfo () const
 The API returns type information for data contained in a tensor. For sparse tensors it returns type information for contained non-zero values. It returns dense shape for sparse tensors. More...
 
ConstMemoryInfo GetTensorMemoryInfo () const
 This API returns information about the memory allocation used to hold data. More...
 
void GetStringTensorElement (size_t buffer_length, size_t element_index, void *buffer) const
 The API copies UTF-8 encoded bytes for the requested string element contained within a tensor or a sparse tensor into a provided buffer. Use GetStringTensorElementLength() to obtain the length of the buffer to allocate. More...
 
size_t GetStringTensorElementLength (size_t element_index) const
 The API returns a byte length of UTF-8 encoded string element contained in either a tensor or a spare tensor values. More...
 
OrtSparseFormat GetSparseFormat () const
 The API returns the sparse data format this OrtValue holds in a sparse tensor. If the sparse tensor was not fully constructed, i.e. Use*() or Fill*() API were not used the value returned is ORT_SPARSE_UNDEFINED. More...
 
TensorTypeAndShapeInfo GetSparseTensorValuesTypeAndShapeInfo () const
 The API returns type and shape information for stored non-zero values of the sparse tensor. Use GetSparseTensorValues() to obtain values buffer pointer. More...
 
TensorTypeAndShapeInfo GetSparseTensorIndicesTypeShapeInfo (OrtSparseIndicesFormat format) const
 The API returns type and shape information for the specified indices. Each supported indices have their own enum values even if a give format has more than one kind of indices. Use GetSparseTensorIndicesData() to obtain pointer to indices buffer. More...
 
const RGetSparseTensorIndicesData (OrtSparseIndicesFormat indices_format, size_t &num_indices) const
 The API retrieves a pointer to the internal indices buffer. The API merely performs a convenience data type casting on the return type pointer. Make sure you are requesting the right type, use GetSparseTensorIndicesTypeShapeInfo(); More...
 
bool IsSparseTensor () const
 Returns true if the OrtValue contains a sparse tensor More...
 
const RGetSparseTensorValues () const
 The API returns a pointer to an internal buffer of the sparse tensor containing non-zero values. The API merely does casting. Make sure you are requesting the right data type by calling GetSparseTensorValuesTypeAndShapeInfo() first. More...
 
- Public Member Functions inherited from Ort::detail::Base< OrtValue >
constexpr Base ()=default
 
constexpr Base (contained_type *p) noexcept
 
 Base (const Base &)=delete
 
 Base (Base &&v) noexcept
 
 ~Base ()
 
Baseoperator= (const Base &)=delete
 
Baseoperator= (Base &&v) noexcept
 
constexpr operator contained_type * () const noexcept
 
contained_typerelease ()
 Relinquishes ownership of the contained C object pointer The underlying object is not destroyed. More...
 

Static Public Member Functions

template<typename T >
static Ort::Value CreateTensor (T *p_data, size_t p_data_element_count, const std::vector< int64_t > &shape)
 
static Ort::Value CreateTensor (void *p_data, size_t p_data_byte_count, const std::vector< int64_t > &shape, ONNXTensorElementDataType type)
 
template<typename T >
static Ort::Value CreateTensor (const std::vector< int64_t > &shape)
 
static Ort::Value CreateTensor (const std::vector< int64_t > &shape, ONNXTensorElementDataType type)
 
- Static Public Member Functions inherited from Ort::Value
template<typename T >
static Value CreateTensor (const OrtMemoryInfo *info, T *p_data, size_t p_data_element_count, const int64_t *shape, size_t shape_len)
 Creates a tensor with a user supplied buffer. Wraps OrtApi::CreateTensorWithDataAsOrtValue. More...
 
static Value CreateTensor (const OrtMemoryInfo *info, void *p_data, size_t p_data_byte_count, const int64_t *shape, size_t shape_len, ONNXTensorElementDataType type)
 Creates a tensor with a user supplied buffer. Wraps OrtApi::CreateTensorWithDataAsOrtValue. More...
 
template<typename T >
static Value CreateTensor (OrtAllocator *allocator, const int64_t *shape, size_t shape_len)
 Creates a tensor using a supplied OrtAllocator. Wraps OrtApi::CreateTensorAsOrtValue. More...
 
static Value CreateTensor (OrtAllocator *allocator, const int64_t *shape, size_t shape_len, ONNXTensorElementDataType type)
 Creates a tensor using a supplied OrtAllocator. Wraps OrtApi::CreateTensorAsOrtValue. More...
 
static Value CreateMap (Value &keys, Value &values)
 Wraps OrtApi::CreateValue. More...
 
static Value CreateSequence (std::vector< Value > &values)
 Wraps OrtApi::CreateValue. More...
 
template<typename T >
static Value CreateOpaque (const char *domain, const char *type_name, const T &)
 Wraps OrtApi::CreateOpaqueValue. More...
 
template<typename T >
static Value CreateSparseTensor (const OrtMemoryInfo *info, T *p_data, const Shape &dense_shape, const Shape &values_shape)
 This is a simple forwarding method to the other overload that helps deducing data type enum value from the type of the buffer. More...
 
static Value CreateSparseTensor (const OrtMemoryInfo *info, void *p_data, const Shape &dense_shape, const Shape &values_shape, ONNXTensorElementDataType type)
 Creates an OrtValue instance containing SparseTensor. This constructs a sparse tensor that makes use of user allocated buffers. It does not make copies of the user provided data and does not modify it. The lifespan of user provided buffers should eclipse the life span of the resulting OrtValue. This call constructs an instance that only contain a pointer to non-zero values. To fully populate the sparse tensor call Use<Format>Indices() API below to supply a sparse format specific indices. This API is not suitable for string data. Use CreateSparseTensor() with allocator specified so strings can be properly copied into the allocated buffer. More...
 
template<typename T >
static Value CreateSparseTensor (OrtAllocator *allocator, const Shape &dense_shape)
 This is a simple forwarding method to the below CreateSparseTensor. This helps to specify data type enum in terms of C++ data type. Use CreateSparseTensor<T> More...
 
static Value CreateSparseTensor (OrtAllocator *allocator, const Shape &dense_shape, ONNXTensorElementDataType type)
 Creates an instance of OrtValue containing sparse tensor. The created instance has no data. The data must be supplied by on of the FillSparseTensor<Format>() methods that take both non-zero values and indices. The data will be copied into a buffer that would be allocated using the supplied allocator. Use this API to create OrtValues that contain sparse tensors with all supported data types including strings. More...
 

Additional Inherited Members

- Public Types inherited from Ort::Value
using Base = detail::ValueImpl< OrtValue >
 
using OrtSparseValuesParam = detail::OrtSparseValuesParam
 
using Shape = detail::Shape
 
- Public Types inherited from Ort::detail::ValueImpl< OrtValue >
using B = ConstValueImpl< OrtValue >
 
using B = Base< OrtValue >
 
- Public Types inherited from Ort::detail::ConstValueImpl< OrtValue >
using B = Base< OrtValue >
 
- Public Types inherited from Ort::detail::Base< OrtValue >
using contained_type = OrtValue
 
- Protected Attributes inherited from Ort::detail::Base< OrtValue >
contained_typep_
 

Detailed Description

Definition at line 53 of file experimental_onnxruntime_cxx_api.h.

Constructor & Destructor Documentation

Ort::Experimental::Value::Value ( OrtValue p)
inline

Definition at line 54 of file experimental_onnxruntime_cxx_api.h.

Member Function Documentation

template<typename T >
Ort::Value Value::CreateTensor ( T *  p_data,
size_t  p_data_element_count,
const std::vector< int64_t > &  shape 
)
inlinestatic

Definition at line 88 of file experimental_onnxruntime_cxx_inline.h.

Ort::Value Value::CreateTensor ( void p_data,
size_t  p_data_byte_count,
const std::vector< int64_t > &  shape,
ONNXTensorElementDataType  type 
)
inlinestatic

Definition at line 92 of file experimental_onnxruntime_cxx_inline.h.

template<typename T >
Ort::Value Value::CreateTensor ( const std::vector< int64_t > &  shape)
inlinestatic

Definition at line 98 of file experimental_onnxruntime_cxx_inline.h.

Ort::Value Value::CreateTensor ( const std::vector< int64_t > &  shape,
ONNXTensorElementDataType  type 
)
inlinestatic

Definition at line 102 of file experimental_onnxruntime_cxx_inline.h.


The documentation for this struct was generated from the following files: