HDK
|
All C++ Onnxruntime APIs are defined inside this namespace. More...
Namespaces | |
Custom | |
detail | |
Experimental | |
Classes | |
struct | Exception |
All C++ methods that can fail will throw an exception of this type. More... | |
struct | Global |
struct | Float16_t |
IEEE 754 half-precision floating point data type. More... | |
struct | BFloat16_t |
bfloat16 (Brain Floating Point) data type More... | |
struct | Float8E4M3FN_t |
float8e4m3fn (Float8 Floating Point) data type More... | |
struct | Float8E4M3FNUZ_t |
float8e4m3fnuz (Float8 Floating Point) data type More... | |
struct | Float8E5M2_t |
float8e5m2 (Float8 Floating Point) data type More... | |
struct | Float8E5M2FNUZ_t |
float8e5m2fnuz (Float8 Floating Point) data type More... | |
struct | Status |
The Status that holds ownership of OrtStatus received from C API Use it to safely destroy OrtStatus* returned from the C API. Use appropriate constructors to construct an instance of a Status object from exceptions. More... | |
struct | ThreadingOptions |
The ThreadingOptions. More... | |
struct | Env |
The Env (Environment) More... | |
struct | CustomOpDomain |
Custom Op Domain. More... | |
struct | LoraAdapter |
LoraAdapter holds a set of Lora Parameters loaded from a single file. More... | |
struct | RunOptions |
RunOptions. More... | |
struct | CustomOpConfigs |
Class that represents session configuration entries for one or more custom operators. More... | |
struct | SessionOptions |
Wrapper around ::OrtSessionOptions. More... | |
struct | ModelMetadata |
Wrapper around ::OrtModelMetadata. More... | |
struct | Session |
Wrapper around ::OrtSession. More... | |
struct | MemoryInfo |
Wrapper around OrtMemoryInfo. More... | |
struct | TensorTypeAndShapeInfo |
Wrapper around ::OrtTensorTypeAndShapeInfo. More... | |
struct | SequenceTypeInfo |
Wrapper around ::OrtSequenceTypeInfo. More... | |
struct | MapTypeInfo |
Wrapper around ::OrtMapTypeInfo. More... | |
struct | TypeInfo |
Type information that may contain either TensorTypeAndShapeInfo or the information about contained sequence or map depending on the ONNXType. More... | |
struct | Value |
Wrapper around OrtValue. More... | |
struct | MemoryAllocation |
Represents native memory allocation coming from one of the OrtAllocators registered with OnnxRuntime. Use it to wrap an allocation made by an allocator so it can be automatically released when no longer needed. More... | |
struct | AllocatorWithDefaultOptions |
Wrapper around ::OrtAllocator default instance that is owned by Onnxruntime. More... | |
struct | Allocator |
Wrapper around ::OrtAllocator. More... | |
struct | IoBinding |
Wrapper around ::OrtIoBinding. More... | |
struct | ArenaCfg |
it is a structure that represents the configuration of an arena based allocator More... | |
struct | OpAttr |
This struct provides life time management for custom op attribute More... | |
struct | Logger |
This class represents an ONNX Runtime logger that can be used to log information with an associated severity level and source code location (file path, line number, function name). More... | |
struct | KernelContext |
This class wraps a raw pointer OrtKernelContext* that is being passed to the custom kernel Compute() method. Use it to safely access context attributes, input and output parameters with exception safety guarantees. See usage example in onnxruntime/test/testdata/custom_op_library/custom_op_library.cc More... | |
struct | KernelInfo |
This struct owns the OrtKernInfo* pointer when a copy is made. For convenient wrapping of OrtKernelInfo* passed to kernel constructor and query attributes, warp the pointer with Ort::Unowned<KernelInfo> instance so it does not destroy the pointer the kernel does not own. More... | |
struct | Op |
Create and own custom defined operation. More... | |
struct | ShapeInferContext |
Provide access to per-node attributes and input shapes, so one could compute and set output shapes. More... | |
struct | CustomOpBase |
struct | TypeToTensorType< float > |
struct | TypeToTensorType< Float16_t > |
struct | TypeToTensorType< BFloat16_t > |
struct | TypeToTensorType< double > |
struct | TypeToTensorType< int8_t > |
struct | TypeToTensorType< int16_t > |
struct | TypeToTensorType< int32_t > |
struct | TypeToTensorType< int64_t > |
struct | TypeToTensorType< uint8_t > |
struct | TypeToTensorType< uint16_t > |
struct | TypeToTensorType< uint32_t > |
struct | TypeToTensorType< uint64_t > |
struct | TypeToTensorType< bool > |
struct | TypeToTensorType< Float8E4M3FN_t > |
struct | TypeToTensorType< Float8E4M3FNUZ_t > |
struct | TypeToTensorType< Float8E5M2_t > |
struct | TypeToTensorType< Float8E5M2FNUZ_t > |
Functions | |
const OrtApi & | GetApi () noexcept |
This returns a reference to the OrtApi interface in use. More... | |
std::string | GetVersionString () |
This function returns the onnxruntime version string More... | |
std::string | GetBuildInfoString () |
This function returns the onnxruntime build information: including git branch, git commit id, build type(Debug/Release/RelWithDebInfo) and cmake cpp flags. More... | |
std::vector< std::string > | GetAvailableProviders () |
This is a C++ wrapper for OrtApi::GetAvailableProviders() and returns a vector of strings representing the available execution providers. More... | |
void | ThrowOnError (OrtStatus *ort_status) |
void | ThrowOnError (const Status &st) |
ctx_ (ctx) | |
All C++ Onnxruntime APIs are defined inside this namespace.
using Ort::AllocatedStringPtr = typedef std::unique_ptr<char, detail::AllocatedFree> |
unique_ptr typedef used to own strings allocated by OrtAllocators and release them at the end of the scope. The lifespan of the given allocator must eclipse the lifespan of AllocatedStringPtr instance
Definition at line 646 of file onnxruntime_cxx_api.h.
using Ort::ConstIoBinding = typedef detail::ConstIoBindingImpl<detail::Unowned<const OrtIoBinding>> |
Definition at line 1906 of file onnxruntime_cxx_api.h.
using Ort::ConstKernelInfo = typedef detail::KernelInfoImpl<detail::Unowned<const OrtKernelInfo>> |
Definition at line 2177 of file onnxruntime_cxx_api.h.
using Ort::ConstMapTypeInfo = typedef detail::MapTypeInfoImpl<detail::Unowned<const OrtMapTypeInfo>> |
Definition at line 1290 of file onnxruntime_cxx_api.h.
using Ort::ConstMemoryInfo = typedef detail::MemoryInfoImpl<detail::Unowned<const OrtMemoryInfo>> |
Definition at line 1197 of file onnxruntime_cxx_api.h.
using Ort::ConstOptionalTypeInfo = typedef detail::OptionalTypeInfoImpl<detail::Unowned<const OrtOptionalTypeInfo>> |
Definition at line 1277 of file onnxruntime_cxx_api.h.
using Ort::ConstSequenceTypeInfo = typedef detail::SequenceTypeInfoImpl<detail::Unowned<const OrtSequenceTypeInfo>> |
Definition at line 1255 of file onnxruntime_cxx_api.h.
using Ort::ConstSession = typedef detail::ConstSessionImpl<detail::Unowned<const OrtSession>> |
Definition at line 1160 of file onnxruntime_cxx_api.h.
using Ort::ConstSessionOptions = typedef detail::ConstSessionOptionsImpl<detail::Unowned<const OrtSessionOptions>> |
Definition at line 949 of file onnxruntime_cxx_api.h.
using Ort::ConstTensorTypeAndShapeInfo = typedef detail::TensorTypeAndShapeInfoImpl<detail::Unowned<const OrtTensorTypeAndShapeInfo>> |
Definition at line 1234 of file onnxruntime_cxx_api.h.
using Ort::ConstTypeInfo = typedef detail::TypeInfoImpl<detail::Unowned<const OrtTypeInfo>> |
Contains a constant, unowned OrtTypeInfo that can be copied and passed around by value. Provides access to const OrtTypeInfo APIs.
Definition at line 1320 of file onnxruntime_cxx_api.h.
using Ort::ConstValue = typedef detail::ConstValueImpl<detail::Unowned<const OrtValue>> |
Definition at line 1656 of file onnxruntime_cxx_api.h.
using Ort::ShapeInferFn = typedef Ort::Status (*)(Ort::ShapeInferContext&) |
Definition at line 2291 of file onnxruntime_cxx_api.h.
using Ort::UnownedAllocator = typedef detail::AllocatorImpl<detail::Unowned<OrtAllocator>> |
Definition at line 1870 of file onnxruntime_cxx_api.h.
using Ort::UnownedIoBinding = typedef detail::IoBindingImpl<detail::Unowned<OrtIoBinding>> |
Definition at line 1907 of file onnxruntime_cxx_api.h.
using Ort::UnownedSession = typedef detail::SessionImpl<detail::Unowned<OrtSession>> |
Definition at line 1161 of file onnxruntime_cxx_api.h.
using Ort::UnownedSessionOptions = typedef detail::SessionOptionsImpl<detail::Unowned<OrtSessionOptions>> |
Definition at line 948 of file onnxruntime_cxx_api.h.
using Ort::UnownedValue = typedef detail::ValueImpl<detail::Unowned<OrtValue>> |
Definition at line 1657 of file onnxruntime_cxx_api.h.
Ort::ctx_ | ( | ctx | ) |
Definition at line 2000 of file onnxruntime_cxx_inline.h.
|
inlinenoexcept |
This returns a reference to the OrtApi interface in use.
Definition at line 124 of file onnxruntime_cxx_api.h.
std::vector<std::string> Ort::GetAvailableProviders | ( | ) |
This is a C++ wrapper for OrtApi::GetAvailableProviders() and returns a vector of strings representing the available execution providers.
std::string Ort::GetBuildInfoString | ( | ) |
This function returns the onnxruntime build information: including git branch, git commit id, build type(Debug/Release/RelWithDebInfo) and cmake cpp flags.
std::string Ort::GetVersionString | ( | ) |
This function returns the onnxruntime version string
|
inline |
Definition at line 41 of file onnxruntime_cxx_inline.h.
|
inline |
Definition at line 48 of file onnxruntime_cxx_inline.h.