HDK
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Groups Pages
Public Attributes | List of all members
OrtTensorRTProviderOptionsV2 Struct Reference

Options for the TensorRT provider that are passed to SessionOptionsAppendExecutionProvider_TensorRT_V2. Please note that this struct is similar to OrtTensorRTProviderOptions but only to be used internally. Going forward, new trt provider options are to be supported via this struct and usage of the publicly defined OrtTensorRTProviderOptions will be deprecated over time. User can only get the instance of OrtTensorRTProviderOptionsV2 via CreateTensorRTProviderOptions. More...

#include <tensorrt_provider_options.h>

Public Attributes

int device_id
 
int has_user_compute_stream
 
void * user_compute_stream
 
int trt_max_partition_iterations
 
int trt_min_subgraph_size
 
size_t trt_max_workspace_size
 
int trt_fp16_enable
 
int trt_int8_enable
 
const char * trt_int8_calibration_table_name
 
int trt_int8_use_native_calibration_table
 
int trt_dla_enable
 
int trt_dla_core
 
int trt_dump_subgraphs
 
int trt_engine_cache_enable
 
const char * trt_engine_cache_path
 
int trt_engine_decryption_enable
 
const char * trt_engine_decryption_lib_path
 
int trt_force_sequential_engine_build
 
int trt_context_memory_sharing_enable
 
int trt_layer_norm_fp32_fallback
 

Detailed Description

Options for the TensorRT provider that are passed to SessionOptionsAppendExecutionProvider_TensorRT_V2. Please note that this struct is similar to OrtTensorRTProviderOptions but only to be used internally. Going forward, new trt provider options are to be supported via this struct and usage of the publicly defined OrtTensorRTProviderOptions will be deprecated over time. User can only get the instance of OrtTensorRTProviderOptionsV2 via CreateTensorRTProviderOptions.

Definition at line 13 of file tensorrt_provider_options.h.

Member Data Documentation

int OrtTensorRTProviderOptionsV2::device_id

Definition at line 14 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::has_user_compute_stream

Definition at line 15 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_context_memory_sharing_enable

Definition at line 32 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_dla_core

Definition at line 25 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_dla_enable

Definition at line 24 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_dump_subgraphs

Definition at line 26 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_engine_cache_enable

Definition at line 27 of file tensorrt_provider_options.h.

const char* OrtTensorRTProviderOptionsV2::trt_engine_cache_path

Definition at line 28 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_engine_decryption_enable

Definition at line 29 of file tensorrt_provider_options.h.

const char* OrtTensorRTProviderOptionsV2::trt_engine_decryption_lib_path

Definition at line 30 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_force_sequential_engine_build

Definition at line 31 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_fp16_enable

Definition at line 20 of file tensorrt_provider_options.h.

const char* OrtTensorRTProviderOptionsV2::trt_int8_calibration_table_name

Definition at line 22 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_int8_enable

Definition at line 21 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_int8_use_native_calibration_table

Definition at line 23 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_layer_norm_fp32_fallback

Definition at line 33 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_max_partition_iterations

Definition at line 17 of file tensorrt_provider_options.h.

size_t OrtTensorRTProviderOptionsV2::trt_max_workspace_size

Definition at line 19 of file tensorrt_provider_options.h.

int OrtTensorRTProviderOptionsV2::trt_min_subgraph_size

Definition at line 18 of file tensorrt_provider_options.h.

void* OrtTensorRTProviderOptionsV2::user_compute_stream

Definition at line 16 of file tensorrt_provider_options.h.

The documentation for this struct was generated from the following file: