HDK
|
Options for the TensorRT provider that are passed to SessionOptionsAppendExecutionProvider_TensorRT_V2. Please note that this struct is similar to OrtTensorRTProviderOptions but only to be used internally. Going forward, new trt provider options are to be supported via this struct and usage of the publicly defined OrtTensorRTProviderOptions will be deprecated over time. User can only get the instance of OrtTensorRTProviderOptionsV2 via CreateTensorRTProviderOptions. More...
#include <tensorrt_provider_options.h>
Options for the TensorRT provider that are passed to SessionOptionsAppendExecutionProvider_TensorRT_V2. Please note that this struct is similar to OrtTensorRTProviderOptions but only to be used internally. Going forward, new trt provider options are to be supported via this struct and usage of the publicly defined OrtTensorRTProviderOptions will be deprecated over time. User can only get the instance of OrtTensorRTProviderOptionsV2 via CreateTensorRTProviderOptions.
Definition at line 13 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::device_id |
Definition at line 14 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::has_user_compute_stream |
Definition at line 15 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_context_memory_sharing_enable |
Definition at line 32 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_dla_core |
Definition at line 25 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_dla_enable |
Definition at line 24 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_dump_subgraphs |
Definition at line 26 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_engine_cache_enable |
Definition at line 27 of file tensorrt_provider_options.h.
const char* OrtTensorRTProviderOptionsV2::trt_engine_cache_path |
Definition at line 28 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_engine_decryption_enable |
Definition at line 29 of file tensorrt_provider_options.h.
const char* OrtTensorRTProviderOptionsV2::trt_engine_decryption_lib_path |
Definition at line 30 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_force_sequential_engine_build |
Definition at line 31 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_fp16_enable |
Definition at line 20 of file tensorrt_provider_options.h.
const char* OrtTensorRTProviderOptionsV2::trt_int8_calibration_table_name |
Definition at line 22 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_int8_enable |
Definition at line 21 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_int8_use_native_calibration_table |
Definition at line 23 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_layer_norm_fp32_fallback |
Definition at line 33 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_max_partition_iterations |
Definition at line 17 of file tensorrt_provider_options.h.
size_t OrtTensorRTProviderOptionsV2::trt_max_workspace_size |
Definition at line 19 of file tensorrt_provider_options.h.
int OrtTensorRTProviderOptionsV2::trt_min_subgraph_size |
Definition at line 18 of file tensorrt_provider_options.h.
void* OrtTensorRTProviderOptionsV2::user_compute_stream |
Definition at line 16 of file tensorrt_provider_options.h.