Options for the CUDA provider that are passed to SessionOptionsAppendExecutionProvider_CUDA_V2. Please note that this struct is similar to OrtCUDAProviderOptions but only to be used internally. Going forward, new cuda provider options are to be supported via this struct and usage of the publicly defined OrtCUDAProviderOptions will be deprecated over time. User can only get the instance of OrtCUDAProviderOptionsV2 via CreateCUDAProviderOptions. More...

#include <cuda_provider_options.h>

Public Attributes
int	device_id

int	has_user_compute_stream

void *	user_compute_stream

int	do_copy_in_default_stream

OrtCudnnConvAlgoSearch	cudnn_conv_algo_search

size_t	gpu_mem_limit

onnxruntime::ArenaExtendStrategy	arena_extend_strategy

OrtArenaCfg *	default_memory_arena_cfg

int	cudnn_conv_use_max_workspace

int	enable_cuda_graph

int	cudnn_conv1d_pad_to_nc1d

int	tunable_op_enabled

Detailed Description

Options for the CUDA provider that are passed to SessionOptionsAppendExecutionProvider_CUDA_V2. Please note that this struct is similar to OrtCUDAProviderOptions but only to be used internally. Going forward, new cuda provider options are to be supported via this struct and usage of the publicly defined OrtCUDAProviderOptions will be deprecated over time. User can only get the instance of OrtCUDAProviderOptionsV2 via CreateCUDAProviderOptions.

Definition at line 16 of file cuda_provider_options.h.

Member Data Documentation

onnxruntime::ArenaExtendStrategy OrtCUDAProviderOptionsV2::arena_extend_strategy

Definition at line 24 of file cuda_provider_options.h.

int OrtCUDAProviderOptionsV2::cudnn_conv1d_pad_to_nc1d

Definition at line 29 of file cuda_provider_options.h.

OrtCudnnConvAlgoSearch OrtCUDAProviderOptionsV2::cudnn_conv_algo_search

Definition at line 21 of file cuda_provider_options.h.

int OrtCUDAProviderOptionsV2::cudnn_conv_use_max_workspace

Definition at line 27 of file cuda_provider_options.h.

OrtArenaCfg* OrtCUDAProviderOptionsV2::default_memory_arena_cfg

Definition at line 26 of file cuda_provider_options.h.

int OrtCUDAProviderOptionsV2::device_id

Definition at line 17 of file cuda_provider_options.h.

int OrtCUDAProviderOptionsV2::do_copy_in_default_stream

Definition at line 20 of file cuda_provider_options.h.

int OrtCUDAProviderOptionsV2::enable_cuda_graph

Definition at line 28 of file cuda_provider_options.h.

size_t OrtCUDAProviderOptionsV2::gpu_mem_limit

Definition at line 22 of file cuda_provider_options.h.

int OrtCUDAProviderOptionsV2::has_user_compute_stream

Definition at line 18 of file cuda_provider_options.h.

int OrtCUDAProviderOptionsV2::tunable_op_enabled

Definition at line 30 of file cuda_provider_options.h.

void* OrtCUDAProviderOptionsV2::user_compute_stream

Definition at line 19 of file cuda_provider_options.h.

The documentation for this struct was generated from the following file:

onnxruntime/core/providers/cuda/cuda_provider_options.h

Public Attributes

Detailed Description

Member Data Documentation