ExecutionProvider

sealed class ExecutionProvider
Content copied to clipboard

These are classes representing the supported ONNXRuntime execution providers for KotlinDL. The supported providers are:

  • CPU (default)

  • CUDA (could be used if the CUDA runtime is installed)

  • NNAPI (could be used on Android if the NNAPI runtime is supported)

Internally, the OrtProvider enum is used to indicate the provider.

Parameters

internalProviderId

the OrtProvider enum value

Types

CPU
Link copied to clipboard
common
data class CPU(useBFCArenaAllocator: Boolean) : ExecutionProvider
Content copied to clipboard

Default CPU execution provider. Available on all platforms.

CUDA
Link copied to clipboard
common
data class CUDA(deviceId: Int) : ExecutionProvider
Content copied to clipboard

CUDA execution provider. Available only on platforms with Nvidia gpu and CUDA runtime installed.

NNAPI
Link copied to clipboard
common
data class NNAPI(flags: Set<<ERROR CLASS>>) : ExecutionProvider
Content copied to clipboard

NNAPI execution provider. Available only on Android.

Functions

addOptionsTo
Link copied to clipboard
common
open fun addOptionsTo(sessionOptions: <ERROR CLASS>)
Content copied to clipboard

Adds execution provider options to the OrtSession.SessionOptions.

Properties

internalProviderId
Link copied to clipboard
common
val internalProviderId: <ERROR CLASS>
Content copied to clipboard

Inheritors

ExecutionProvider
Link copied to clipboard
ExecutionProvider
Link copied to clipboard
ExecutionProvider
Link copied to clipboard