org.bytedeco.tensorrt.nvinfer

Class IRuntime

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.tensorrt.nvinfer.INoCopy

org.bytedeco.tensorrt.nvinfer.IRuntime

All Implemented Interfaces:

AutoCloseable

@Namespace(value="nvinfer1")
 @NoOffset
 @Properties(inherit=nvinfer.class)
public class IRuntime
extends INoCopy

\class IRuntime \brief Allows a serialized functionally unsafe engine to be deserialized. \warning Do not inherit from this class, as doing so will break forward-compatibility of the API and ABI.

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
IRuntime() Default native constructor.
IRuntime(long size) Native array allocator.
IRuntime(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
ICudaEngine	deserializeCudaEngine(Pointer blob, long size) \brief Deserialize an engine from a stream.
ICudaEngine	deserializeCudaEngine(Pointer blob, long size, IPluginFactory pluginFactory) Deprecated. Deprecated in TensorRT 8.0. \warning IPluginFactory is no longer supported, therefore pluginFactory must be a nullptr.
void	destroy() Deprecated. Use delete instead. Deprecated in TRT 8.0. \warning Calling destroy on a managed pointer will result in a double-free error.
int	getDLACore() \brief Get the DLA core that the engine executes on.
IErrorRecorder	getErrorRecorder() \brief get the ErrorRecorder assigned to this interface.
ILogger	getLogger() \brief get the logger with which the runtime was created
int	getMaxThreads() \brief Get the maximum number of threads that can be used by the runtime.
int	getNbDLACores() \brief Returns number of DLA hardware cores accessible or 0 if DLA is unavailable.
IRuntime	getPointer(long i)
IRuntime	position(long position)
void	setDLACore(int dlaCore) \brief Sets the DLA core used by the network.
void	setErrorRecorder(IErrorRecorder recorder)
void	setGpuAllocator(IGpuAllocator allocator) \brief Set the GPU allocator.
boolean	setMaxThreads(int maxThreads) \brief Set the maximum number of threads.

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

IRuntime

public IRuntime()

Default native constructor.

IRuntime

public IRuntime(long size)

Native array allocator. Access with Pointer.position(long).

IRuntime

public IRuntime(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

Method Detail

position

public IRuntime position(long position)

Overrides:

position in class Pointer

getPointer

public IRuntime getPointer(long i)

Overrides:

getPointer in class Pointer

deserializeCudaEngine

@Deprecated
 @NoException(value=true)
public ICudaEngine deserializeCudaEngine(@Const
                                                                                 Pointer blob,
                                                                                 @Cast(value="std::size_t")
                                                                                 long size,
                                                                                 IPluginFactory pluginFactory)

Deprecated. Deprecated in TensorRT 8.0. \warning IPluginFactory is no longer supported, therefore pluginFactory must be a nullptr.

\brief Deserialize an engine from a stream. If an error recorder has been set for the runtime, it will also be passed to the engine.

Parameters:

blob - The memory that holds the serialized engine.

size - The size of the memory in bytes.

pluginFactory - The plugin factory, if any plugins are used by the network, otherwise nullptr.

Returns:

The engine, or nullptr if it could not be deserialized.

setDLACore

@NoException(value=true)
public void setDLACore(int dlaCore)

\brief Sets the DLA core used by the network. Defaults to -1.

Parameters:

dlaCore - The DLA core to execute the engine on, in the range [0,getNbDlaCores()). This function is used to specify which DLA core to use via indexing, if multiple DLA cores are available. \warning if getNbDLACores() returns 0, then this function does nothing.

See Also:

getDLACore()

getDLACore

@NoException(value=true)
public int getDLACore()

\brief Get the DLA core that the engine executes on.

Returns:

assigned DLA core or -1 for DLA not present or unset.

getNbDLACores

@NoException(value=true)
public int getNbDLACores()

\brief Returns number of DLA hardware cores accessible or 0 if DLA is unavailable.

destroy

@Deprecated
 @NoException(value=true)
public void destroy()

Deprecated. Use delete instead. Deprecated in TRT 8.0. \warning Calling destroy on a managed pointer will result in a double-free error.

\brief Destroy this object.

setGpuAllocator

@NoException(value=true)
public void setGpuAllocator(IGpuAllocator allocator)

\brief Set the GPU allocator.

Parameters:

allocator - Set the GPU allocator to be used by the runtime. All GPU memory acquired will use this allocator. If NULL is passed, the default allocator will be used. Default: uses cudaMalloc/cudaFree. If nullptr is passed, the default allocator will be used.

setErrorRecorder

@NoException(value=true)
public void setErrorRecorder(IErrorRecorder recorder)

See Also:

/**

getErrorRecorder

@NoException(value=true)
public IErrorRecorder getErrorRecorder()

\brief get the ErrorRecorder assigned to this interface. Retrieves the assigned error recorder object for the given class. A nullptr will be returned if an error handler has not been set.

Returns:

A pointer to the IErrorRecorder object that has been registered.

See Also:

setErrorRecorder()

deserializeCudaEngine

@NoException(value=true)
public ICudaEngine deserializeCudaEngine(@Const
                                                                   Pointer blob,
                                                                   @Cast(value="std::size_t")
                                                                   long size)

\brief Deserialize an engine from a stream. If an error recorder has been set for the runtime, it will also be passed to the engine.

Parameters:

blob - The memory that holds the serialized engine.

size - The size of the memory.

Returns:

The engine, or nullptr if it could not be deserialized.

getLogger

@NoException(value=true)
public ILogger getLogger()

\brief get the logger with which the runtime was created

Returns:

the logger

setMaxThreads

@Cast(value="bool")
 @NoException(value=true)
public boolean setMaxThreads(int maxThreads)

\brief Set the maximum number of threads.

Parameters:

maxThreads - The maximum number of threads that can be used by the runtime.

Returns:

True if successful, false otherwise. The default value is 1 and includes the current thread. A value greater than 1 permits TensorRT to use multi-threaded algorithms. A value less than 1 triggers a kINVALID_ARGUMENT error.

getMaxThreads

@NoException(value=true)
public int getMaxThreads()

\brief Get the maximum number of threads that can be used by the runtime. Retrieves the maximum number of threads that can be used by the runtime.

Returns:

The maximum number of threads that can be used by the runtime.

See Also:

setMaxThreads()