org.bytedeco.tensorrt.nvinfer

Class IAlgorithmSelector

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.tensorrt.nvinfer.IAlgorithmSelector

All Implemented Interfaces:

AutoCloseable

@Namespace(value="nvinfer1")
 @Properties(inherit=nvinfer.class)
public class IAlgorithmSelector
extends Pointer

\class IAlgorithmSelector \brief Interface implemented by application for selecting and reporting algorithms of a layer provided by the builder. \note A layer in context of algorithm selection may be different from ILayer in INetworkDefiniton. For example, an algorithm might be implementing a conglomeration of multiple ILayers in INetworkDefinition.

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
IAlgorithmSelector(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
void	reportAlgorithms(IAlgorithmContext algoContexts, IAlgorithm algoChoices, int nbAlgorithms)
void	reportAlgorithms(PointerPointer algoContexts, PointerPointer algoChoices, int nbAlgorithms) \brief Called by TensorRT to report choices it made.
int	selectAlgorithms(IAlgorithmContext context, IAlgorithm choices, int nbChoices, int[] selection)
int	selectAlgorithms(IAlgorithmContext context, IAlgorithm choices, int nbChoices, IntBuffer selection)
int	selectAlgorithms(IAlgorithmContext context, IAlgorithm choices, int nbChoices, IntPointer selection)
int	selectAlgorithms(IAlgorithmContext context, PointerPointer choices, int nbChoices, IntPointer selection) \brief Select Algorithms for a layer from the given list of algorithm choices.

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

IAlgorithmSelector

public IAlgorithmSelector(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

Method Detail

selectAlgorithms

@NoException(value=true)
public int selectAlgorithms(@Const @ByRef
                                                      IAlgorithmContext context,
                                                      @Cast(value="const nvinfer1::IAlgorithm*const*")
                                                      PointerPointer choices,
                                                      int nbChoices,
                                                      IntPointer selection)

\brief Select Algorithms for a layer from the given list of algorithm choices.

Parameters:

context - The context for which the algorithm choices are valid.

choices - The list of algorithm choices to select for implementation of this layer.

nbChoices - Number of algorithm choices.

selection - The user writes indices of selected choices in to selection buffer which is of size nbChoices. \note TensorRT uses its default algorithm selection to choose from the list provided. If return value is 0, TensorRT's default algorithm selection is used unless BuilderFlag::kREJECT_EMPTY_ALGORITHMS (or the deprecated BuilderFlag::kSTRICT_TYPES) is set. The list of choices is valid only for this specific algorithm context.

Returns:

The number of choices selected from [0, nbChoices-1].

selectAlgorithms

@NoException(value=true)
public int selectAlgorithms(@Const @ByRef
                                                      IAlgorithmContext context,
                                                      @Const @ByPtrPtr
                                                      IAlgorithm choices,
                                                      int nbChoices,
                                                      IntPointer selection)

selectAlgorithms

@NoException(value=true)
public int selectAlgorithms(@Const @ByRef
                                                      IAlgorithmContext context,
                                                      @Const @ByPtrPtr
                                                      IAlgorithm choices,
                                                      int nbChoices,
                                                      IntBuffer selection)

selectAlgorithms

@NoException(value=true)
public int selectAlgorithms(@Const @ByRef
                                                      IAlgorithmContext context,
                                                      @Const @ByPtrPtr
                                                      IAlgorithm choices,
                                                      int nbChoices,
                                                      int[] selection)

reportAlgorithms

@NoException(value=true)
public void reportAlgorithms(@Cast(value="const nvinfer1::IAlgorithmContext*const*")
                                                       PointerPointer algoContexts,
                                                       @Cast(value="const nvinfer1::IAlgorithm*const*")
                                                       PointerPointer algoChoices,
                                                       int nbAlgorithms)

\brief Called by TensorRT to report choices it made. \note For a given optimization profile, this call comes after all calls to selectAlgorithms. algoChoices[i] is the choice that TensorRT made for algoContexts[i], for i in [0, nbAlgorithms-1]

Parameters:

algoContexts - The list of all algorithm contexts.

algoChoices - The list of algorithm choices made by TensorRT

nbAlgorithms - The size of algoContexts as well as algoChoices.

reportAlgorithms

@NoException(value=true)
public void reportAlgorithms(@Const @ByPtrPtr
                                                       IAlgorithmContext algoContexts,
                                                       @Const @ByPtrPtr
                                                       IAlgorithm algoChoices,
                                                       int nbAlgorithms)