org.bytedeco.tensorrt.nvonnxparser

Class IParser

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.tensorrt.nvonnxparser.IParser

All Implemented Interfaces:

AutoCloseable

@Namespace(value="nvonnxparser")
 @Properties(inherit=nvonnxparser.class)
public class IParser
extends Pointer

\class IParser \brief an object for parsing ONNX models into a TensorRT network definition

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
IParser(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
void	clearErrors() \brief Clear errors from prior calls to \p parse
void	destroy() Deprecated.
IParserError	getError(int index) \brief Get an error that occurred during prior calls to \p parse
int	getNbErrors() \brief Get the number of errors that occurred during prior calls to \p parse
boolean	parse(Pointer serialized_onnx_model, long serialized_onnx_model_size)
boolean	parse(Pointer serialized_onnx_model, long serialized_onnx_model_size, BytePointer model_path)
boolean	parse(Pointer serialized_onnx_model, long serialized_onnx_model_size, String model_path) \brief Parse a serialized ONNX model into the TensorRT network.
boolean	parseFromFile(BytePointer onnxModelFile, int verbosity)
boolean	parseFromFile(String onnxModelFile, int verbosity) \brief Parse an onnx model file, which can be a binary protobuf or a text onnx model calls parse method inside.
boolean	parseWithWeightDescriptors(Pointer serialized_onnx_model, long serialized_onnx_model_size) \brief Parse a serialized ONNX model into the TensorRT network with consideration of user provided weights
boolean	supportsModel(Pointer serialized_onnx_model, long serialized_onnx_model_size, SubGraphCollection_t sub_graph_collection)
boolean	supportsModel(Pointer serialized_onnx_model, long serialized_onnx_model_size, SubGraphCollection_t sub_graph_collection, BytePointer model_path)
boolean	supportsModel(Pointer serialized_onnx_model, long serialized_onnx_model_size, SubGraphCollection_t sub_graph_collection, String model_path) \brief Check whether TensorRT supports a particular ONNX model.
boolean	supportsOperator(BytePointer op_name)
boolean	supportsOperator(String op_name) \brief Returns whether the specified operator may be supported by the parser.

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

IParser

public IParser(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

Method Detail

parse

@Cast(value="bool")
public boolean parse(@Const
                                          Pointer serialized_onnx_model,
                                          @Cast(value="size_t")
                                          long serialized_onnx_model_size,
                                          String model_path)

\brief Parse a serialized ONNX model into the TensorRT network. This method has very limited diagnostics. If parsing the serialized model fails for any reason (e.g. unsupported IR version, unsupported opset, etc.) it the user responsibility to intercept and report the error. To obtain a better diagnostic, use the parseFromFile method below.

Parameters:

serialized_onnx_model - Pointer to the serialized ONNX model

serialized_onnx_model_size - Size of the serialized ONNX model in bytes

model_path - Absolute path to the model file for loading external weights if required

Returns:

true if the model was parsed successfully

See Also:

getError()

parse

@Cast(value="bool")
public boolean parse(@Const
                                          Pointer serialized_onnx_model,
                                          @Cast(value="size_t")
                                          long serialized_onnx_model_size)

parse

@Cast(value="bool")
public boolean parse(@Const
                                          Pointer serialized_onnx_model,
                                          @Cast(value="size_t")
                                          long serialized_onnx_model_size,
                                          @Cast(value="const char*")
                                          BytePointer model_path)

parseFromFile

@Cast(value="bool")
public boolean parseFromFile(String onnxModelFile,
                                                  int verbosity)

\brief Parse an onnx model file, which can be a binary protobuf or a text onnx model calls parse method inside.

Parameters:

File - name

Verbosity - Level

Returns:

true if the model was parsed successfully

parseFromFile

@Cast(value="bool")
public boolean parseFromFile(@Cast(value="const char*")
                                                  BytePointer onnxModelFile,
                                                  int verbosity)

supportsModel

@Cast(value="bool")
public boolean supportsModel(@Const
                                                  Pointer serialized_onnx_model,
                                                  @Cast(value="size_t")
                                                  long serialized_onnx_model_size,
                                                  @ByRef
                                                  SubGraphCollection_t sub_graph_collection,
                                                  String model_path)

\brief Check whether TensorRT supports a particular ONNX model. If the function returns True, one can proceed to engine building without having to call \p parse or \p parseFromFile.

Parameters:

serialized_onnx_model - Pointer to the serialized ONNX model

serialized_onnx_model_size - Size of the serialized ONNX model in bytes

sub_graph_collection - Container to hold supported subgraphs

model_path - Absolute path to the model file for loading external weights if required

Returns:

true if the model is supported

supportsModel

@Cast(value="bool")
public boolean supportsModel(@Const
                                                  Pointer serialized_onnx_model,
                                                  @Cast(value="size_t")
                                                  long serialized_onnx_model_size,
                                                  @ByRef
                                                  SubGraphCollection_t sub_graph_collection)

supportsModel

@Cast(value="bool")
public boolean supportsModel(@Const
                                                  Pointer serialized_onnx_model,
                                                  @Cast(value="size_t")
                                                  long serialized_onnx_model_size,
                                                  @ByRef
                                                  SubGraphCollection_t sub_graph_collection,
                                                  @Cast(value="const char*")
                                                  BytePointer model_path)

parseWithWeightDescriptors

@Cast(value="bool")
public boolean parseWithWeightDescriptors(@Const
                                                               Pointer serialized_onnx_model,
                                                               @Cast(value="size_t")
                                                               long serialized_onnx_model_size)

\brief Parse a serialized ONNX model into the TensorRT network with consideration of user provided weights

Parameters:

serialized_onnx_model - Pointer to the serialized ONNX model

serialized_onnx_model_size - Size of the serialized ONNX model in bytes

Returns:

true if the model was parsed successfully

See Also:

getError()

supportsOperator

@Cast(value="bool")
public boolean supportsOperator(String op_name)

\brief Returns whether the specified operator may be supported by the parser. Note that a result of true does not guarantee that the operator will be supported in all cases (i.e., this function may return false-positives).

Parameters:

op_name - The name of the ONNX operator to check for support

supportsOperator

@Cast(value="bool")
public boolean supportsOperator(@Cast(value="const char*")
                                                     BytePointer op_name)

destroy

@Deprecated
public void destroy()

Deprecated.

\brief destroy this object \warning deprecated and planned on being removed in TensorRT 10.0

getNbErrors

public int getNbErrors()

\brief Get the number of errors that occurred during prior calls to \p parse

See Also:

clearErrors() IParserError

getError

@Const
public IParserError getError(int index)

\brief Get an error that occurred during prior calls to \p parse

See Also:

clearErrors() IParserError

clearErrors

public void clearErrors()

\brief Clear errors from prior calls to \p parse

See Also:

getError() IParserError