/usr/src/tensorrt/bin/trtexec --onnx=model_small.onnx
&&&& RUNNING TensorRT.trtexec [TensorRT v8401] # /usr/src/tensorrt/bin/trtexec --onnx=model_small.onnx
[07/12/2022-09:35:10] [I] === Model Options ===
[07/12/2022-09:35:10] [I] Format: ONNX
[07/12/2022-09:35:10] [I] Model: model_small.onnx
[07/12/2022-09:35:10] [I] Output:
[07/12/2022-09:35:10] [I] === Build Options ===
[07/12/2022-09:35:10] [I] Max batch: explicit batch
[07/12/2022-09:35:10] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
[07/12/2022-09:35:10] [I] minTiming: 1
[07/12/2022-09:35:10] [I] avgTiming: 8
[07/12/2022-09:35:10] [I] Precision: FP32
[07/12/2022-09:35:10] [I] LayerPrecisions: 
[07/12/2022-09:35:10] [I] Calibration: 
[07/12/2022-09:35:10] [I] Refit: Disabled
[07/12/2022-09:35:10] [I] Sparsity: Disabled
[07/12/2022-09:35:10] [I] Safe mode: Disabled
[07/12/2022-09:35:10] [I] DirectIO mode: Disabled
[07/12/2022-09:35:10] [I] Restricted mode: Disabled
[07/12/2022-09:35:10] [I] Build only: Disabled
[07/12/2022-09:35:10] [I] Save engine: 
[07/12/2022-09:35:10] [I] Load engine: 
[07/12/2022-09:35:10] [I] Profiling verbosity: 0
[07/12/2022-09:35:10] [I] Tactic sources: Using default tactic sources
[07/12/2022-09:35:10] [I] timingCacheMode: local
[07/12/2022-09:35:10] [I] timingCacheFile: 
[07/12/2022-09:35:10] [I] Input(s)s format: fp32:CHW
[07/12/2022-09:35:10] [I] Output(s)s format: fp32:CHW
[07/12/2022-09:35:10] [I] Input build shapes: model
[07/12/2022-09:35:10] [I] Input calibration shapes: model
[07/12/2022-09:35:10] [I] === System Options ===
[07/12/2022-09:35:10] [I] Device: 0
[07/12/2022-09:35:10] [I] DLACore: 
[07/12/2022-09:35:10] [I] Plugins:
[07/12/2022-09:35:10] [I] === Inference Options ===
[07/12/2022-09:35:10] [I] Batch: Explicit
[07/12/2022-09:35:10] [I] Input inference shapes: model
[07/12/2022-09:35:10] [I] Iterations: 10
[07/12/2022-09:35:10] [I] Duration: 3s (+ 200ms warm up)
[07/12/2022-09:35:10] [I] Sleep time: 0ms
[07/12/2022-09:35:10] [I] Idle time: 0ms
[07/12/2022-09:35:10] [I] Streams: 1
[07/12/2022-09:35:10] [I] ExposeDMA: Disabled
[07/12/2022-09:35:10] [I] Data transfers: Enabled
[07/12/2022-09:35:10] [I] Spin-wait: Disabled
[07/12/2022-09:35:10] [I] Multithreading: Disabled
[07/12/2022-09:35:10] [I] CUDA Graph: Disabled
[07/12/2022-09:35:10] [I] Separate profiling: Disabled
[07/12/2022-09:35:10] [I] Time Deserialize: Disabled
[07/12/2022-09:35:10] [I] Time Refit: Disabled
[07/12/2022-09:35:10] [I] Inputs:
[07/12/2022-09:35:10] [I] === Reporting Options ===
[07/12/2022-09:35:10] [I] Verbose: Disabled
[07/12/2022-09:35:10] [I] Averages: 10 inferences
[07/12/2022-09:35:10] [I] Percentile: 99
[07/12/2022-09:35:10] [I] Dump refittable layers:Disabled
[07/12/2022-09:35:10] [I] Dump output: Disabled
[07/12/2022-09:35:10] [I] Profile: Disabled
[07/12/2022-09:35:10] [I] Export timing to JSON file: 
[07/12/2022-09:35:10] [I] Export output to JSON file: 
[07/12/2022-09:35:10] [I] Export profile to JSON file: 
[07/12/2022-09:35:10] [I] 
[07/12/2022-09:35:12] [I] === Device Information ===
[07/12/2022-09:35:12] [I] Selected Device: NVIDIA GeForce RTX 2060 with Max-Q Design
[07/12/2022-09:35:12] [I] Compute Capability: 7.5
[07/12/2022-09:35:12] [I] SMs: 30
[07/12/2022-09:35:12] [I] Compute Clock Rate: 1.185 GHz
[07/12/2022-09:35:12] [I] Device Global Memory: 5934 MiB
[07/12/2022-09:35:12] [I] Shared Memory per SM: 64 KiB
[07/12/2022-09:35:12] [I] Memory Bus Width: 192 bits (ECC disabled)
[07/12/2022-09:35:12] [I] Memory Clock Rate: 5.501 GHz
[07/12/2022-09:35:12] [I] 
[07/12/2022-09:35:12] [I] TensorRT version: 8.4.1
[07/12/2022-09:35:12] [I] [TRT] [MemUsageChange] Init CUDA: CPU +311, GPU +0, now: CPU 319, GPU 228 (MiB)
[07/12/2022-09:35:13] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +206, GPU +68, now: CPU 544, GPU 296 (MiB)
[07/12/2022-09:35:13] [I] Start parsing network model
[07/12/2022-09:35:13] [I] [TRT] ----------------------------------------------------------------
[07/12/2022-09:35:13] [I] [TRT] Input filename:   model_small.onnx
[07/12/2022-09:35:13] [I] [TRT] ONNX IR version:  0.0.6
[07/12/2022-09:35:13] [I] [TRT] Opset version:    11
[07/12/2022-09:35:13] [I] [TRT] Producer name:    pytorch
[07/12/2022-09:35:13] [I] [TRT] Producer version: 1.11.0
[07/12/2022-09:35:13] [I] [TRT] Domain:           
[07/12/2022-09:35:13] [I] [TRT] Model version:    0
[07/12/2022-09:35:13] [I] [TRT] Doc string:       
[07/12/2022-09:35:13] [I] [TRT] ----------------------------------------------------------------
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:369: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:13] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:14] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:15] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:16] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:17] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:18] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:18] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:18] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:18] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:18] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:18] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:19] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:20] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:20] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:20] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:20] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:20] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:20] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:21] [W] [TRT] onnx2trt_utils.cpp:395: One or more weights outside the range of INT32 was clamped
[07/12/2022-09:35:21] [I] [TRT] No importer registered for op: Mod. Attempting to import as plugin.
[07/12/2022-09:35:21] [I] [TRT] Searching for plugin: Mod, plugin_version: 1, plugin_namespace: 
[07/12/2022-09:35:21] [E] [TRT] ModelImporter.cpp:773: While parsing node number 2495 [Mod -> "onnx::Sub_4014"]:
[07/12/2022-09:35:21] [E] [TRT] ModelImporter.cpp:774: --- Begin node ---
[07/12/2022-09:35:21] [E] [TRT] ModelImporter.cpp:775: input: "onnx::Mod_4012"
input: "onnx::Mod_4013"
output: "onnx::Sub_4014"
name: "Mod_2495"
op_type: "Mod"
attribute {
  name: "fmod"
  i: 0
  type: INT
}

[07/12/2022-09:35:21] [E] [TRT] ModelImporter.cpp:776: --- End node ---
[07/12/2022-09:35:21] [E] [TRT] ModelImporter.cpp:779: ERROR: builtin_op_importers.cpp:4890 In function importFallbackPluginImporter:
[8] Assertion failed: creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[07/12/2022-09:35:21] [E] Failed to parse onnx file
[07/12/2022-09:35:21] [I] Finish parsing network model
[07/12/2022-09:35:21] [E] Parsing model failed
[07/12/2022-09:35:21] [E] Failed to create engine from model or file.
[07/12/2022-09:35:21] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8401] # /usr/src/tensorrt/bin/trtexec --onnx=model_small.onnx