&&&& RUNNING TensorRT.trtexec # trtexec --onnx=models/weights/Retinaface_m25_dynamic_batch.onnx --verbose --explicitBatch --minShapes=input:1x3x640x640 --optShapes=input:4x3x640x640 --maxShapes=input:8x3x640x640 --shapes=input:5x3x640x640 --saveEngine=./models/weights/retinaface.trt [07/29/2021-16:41:58] [I] === Model Options === [07/29/2021-16:41:58] [I] Format: ONNX [07/29/2021-16:41:58] [I] Model: models/weights/Retinaface_m25_dynamic_batch.onnx [07/29/2021-16:41:58] [I] Output: [07/29/2021-16:41:58] [I] === Build Options === [07/29/2021-16:41:58] [I] Max batch: explicit [07/29/2021-16:41:58] [I] Workspace: 16 MiB [07/29/2021-16:41:58] [I] minTiming: 1 [07/29/2021-16:41:58] [I] avgTiming: 8 [07/29/2021-16:41:58] [I] Precision: FP32 [07/29/2021-16:41:58] [I] Calibration: [07/29/2021-16:41:58] [I] Refit: Disabled [07/29/2021-16:41:58] [I] Safe mode: Disabled [07/29/2021-16:41:58] [I] Save engine: ./models/weights/retinaface.trt [07/29/2021-16:41:58] [I] Load engine: [07/29/2021-16:41:58] [I] Builder Cache: Enabled [07/29/2021-16:41:58] [I] NVTX verbosity: 0 [07/29/2021-16:41:58] [I] Tactic sources: Using default tactic sources [07/29/2021-16:41:58] [I] Input(s)s format: fp32:CHW [07/29/2021-16:41:58] [I] Output(s)s format: fp32:CHW [07/29/2021-16:41:58] [I] Input build shape: input=1x3x640x640+4x3x640x640+8x3x640x640 [07/29/2021-16:41:58] [I] Input calibration shapes: model [07/29/2021-16:41:58] [I] === System Options === [07/29/2021-16:41:58] [I] Device: 0 [07/29/2021-16:41:58] [I] DLACore: [07/29/2021-16:41:58] [I] Plugins: [07/29/2021-16:41:58] [I] === Inference Options === [07/29/2021-16:41:58] [I] Batch: Explicit [07/29/2021-16:41:58] [I] Input inference shape: input=5x3x640x640 [07/29/2021-16:41:58] [I] Iterations: 10 [07/29/2021-16:41:58] [I] Duration: 3s (+ 200ms warm up) [07/29/2021-16:41:58] [I] Sleep time: 0ms [07/29/2021-16:41:58] [I] Streams: 1 [07/29/2021-16:41:58] [I] ExposeDMA: Disabled [07/29/2021-16:41:58] [I] Data transfers: Enabled [07/29/2021-16:41:58] [I] Spin-wait: Disabled [07/29/2021-16:41:58] [I] Multithreading: Disabled [07/29/2021-16:41:58] [I] CUDA Graph: Disabled [07/29/2021-16:41:58] [I] Separate profiling: Disabled [07/29/2021-16:41:58] [I] Skip inference: Disabled [07/29/2021-16:41:58] [I] Inputs: [07/29/2021-16:41:58] [I] === Reporting Options === [07/29/2021-16:41:58] [I] Verbose: Enabled [07/29/2021-16:41:58] [I] Averages: 10 inferences [07/29/2021-16:41:58] [I] Percentile: 99 [07/29/2021-16:41:58] [I] Dump refittable layers:Disabled [07/29/2021-16:41:58] [I] Dump output: Disabled [07/29/2021-16:41:58] [I] Profile: Disabled [07/29/2021-16:41:58] [I] Export timing to JSON file: [07/29/2021-16:41:58] [I] Export output to JSON file: [07/29/2021-16:41:58] [I] Export profile to JSON file: [07/29/2021-16:41:58] [I] [07/29/2021-16:41:58] [I] === Device Information === [07/29/2021-16:41:58] [I] Selected Device: Tesla T4 [07/29/2021-16:41:58] [I] Compute Capability: 7.5 [07/29/2021-16:41:58] [I] SMs: 40 [07/29/2021-16:41:58] [I] Compute Clock Rate: 1.59 GHz [07/29/2021-16:41:58] [I] Device Global Memory: 15109 MiB [07/29/2021-16:41:58] [I] Shared Memory per SM: 64 KiB [07/29/2021-16:41:58] [I] Memory Bus Width: 256 bits (ECC enabled) [07/29/2021-16:41:58] [I] Memory Clock Rate: 5.001 GHz [07/29/2021-16:41:58] [I] [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::Proposal version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::Split version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 ---------------------------------------------------------------- Input filename: models/weights/Retinaface_m25_dynamic_batch.onnx ONNX IR version: 0.0.6 Opset version: 11 Producer name: pytorch Producer version: 1.9 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::Split version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:202: Adding network input: input with dtype: float32, dimensions: (-1, 3, 640, 640) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: input for ONNX tensor: input [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 283 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 284 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 285 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 286 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 287 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 288 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 289 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 290 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 291 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 292 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 293 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 294 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 295 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 296 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 297 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 298 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 299 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 300 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 592 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 593 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 595 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 596 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 598 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 599 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 601 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 602 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 604 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 605 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 607 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 608 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 610 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 611 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 613 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 614 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 616 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 617 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 619 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 620 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 622 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 623 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 625 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 626 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 628 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 629 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 631 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 632 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 634 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 635 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 637 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 638 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 640 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 641 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 643 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 644 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 646 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 647 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 649 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 650 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 652 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 653 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 655 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 656 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 658 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 659 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 661 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 662 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 664 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 665 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 667 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 668 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 670 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 671 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 673 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 674 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 676 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 677 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 679 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 680 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 682 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 683 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 685 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 686 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 688 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 689 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 691 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 692 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 694 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 695 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 697 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 698 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 700 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 701 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 703 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 704 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 706 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 707 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 709 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 710 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 712 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 713 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 715 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 716 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 718 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 719 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 721 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 722 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 724 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 725 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 727 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 728 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 730 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 731 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 732 [07/29/2021-16:41:58] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 733 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 734 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 735 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 736 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 737 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 738 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 739 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 740 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 741 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 742 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 743 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 744 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 745 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 746 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 747 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 748 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:90: Importing initializer: 749 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_0 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: input [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 592 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 593 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_0 [Conv] inputs: [input -> (-1, 3, 640, 640)], [592 -> (8, 3, 3, 3)], [593 -> (8)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 3, 640, 640) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_0 for ONNX node: Conv_0 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 8 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 8, 320, 320) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 591 for ONNX tensor: 591 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_0 [Conv] outputs: [591 -> (-1, 8, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_1 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 591 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_1 [LeakyRelu] inputs: [591 -> (-1, 8, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_1 for ONNX node: LeakyRelu_1 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 303 for ONNX tensor: 303 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_1 [LeakyRelu] outputs: [303 -> (-1, 8, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_2 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 303 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 595 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 596 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_2 [Conv] inputs: [303 -> (-1, 8, 320, 320)], [595 -> (8, 1, 3, 3)], [596 -> (8)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 8, 320, 320) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_2 for ONNX node: Conv_2 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 8 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 8, 320, 320) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 594 for ONNX tensor: 594 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_2 [Conv] outputs: [594 -> (-1, 8, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_3 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 594 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_3 [LeakyRelu] inputs: [594 -> (-1, 8, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_3 for ONNX node: LeakyRelu_3 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 306 for ONNX tensor: 306 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_3 [LeakyRelu] outputs: [306 -> (-1, 8, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_4 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 306 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 598 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 599 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_4 [Conv] inputs: [306 -> (-1, 8, 320, 320)], [598 -> (16, 8, 1, 1)], [599 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 8, 320, 320) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_4 for ONNX node: Conv_4 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 320, 320) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 597 for ONNX tensor: 597 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_4 [Conv] outputs: [597 -> (-1, 16, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_5 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 597 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_5 [LeakyRelu] inputs: [597 -> (-1, 16, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_5 for ONNX node: LeakyRelu_5 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 309 for ONNX tensor: 309 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_5 [LeakyRelu] outputs: [309 -> (-1, 16, 320, 320)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_6 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 309 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 601 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 602 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_6 [Conv] inputs: [309 -> (-1, 16, 320, 320)], [601 -> (16, 1, 3, 3)], [602 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 320, 320) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_6 for ONNX node: Conv_6 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 160, 160) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 600 for ONNX tensor: 600 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_6 [Conv] outputs: [600 -> (-1, 16, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_7 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 600 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_7 [LeakyRelu] inputs: [600 -> (-1, 16, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_7 for ONNX node: LeakyRelu_7 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 312 for ONNX tensor: 312 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_7 [LeakyRelu] outputs: [312 -> (-1, 16, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_8 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 312 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 604 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 605 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_8 [Conv] inputs: [312 -> (-1, 16, 160, 160)], [604 -> (32, 16, 1, 1)], [605 -> (32)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 160, 160) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_8 for ONNX node: Conv_8 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 32, 160, 160) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 603 for ONNX tensor: 603 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_8 [Conv] outputs: [603 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_9 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 603 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_9 [LeakyRelu] inputs: [603 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_9 for ONNX node: LeakyRelu_9 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 315 for ONNX tensor: 315 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_9 [LeakyRelu] outputs: [315 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_10 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 315 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 607 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 608 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_10 [Conv] inputs: [315 -> (-1, 32, 160, 160)], [607 -> (32, 1, 3, 3)], [608 -> (32)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 32, 160, 160) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_10 for ONNX node: Conv_10 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 32, 160, 160) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 606 for ONNX tensor: 606 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_10 [Conv] outputs: [606 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_11 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 606 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_11 [LeakyRelu] inputs: [606 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_11 for ONNX node: LeakyRelu_11 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 318 for ONNX tensor: 318 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_11 [LeakyRelu] outputs: [318 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_12 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 318 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 610 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 611 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_12 [Conv] inputs: [318 -> (-1, 32, 160, 160)], [610 -> (32, 32, 1, 1)], [611 -> (32)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 32, 160, 160) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_12 for ONNX node: Conv_12 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 32 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 32, 160, 160) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 609 for ONNX tensor: 609 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_12 [Conv] outputs: [609 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_13 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 609 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_13 [LeakyRelu] inputs: [609 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_13 for ONNX node: LeakyRelu_13 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 321 for ONNX tensor: 321 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_13 [LeakyRelu] outputs: [321 -> (-1, 32, 160, 160)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_14 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 321 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 613 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 614 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_14 [Conv] inputs: [321 -> (-1, 32, 160, 160)], [613 -> (32, 1, 3, 3)], [614 -> (32)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 32, 160, 160) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_14 for ONNX node: Conv_14 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 32, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 612 for ONNX tensor: 612 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_14 [Conv] outputs: [612 -> (-1, 32, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_15 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 612 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_15 [LeakyRelu] inputs: [612 -> (-1, 32, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_15 for ONNX node: LeakyRelu_15 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 324 for ONNX tensor: 324 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_15 [LeakyRelu] outputs: [324 -> (-1, 32, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_16 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 324 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 616 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 617 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_16 [Conv] inputs: [324 -> (-1, 32, 80, 80)], [616 -> (64, 32, 1, 1)], [617 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 32, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_16 for ONNX node: Conv_16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 615 for ONNX tensor: 615 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_16 [Conv] outputs: [615 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_17 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 615 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_17 [LeakyRelu] inputs: [615 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_17 for ONNX node: LeakyRelu_17 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 327 for ONNX tensor: 327 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_17 [LeakyRelu] outputs: [327 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_18 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 327 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 619 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 620 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_18 [Conv] inputs: [327 -> (-1, 64, 80, 80)], [619 -> (64, 1, 3, 3)], [620 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_18 for ONNX node: Conv_18 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 618 for ONNX tensor: 618 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_18 [Conv] outputs: [618 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_19 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 618 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_19 [LeakyRelu] inputs: [618 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_19 for ONNX node: LeakyRelu_19 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 330 for ONNX tensor: 330 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_19 [LeakyRelu] outputs: [330 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_20 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 330 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 622 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 623 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_20 [Conv] inputs: [330 -> (-1, 64, 80, 80)], [622 -> (64, 64, 1, 1)], [623 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_20 for ONNX node: Conv_20 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 621 for ONNX tensor: 621 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_20 [Conv] outputs: [621 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_21 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 621 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_21 [LeakyRelu] inputs: [621 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_21 for ONNX node: LeakyRelu_21 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 333 for ONNX tensor: 333 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_21 [LeakyRelu] outputs: [333 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_22 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 333 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 625 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 626 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_22 [Conv] inputs: [333 -> (-1, 64, 80, 80)], [625 -> (64, 1, 3, 3)], [626 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_22 for ONNX node: Conv_22 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 624 for ONNX tensor: 624 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_22 [Conv] outputs: [624 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_23 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 624 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_23 [LeakyRelu] inputs: [624 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_23 for ONNX node: LeakyRelu_23 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 336 for ONNX tensor: 336 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_23 [LeakyRelu] outputs: [336 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_24 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 336 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 628 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 629 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_24 [Conv] inputs: [336 -> (-1, 64, 40, 40)], [628 -> (128, 64, 1, 1)], [629 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_24 for ONNX node: Conv_24 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 627 for ONNX tensor: 627 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_24 [Conv] outputs: [627 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_25 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 627 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_25 [LeakyRelu] inputs: [627 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_25 for ONNX node: LeakyRelu_25 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 339 for ONNX tensor: 339 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_25 [LeakyRelu] outputs: [339 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_26 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 339 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 631 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 632 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_26 [Conv] inputs: [339 -> (-1, 128, 40, 40)], [631 -> (128, 1, 3, 3)], [632 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_26 for ONNX node: Conv_26 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 630 for ONNX tensor: 630 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_26 [Conv] outputs: [630 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_27 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 630 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_27 [LeakyRelu] inputs: [630 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_27 for ONNX node: LeakyRelu_27 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 342 for ONNX tensor: 342 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_27 [LeakyRelu] outputs: [342 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_28 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 342 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 634 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 635 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_28 [Conv] inputs: [342 -> (-1, 128, 40, 40)], [634 -> (128, 128, 1, 1)], [635 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_28 for ONNX node: Conv_28 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 633 for ONNX tensor: 633 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_28 [Conv] outputs: [633 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_29 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 633 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_29 [LeakyRelu] inputs: [633 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_29 for ONNX node: LeakyRelu_29 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 345 for ONNX tensor: 345 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_29 [LeakyRelu] outputs: [345 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_30 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 345 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 637 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 638 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_30 [Conv] inputs: [345 -> (-1, 128, 40, 40)], [637 -> (128, 1, 3, 3)], [638 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_30 for ONNX node: Conv_30 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 636 for ONNX tensor: 636 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_30 [Conv] outputs: [636 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_31 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 636 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_31 [LeakyRelu] inputs: [636 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_31 for ONNX node: LeakyRelu_31 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 348 for ONNX tensor: 348 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_31 [LeakyRelu] outputs: [348 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_32 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 348 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 640 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 641 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_32 [Conv] inputs: [348 -> (-1, 128, 40, 40)], [640 -> (128, 128, 1, 1)], [641 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_32 for ONNX node: Conv_32 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 639 for ONNX tensor: 639 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_32 [Conv] outputs: [639 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_33 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 639 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_33 [LeakyRelu] inputs: [639 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_33 for ONNX node: LeakyRelu_33 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 351 for ONNX tensor: 351 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_33 [LeakyRelu] outputs: [351 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_34 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 351 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 643 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 644 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_34 [Conv] inputs: [351 -> (-1, 128, 40, 40)], [643 -> (128, 1, 3, 3)], [644 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_34 for ONNX node: Conv_34 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 642 for ONNX tensor: 642 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_34 [Conv] outputs: [642 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_35 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 642 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_35 [LeakyRelu] inputs: [642 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_35 for ONNX node: LeakyRelu_35 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 354 for ONNX tensor: 354 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_35 [LeakyRelu] outputs: [354 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_36 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 354 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 646 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 647 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_36 [Conv] inputs: [354 -> (-1, 128, 40, 40)], [646 -> (128, 128, 1, 1)], [647 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_36 for ONNX node: Conv_36 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 645 for ONNX tensor: 645 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_36 [Conv] outputs: [645 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_37 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 645 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_37 [LeakyRelu] inputs: [645 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_37 for ONNX node: LeakyRelu_37 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 357 for ONNX tensor: 357 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_37 [LeakyRelu] outputs: [357 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_38 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 357 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 649 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 650 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_38 [Conv] inputs: [357 -> (-1, 128, 40, 40)], [649 -> (128, 1, 3, 3)], [650 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_38 for ONNX node: Conv_38 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 648 for ONNX tensor: 648 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_38 [Conv] outputs: [648 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_39 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 648 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_39 [LeakyRelu] inputs: [648 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_39 for ONNX node: LeakyRelu_39 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 360 for ONNX tensor: 360 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_39 [LeakyRelu] outputs: [360 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_40 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 360 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 652 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 653 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_40 [Conv] inputs: [360 -> (-1, 128, 40, 40)], [652 -> (128, 128, 1, 1)], [653 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_40 for ONNX node: Conv_40 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 651 for ONNX tensor: 651 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_40 [Conv] outputs: [651 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_41 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 651 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_41 [LeakyRelu] inputs: [651 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_41 for ONNX node: LeakyRelu_41 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 363 for ONNX tensor: 363 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_41 [LeakyRelu] outputs: [363 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_42 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 363 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 655 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 656 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_42 [Conv] inputs: [363 -> (-1, 128, 40, 40)], [655 -> (128, 1, 3, 3)], [656 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_42 for ONNX node: Conv_42 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 654 for ONNX tensor: 654 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_42 [Conv] outputs: [654 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_43 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 654 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_43 [LeakyRelu] inputs: [654 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_43 for ONNX node: LeakyRelu_43 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 366 for ONNX tensor: 366 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_43 [LeakyRelu] outputs: [366 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_44 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 366 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 658 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 659 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_44 [Conv] inputs: [366 -> (-1, 128, 40, 40)], [658 -> (128, 128, 1, 1)], [659 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_44 for ONNX node: Conv_44 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 657 for ONNX tensor: 657 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_44 [Conv] outputs: [657 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_45 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 657 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_45 [LeakyRelu] inputs: [657 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_45 for ONNX node: LeakyRelu_45 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 369 for ONNX tensor: 369 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_45 [LeakyRelu] outputs: [369 -> (-1, 128, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_46 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 369 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 661 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 662 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_46 [Conv] inputs: [369 -> (-1, 128, 40, 40)], [661 -> (128, 1, 3, 3)], [662 -> (128)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_46 for ONNX node: Conv_46 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 128, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 660 for ONNX tensor: 660 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_46 [Conv] outputs: [660 -> (-1, 128, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_47 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 660 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_47 [LeakyRelu] inputs: [660 -> (-1, 128, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_47 for ONNX node: LeakyRelu_47 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 372 for ONNX tensor: 372 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_47 [LeakyRelu] outputs: [372 -> (-1, 128, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_48 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 372 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 664 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 665 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_48 [Conv] inputs: [372 -> (-1, 128, 20, 20)], [664 -> (256, 128, 1, 1)], [665 -> (256)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_48 for ONNX node: Conv_48 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 663 for ONNX tensor: 663 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_48 [Conv] outputs: [663 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_49 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 663 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_49 [LeakyRelu] inputs: [663 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_49 for ONNX node: LeakyRelu_49 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 375 for ONNX tensor: 375 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_49 [LeakyRelu] outputs: [375 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_50 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 375 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 667 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 668 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_50 [Conv] inputs: [375 -> (-1, 256, 20, 20)], [667 -> (256, 1, 3, 3)], [668 -> (256)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_50 for ONNX node: Conv_50 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 666 for ONNX tensor: 666 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_50 [Conv] outputs: [666 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_51 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 666 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_51 [LeakyRelu] inputs: [666 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_51 for ONNX node: LeakyRelu_51 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 378 for ONNX tensor: 378 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_51 [LeakyRelu] outputs: [378 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_52 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 378 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 670 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 671 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_52 [Conv] inputs: [378 -> (-1, 256, 20, 20)], [670 -> (256, 256, 1, 1)], [671 -> (256)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_52 for ONNX node: Conv_52 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 256, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 669 for ONNX tensor: 669 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_52 [Conv] outputs: [669 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_53 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 669 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_53 [LeakyRelu] inputs: [669 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_53 for ONNX node: LeakyRelu_53 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 381 for ONNX tensor: 381 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_53 [LeakyRelu] outputs: [381 -> (-1, 256, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_54 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 333 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 673 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 674 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_54 [Conv] inputs: [333 -> (-1, 64, 80, 80)], [673 -> (64, 64, 1, 1)], [674 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_54 for ONNX node: Conv_54 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 672 for ONNX tensor: 672 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_54 [Conv] outputs: [672 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_55 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 672 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_55 [LeakyRelu] inputs: [672 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_55 for ONNX node: LeakyRelu_55 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 384 for ONNX tensor: 384 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_55 [LeakyRelu] outputs: [384 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_56 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 369 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 676 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 677 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_56 [Conv] inputs: [369 -> (-1, 128, 40, 40)], [676 -> (64, 128, 1, 1)], [677 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 128, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_56 for ONNX node: Conv_56 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 675 for ONNX tensor: 675 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_56 [Conv] outputs: [675 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_57 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 675 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_57 [LeakyRelu] inputs: [675 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_57 for ONNX node: LeakyRelu_57 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 387 for ONNX tensor: 387 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_57 [LeakyRelu] outputs: [387 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_58 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 381 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 679 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 680 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_58 [Conv] inputs: [381 -> (-1, 256, 20, 20)], [679 -> (64, 256, 1, 1)], [680 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 256, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_58 for ONNX node: Conv_58 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 678 for ONNX tensor: 678 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_58 [Conv] outputs: [678 -> (-1, 64, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_59 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 678 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_59 [LeakyRelu] inputs: [678 -> (-1, 64, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_59 for ONNX node: LeakyRelu_59 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 390 for ONNX tensor: 390 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_59 [LeakyRelu] outputs: [390 -> (-1, 64, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_60 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 387 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_60 [Shape] inputs: [387 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_60 for ONNX node: Shape_60 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 391 for ONNX tensor: 391 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_60 [Shape] outputs: [391 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_61 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_61 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_61 [Constant] outputs: [392 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_62 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 391 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 392 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_62 [Gather] inputs: [391 -> (4)], [392 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 392 for ONNX initializer: 392 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_62 for ONNX node: Gather_62 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 393 for ONNX tensor: 393 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_62 [Gather] outputs: [393 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_63 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 387 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_63 [Shape] inputs: [387 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_63 for ONNX node: Shape_63 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 394 for ONNX tensor: 394 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_63 [Shape] outputs: [394 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_64 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_64 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_64 [Constant] outputs: [395 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_65 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 394 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 395 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_65 [Gather] inputs: [394 -> (4)], [395 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 395 for ONNX initializer: 395 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_65 for ONNX node: Gather_65 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 396 for ONNX tensor: 396 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_65 [Gather] outputs: [396 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_66 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 393 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_66 [Unsqueeze] inputs: [393 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_66 for ONNX node: Unsqueeze_66 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 397 for ONNX tensor: 397 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_66 [Unsqueeze] outputs: [397 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_67 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 396 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_67 [Unsqueeze] inputs: [396 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_67 for ONNX node: Unsqueeze_67 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 398 for ONNX tensor: 398 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_67 [Unsqueeze] outputs: [398 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_68 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 397 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 398 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_68 [Concat] inputs: [397 -> (1)], [398 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_68 for ONNX node: Concat_68 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 399 for ONNX tensor: 399 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_68 [Concat] outputs: [399 -> (2)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_69 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 390 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_69 [Shape] inputs: [390 -> (-1, 64, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_69 for ONNX node: Shape_69 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 400 for ONNX tensor: 400 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_69 [Shape] outputs: [400 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_70 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_70 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_70 [Constant] outputs: [401 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_71 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_71 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_71 [Constant] outputs: [402 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_72 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_72 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_72 [Constant] outputs: [403 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_73 [Slice] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 400 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 402 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 403 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 401 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Slice_73 [Slice] inputs: [400 -> (4)], [402 -> (1)], [403 -> (1)], [401 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_73 for ONNX node: Slice_73 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 404 for ONNX tensor: 404 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Slice_73 [Slice] outputs: [404 -> (2)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_74 [Cast] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 399 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Cast_74 [Cast] inputs: [399 -> (2)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: int32 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_74 for ONNX node: Cast_74 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 405 for ONNX tensor: 405 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Cast_74 [Cast] outputs: [405 -> (2)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_75 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 404 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 405 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_75 [Concat] inputs: [404 -> (2)], [405 -> (2)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_75 for ONNX node: Concat_75 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 406 for ONNX tensor: 406 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_75 [Concat] outputs: [406 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_76 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_76 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_76 [Constant] outputs: [407 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_77 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_77 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_77 [Constant] outputs: [408 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Resize_78 [Resize] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 390 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 407 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 408 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 406 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Resize_78 [Resize] inputs: [390 -> (-1, 64, 20, 20)], [407 -> ()], [408 -> ()], [406 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Resize_78 for ONNX node: Resize_78 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 409 for ONNX tensor: 409 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Resize_78 [Resize] outputs: [409 -> (-1, -1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_79 [Add] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 387 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 409 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Add_79 [Add] inputs: [387 -> (-1, 64, 40, 40)], [409 -> (-1, -1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_79 for ONNX node: Add_79 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 410 for ONNX tensor: 410 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Add_79 [Add] outputs: [410 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_80 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 410 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 682 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 683 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_80 [Conv] inputs: [410 -> (-1, 64, 40, 40)], [682 -> (64, 64, 3, 3)], [683 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_80 for ONNX node: Conv_80 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 681 for ONNX tensor: 681 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_80 [Conv] outputs: [681 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_81 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 681 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_81 [LeakyRelu] inputs: [681 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_81 for ONNX node: LeakyRelu_81 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 413 for ONNX tensor: 413 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_81 [LeakyRelu] outputs: [413 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_82 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 384 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_82 [Shape] inputs: [384 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_82 for ONNX node: Shape_82 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 414 for ONNX tensor: 414 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_82 [Shape] outputs: [414 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_83 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_83 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_83 [Constant] outputs: [415 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_84 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 414 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 415 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_84 [Gather] inputs: [414 -> (4)], [415 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 415 for ONNX initializer: 415 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_84 for ONNX node: Gather_84 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 416 for ONNX tensor: 416 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_84 [Gather] outputs: [416 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_85 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 384 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_85 [Shape] inputs: [384 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_85 for ONNX node: Shape_85 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 417 for ONNX tensor: 417 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_85 [Shape] outputs: [417 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_86 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_86 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_86 [Constant] outputs: [418 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_87 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 417 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 418 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_87 [Gather] inputs: [417 -> (4)], [418 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 418 for ONNX initializer: 418 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_87 for ONNX node: Gather_87 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 419 for ONNX tensor: 419 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_87 [Gather] outputs: [419 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_88 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 416 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_88 [Unsqueeze] inputs: [416 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_88 for ONNX node: Unsqueeze_88 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 420 for ONNX tensor: 420 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_88 [Unsqueeze] outputs: [420 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_89 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 419 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_89 [Unsqueeze] inputs: [419 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_89 for ONNX node: Unsqueeze_89 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 421 for ONNX tensor: 421 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_89 [Unsqueeze] outputs: [421 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_90 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 420 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 421 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_90 [Concat] inputs: [420 -> (1)], [421 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_90 for ONNX node: Concat_90 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 422 for ONNX tensor: 422 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_90 [Concat] outputs: [422 -> (2)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_91 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 413 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_91 [Shape] inputs: [413 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_91 for ONNX node: Shape_91 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 423 for ONNX tensor: 423 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_91 [Shape] outputs: [423 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_92 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_92 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_92 [Constant] outputs: [424 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_93 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_93 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_93 [Constant] outputs: [425 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_94 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_94 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_94 [Constant] outputs: [426 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Slice_95 [Slice] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 423 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 425 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 426 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 424 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Slice_95 [Slice] inputs: [423 -> (4)], [425 -> (1)], [426 -> (1)], [424 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Slice_95 for ONNX node: Slice_95 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 427 for ONNX tensor: 427 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Slice_95 [Slice] outputs: [427 -> (2)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Cast_96 [Cast] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 422 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Cast_96 [Cast] inputs: [422 -> (2)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: int32 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Cast_96 for ONNX node: Cast_96 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 428 for ONNX tensor: 428 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Cast_96 [Cast] outputs: [428 -> (2)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_97 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 427 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 428 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_97 [Concat] inputs: [427 -> (2)], [428 -> (2)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_97 for ONNX node: Concat_97 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 429 for ONNX tensor: 429 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_97 [Concat] outputs: [429 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_98 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_98 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_98 [Constant] outputs: [430 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_99 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_99 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_99 [Constant] outputs: [431 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Resize_100 [Resize] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 413 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 430 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 431 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 429 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Resize_100 [Resize] inputs: [413 -> (-1, 64, 40, 40)], [430 -> ()], [431 -> ()], [429 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Resize_100 for ONNX node: Resize_100 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 432 for ONNX tensor: 432 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Resize_100 [Resize] outputs: [432 -> (-1, -1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Add_101 [Add] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 384 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 432 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Add_101 [Add] inputs: [384 -> (-1, 64, 80, 80)], [432 -> (-1, -1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Add_101 for ONNX node: Add_101 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 433 for ONNX tensor: 433 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Add_101 [Add] outputs: [433 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_102 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 433 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 685 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 686 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_102 [Conv] inputs: [433 -> (-1, 64, 80, 80)], [685 -> (64, 64, 3, 3)], [686 -> (64)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_102 for ONNX node: Conv_102 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 684 for ONNX tensor: 684 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_102 [Conv] outputs: [684 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_103 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 684 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_103 [LeakyRelu] inputs: [684 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_103 for ONNX node: LeakyRelu_103 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 436 for ONNX tensor: 436 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_103 [LeakyRelu] outputs: [436 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_104 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 436 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 688 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 689 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_104 [Conv] inputs: [436 -> (-1, 64, 80, 80)], [688 -> (32, 64, 3, 3)], [689 -> (32)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_104 for ONNX node: Conv_104 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 32, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 687 for ONNX tensor: 687 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_104 [Conv] outputs: [687 -> (-1, 32, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_105 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 436 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 691 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 692 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_105 [Conv] inputs: [436 -> (-1, 64, 80, 80)], [691 -> (16, 64, 3, 3)], [692 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_105 for ONNX node: Conv_105 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 690 for ONNX tensor: 690 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_105 [Conv] outputs: [690 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_106 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 690 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_106 [LeakyRelu] inputs: [690 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_106 for ONNX node: LeakyRelu_106 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 441 for ONNX tensor: 441 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_106 [LeakyRelu] outputs: [441 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_107 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 441 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 694 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 695 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_107 [Conv] inputs: [441 -> (-1, 16, 80, 80)], [694 -> (16, 16, 3, 3)], [695 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_107 for ONNX node: Conv_107 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 693 for ONNX tensor: 693 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_107 [Conv] outputs: [693 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_108 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 441 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 697 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 698 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_108 [Conv] inputs: [441 -> (-1, 16, 80, 80)], [697 -> (16, 16, 3, 3)], [698 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_108 for ONNX node: Conv_108 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 696 for ONNX tensor: 696 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_108 [Conv] outputs: [696 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_109 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 696 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_109 [LeakyRelu] inputs: [696 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_109 for ONNX node: LeakyRelu_109 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 446 for ONNX tensor: 446 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_109 [LeakyRelu] outputs: [446 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_110 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 446 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 700 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 701 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_110 [Conv] inputs: [446 -> (-1, 16, 80, 80)], [700 -> (16, 16, 3, 3)], [701 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_110 for ONNX node: Conv_110 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 699 for ONNX tensor: 699 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_110 [Conv] outputs: [699 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_111 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 687 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 693 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 699 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_111 [Concat] inputs: [687 -> (-1, 32, 80, 80)], [693 -> (-1, 16, 80, 80)], [699 -> (-1, 16, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_111 for ONNX node: Concat_111 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 449 for ONNX tensor: 449 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_111 [Concat] outputs: [449 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_112 [Relu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 449 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Relu_112 [Relu] inputs: [449 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Relu_112 for ONNX node: Relu_112 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 450 for ONNX tensor: 450 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Relu_112 [Relu] outputs: [450 -> (-1, 64, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_113 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 413 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 703 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 704 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_113 [Conv] inputs: [413 -> (-1, 64, 40, 40)], [703 -> (32, 64, 3, 3)], [704 -> (32)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_113 for ONNX node: Conv_113 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 32, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 702 for ONNX tensor: 702 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_113 [Conv] outputs: [702 -> (-1, 32, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_114 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 413 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 706 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 707 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_114 [Conv] inputs: [413 -> (-1, 64, 40, 40)], [706 -> (16, 64, 3, 3)], [707 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_114 for ONNX node: Conv_114 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 705 for ONNX tensor: 705 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_114 [Conv] outputs: [705 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_115 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 705 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_115 [LeakyRelu] inputs: [705 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_115 for ONNX node: LeakyRelu_115 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 455 for ONNX tensor: 455 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_115 [LeakyRelu] outputs: [455 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_116 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 455 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 709 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 710 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_116 [Conv] inputs: [455 -> (-1, 16, 40, 40)], [709 -> (16, 16, 3, 3)], [710 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_116 for ONNX node: Conv_116 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 708 for ONNX tensor: 708 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_116 [Conv] outputs: [708 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_117 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 455 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 712 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 713 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_117 [Conv] inputs: [455 -> (-1, 16, 40, 40)], [712 -> (16, 16, 3, 3)], [713 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_117 for ONNX node: Conv_117 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 711 for ONNX tensor: 711 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_117 [Conv] outputs: [711 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_118 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 711 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_118 [LeakyRelu] inputs: [711 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_118 for ONNX node: LeakyRelu_118 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 460 for ONNX tensor: 460 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_118 [LeakyRelu] outputs: [460 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_119 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 460 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 715 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 716 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_119 [Conv] inputs: [460 -> (-1, 16, 40, 40)], [715 -> (16, 16, 3, 3)], [716 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_119 for ONNX node: Conv_119 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 714 for ONNX tensor: 714 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_119 [Conv] outputs: [714 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_120 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 702 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 708 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 714 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_120 [Concat] inputs: [702 -> (-1, 32, 40, 40)], [708 -> (-1, 16, 40, 40)], [714 -> (-1, 16, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_120 for ONNX node: Concat_120 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 463 for ONNX tensor: 463 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_120 [Concat] outputs: [463 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_121 [Relu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 463 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Relu_121 [Relu] inputs: [463 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Relu_121 for ONNX node: Relu_121 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 464 for ONNX tensor: 464 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Relu_121 [Relu] outputs: [464 -> (-1, 64, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_122 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 390 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 718 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 719 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_122 [Conv] inputs: [390 -> (-1, 64, 20, 20)], [718 -> (32, 64, 3, 3)], [719 -> (32)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_122 for ONNX node: Conv_122 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 32, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 717 for ONNX tensor: 717 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_122 [Conv] outputs: [717 -> (-1, 32, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_123 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 390 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 721 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 722 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_123 [Conv] inputs: [390 -> (-1, 64, 20, 20)], [721 -> (16, 64, 3, 3)], [722 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_123 for ONNX node: Conv_123 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 720 for ONNX tensor: 720 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_123 [Conv] outputs: [720 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_124 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 720 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_124 [LeakyRelu] inputs: [720 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_124 for ONNX node: LeakyRelu_124 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 469 for ONNX tensor: 469 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_124 [LeakyRelu] outputs: [469 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_125 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 469 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 724 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 725 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_125 [Conv] inputs: [469 -> (-1, 16, 20, 20)], [724 -> (16, 16, 3, 3)], [725 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_125 for ONNX node: Conv_125 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 723 for ONNX tensor: 723 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_125 [Conv] outputs: [723 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_126 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 469 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 727 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 728 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_126 [Conv] inputs: [469 -> (-1, 16, 20, 20)], [727 -> (16, 16, 3, 3)], [728 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_126 for ONNX node: Conv_126 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 726 for ONNX tensor: 726 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_126 [Conv] outputs: [726 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: LeakyRelu_127 [LeakyRelu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 726 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: LeakyRelu_127 [LeakyRelu] inputs: [726 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: LeakyRelu_127 for ONNX node: LeakyRelu_127 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 474 for ONNX tensor: 474 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: LeakyRelu_127 [LeakyRelu] outputs: [474 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_128 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 474 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 730 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 731 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_128 [Conv] inputs: [474 -> (-1, 16, 20, 20)], [730 -> (16, 16, 3, 3)], [731 -> (16)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 16, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_128 for ONNX node: Conv_128 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 16 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 16, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 729 for ONNX tensor: 729 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_128 [Conv] outputs: [729 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_129 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 717 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 723 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 729 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_129 [Concat] inputs: [717 -> (-1, 32, 20, 20)], [723 -> (-1, 16, 20, 20)], [729 -> (-1, 16, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_129 for ONNX node: Concat_129 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 477 for ONNX tensor: 477 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_129 [Concat] outputs: [477 -> (-1, 64, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Relu_130 [Relu] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 477 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Relu_130 [Relu] inputs: [477 -> (-1, 64, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Relu_130 for ONNX node: Relu_130 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 478 for ONNX tensor: 478 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Relu_130 [Relu] outputs: [478 -> (-1, 64, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_131 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 450 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 289 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 290 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_131 [Conv] inputs: [450 -> (-1, 64, 80, 80)], [289 -> (8, 64, 1, 1)], [290 -> (8)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_131 for ONNX node: Conv_131 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 8 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 8, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 479 for ONNX tensor: 479 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_131 [Conv] outputs: [479 -> (-1, 8, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_132 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 479 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_132 [Transpose] inputs: [479 -> (-1, 8, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_132 for ONNX node: Transpose_132 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 480 for ONNX tensor: 480 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_132 [Transpose] outputs: [480 -> (-1, 80, 80, 8)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_133 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 480 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_133 [Shape] inputs: [480 -> (-1, 80, 80, 8)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_133 for ONNX node: Shape_133 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 481 for ONNX tensor: 481 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_133 [Shape] outputs: [481 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_134 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_134 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_134 [Constant] outputs: [482 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_135 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 481 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 482 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_135 [Gather] inputs: [481 -> (4)], [482 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 482 for ONNX initializer: 482 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_135 for ONNX node: Gather_135 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 483 for ONNX tensor: 483 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_135 [Gather] outputs: [483 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_136 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 483 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_136 [Unsqueeze] inputs: [483 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_136 for ONNX node: Unsqueeze_136 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 486 for ONNX tensor: 486 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_136 [Unsqueeze] outputs: [486 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_137 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 486 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 732 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 733 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_137 [Concat] inputs: [486 -> (1)], [732 -> (1)], [733 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 732 for ONNX initializer: 732 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 733 for ONNX initializer: 733 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_137 for ONNX node: Concat_137 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 489 for ONNX tensor: 489 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_137 [Concat] outputs: [489 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_138 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 480 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 489 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_138 [Reshape] inputs: [480 -> (-1, 80, 80, 8)], [489 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_138 for ONNX node: Reshape_138 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 490 for ONNX tensor: 490 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_138 [Reshape] outputs: [490 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_139 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 464 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 291 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 292 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_139 [Conv] inputs: [464 -> (-1, 64, 40, 40)], [291 -> (8, 64, 1, 1)], [292 -> (8)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_139 for ONNX node: Conv_139 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 8 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 8, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 491 for ONNX tensor: 491 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_139 [Conv] outputs: [491 -> (-1, 8, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_140 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 491 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_140 [Transpose] inputs: [491 -> (-1, 8, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_140 for ONNX node: Transpose_140 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 492 for ONNX tensor: 492 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_140 [Transpose] outputs: [492 -> (-1, 40, 40, 8)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_141 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 492 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_141 [Shape] inputs: [492 -> (-1, 40, 40, 8)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_141 for ONNX node: Shape_141 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 493 for ONNX tensor: 493 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_141 [Shape] outputs: [493 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_142 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_142 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_142 [Constant] outputs: [494 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_143 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 493 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 494 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_143 [Gather] inputs: [493 -> (4)], [494 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 494 for ONNX initializer: 494 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_143 for ONNX node: Gather_143 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 495 for ONNX tensor: 495 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_143 [Gather] outputs: [495 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_144 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 495 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_144 [Unsqueeze] inputs: [495 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_144 for ONNX node: Unsqueeze_144 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 498 for ONNX tensor: 498 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_144 [Unsqueeze] outputs: [498 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_145 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 498 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 734 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 735 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_145 [Concat] inputs: [498 -> (1)], [734 -> (1)], [735 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 734 for ONNX initializer: 734 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 735 for ONNX initializer: 735 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_145 for ONNX node: Concat_145 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 501 for ONNX tensor: 501 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_145 [Concat] outputs: [501 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_146 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 492 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 501 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_146 [Reshape] inputs: [492 -> (-1, 40, 40, 8)], [501 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_146 for ONNX node: Reshape_146 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 502 for ONNX tensor: 502 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_146 [Reshape] outputs: [502 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_147 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 478 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 293 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 294 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_147 [Conv] inputs: [478 -> (-1, 64, 20, 20)], [293 -> (8, 64, 1, 1)], [294 -> (8)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_147 for ONNX node: Conv_147 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 8 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 8, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 503 for ONNX tensor: 503 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_147 [Conv] outputs: [503 -> (-1, 8, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_148 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 503 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_148 [Transpose] inputs: [503 -> (-1, 8, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_148 for ONNX node: Transpose_148 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 504 for ONNX tensor: 504 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_148 [Transpose] outputs: [504 -> (-1, 20, 20, 8)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_149 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 504 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_149 [Shape] inputs: [504 -> (-1, 20, 20, 8)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_149 for ONNX node: Shape_149 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 505 for ONNX tensor: 505 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_149 [Shape] outputs: [505 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_150 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_150 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_150 [Constant] outputs: [506 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_151 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 505 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 506 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_151 [Gather] inputs: [505 -> (4)], [506 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 506 for ONNX initializer: 506 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_151 for ONNX node: Gather_151 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 507 for ONNX tensor: 507 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_151 [Gather] outputs: [507 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_152 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 507 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_152 [Unsqueeze] inputs: [507 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_152 for ONNX node: Unsqueeze_152 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 510 for ONNX tensor: 510 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_152 [Unsqueeze] outputs: [510 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_153 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 510 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 736 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 737 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_153 [Concat] inputs: [510 -> (1)], [736 -> (1)], [737 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 736 for ONNX initializer: 736 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 737 for ONNX initializer: 737 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_153 for ONNX node: Concat_153 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 513 for ONNX tensor: 513 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_153 [Concat] outputs: [513 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_154 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 504 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 513 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_154 [Reshape] inputs: [504 -> (-1, 20, 20, 8)], [513 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_154 for ONNX node: Reshape_154 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 514 for ONNX tensor: 514 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_154 [Reshape] outputs: [514 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_155 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 490 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 502 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 514 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_155 [Concat] inputs: [490 -> (-1, -1, -1)], [502 -> (-1, -1, -1)], [514 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_155 for ONNX node: Concat_155 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: output_0 for ONNX tensor: output [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_155 [Concat] outputs: [output -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_156 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 450 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 283 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 284 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_156 [Conv] inputs: [450 -> (-1, 64, 80, 80)], [283 -> (4, 64, 1, 1)], [284 -> (4)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_156 for ONNX node: Conv_156 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 4 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 4, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 516 for ONNX tensor: 516 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_156 [Conv] outputs: [516 -> (-1, 4, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_157 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 516 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_157 [Transpose] inputs: [516 -> (-1, 4, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_157 for ONNX node: Transpose_157 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 517 for ONNX tensor: 517 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_157 [Transpose] outputs: [517 -> (-1, 80, 80, 4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_158 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 517 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_158 [Shape] inputs: [517 -> (-1, 80, 80, 4)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_158 for ONNX node: Shape_158 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 518 for ONNX tensor: 518 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_158 [Shape] outputs: [518 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_159 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_159 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_159 [Constant] outputs: [519 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_160 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 518 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 519 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_160 [Gather] inputs: [518 -> (4)], [519 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 519 for ONNX initializer: 519 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_160 for ONNX node: Gather_160 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 520 for ONNX tensor: 520 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_160 [Gather] outputs: [520 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_161 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 520 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_161 [Unsqueeze] inputs: [520 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_161 for ONNX node: Unsqueeze_161 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 523 for ONNX tensor: 523 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_161 [Unsqueeze] outputs: [523 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_162 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 523 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 738 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 739 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_162 [Concat] inputs: [523 -> (1)], [738 -> (1)], [739 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 738 for ONNX initializer: 738 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 739 for ONNX initializer: 739 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_162 for ONNX node: Concat_162 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 526 for ONNX tensor: 526 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_162 [Concat] outputs: [526 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_163 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 517 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 526 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_163 [Reshape] inputs: [517 -> (-1, 80, 80, 4)], [526 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_163 for ONNX node: Reshape_163 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 527 for ONNX tensor: 527 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_163 [Reshape] outputs: [527 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_164 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 464 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 285 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 286 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_164 [Conv] inputs: [464 -> (-1, 64, 40, 40)], [285 -> (4, 64, 1, 1)], [286 -> (4)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_164 for ONNX node: Conv_164 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 4 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 4, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 528 for ONNX tensor: 528 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_164 [Conv] outputs: [528 -> (-1, 4, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_165 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 528 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_165 [Transpose] inputs: [528 -> (-1, 4, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_165 for ONNX node: Transpose_165 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 529 for ONNX tensor: 529 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_165 [Transpose] outputs: [529 -> (-1, 40, 40, 4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_166 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 529 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_166 [Shape] inputs: [529 -> (-1, 40, 40, 4)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_166 for ONNX node: Shape_166 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 530 for ONNX tensor: 530 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_166 [Shape] outputs: [530 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_167 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_167 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_167 [Constant] outputs: [531 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_168 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 530 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 531 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_168 [Gather] inputs: [530 -> (4)], [531 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 531 for ONNX initializer: 531 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_168 for ONNX node: Gather_168 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 532 for ONNX tensor: 532 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_168 [Gather] outputs: [532 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_169 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 532 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_169 [Unsqueeze] inputs: [532 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_169 for ONNX node: Unsqueeze_169 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 535 for ONNX tensor: 535 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_169 [Unsqueeze] outputs: [535 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_170 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 535 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 740 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 741 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_170 [Concat] inputs: [535 -> (1)], [740 -> (1)], [741 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 740 for ONNX initializer: 740 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 741 for ONNX initializer: 741 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_170 for ONNX node: Concat_170 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 538 for ONNX tensor: 538 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_170 [Concat] outputs: [538 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_171 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 529 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 538 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_171 [Reshape] inputs: [529 -> (-1, 40, 40, 4)], [538 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_171 for ONNX node: Reshape_171 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 539 for ONNX tensor: 539 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_171 [Reshape] outputs: [539 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_172 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 478 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 287 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 288 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_172 [Conv] inputs: [478 -> (-1, 64, 20, 20)], [287 -> (4, 64, 1, 1)], [288 -> (4)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_172 for ONNX node: Conv_172 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 4 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 4, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 540 for ONNX tensor: 540 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_172 [Conv] outputs: [540 -> (-1, 4, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_173 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 540 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_173 [Transpose] inputs: [540 -> (-1, 4, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_173 for ONNX node: Transpose_173 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 541 for ONNX tensor: 541 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_173 [Transpose] outputs: [541 -> (-1, 20, 20, 4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_174 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 541 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_174 [Shape] inputs: [541 -> (-1, 20, 20, 4)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_174 for ONNX node: Shape_174 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 542 for ONNX tensor: 542 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_174 [Shape] outputs: [542 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_175 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_175 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_175 [Constant] outputs: [543 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_176 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 542 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 543 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_176 [Gather] inputs: [542 -> (4)], [543 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 543 for ONNX initializer: 543 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_176 for ONNX node: Gather_176 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 544 for ONNX tensor: 544 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_176 [Gather] outputs: [544 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_177 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 544 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_177 [Unsqueeze] inputs: [544 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_177 for ONNX node: Unsqueeze_177 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 547 for ONNX tensor: 547 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_177 [Unsqueeze] outputs: [547 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_178 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 547 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 742 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 743 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_178 [Concat] inputs: [547 -> (1)], [742 -> (1)], [743 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 742 for ONNX initializer: 742 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 743 for ONNX initializer: 743 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_178 for ONNX node: Concat_178 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 550 for ONNX tensor: 550 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_178 [Concat] outputs: [550 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_179 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 541 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 550 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_179 [Reshape] inputs: [541 -> (-1, 20, 20, 4)], [550 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_179 for ONNX node: Reshape_179 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 551 for ONNX tensor: 551 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_179 [Reshape] outputs: [551 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_180 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 527 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 539 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 551 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_180 [Concat] inputs: [527 -> (-1, -1, -1)], [539 -> (-1, -1, -1)], [551 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_180 for ONNX node: Concat_180 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 552 for ONNX tensor: 552 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_180 [Concat] outputs: [552 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_181 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 450 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 295 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 296 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_181 [Conv] inputs: [450 -> (-1, 64, 80, 80)], [295 -> (20, 64, 1, 1)], [296 -> (20)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_181 for ONNX node: Conv_181 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 20 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 20, 80, 80) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 553 for ONNX tensor: 553 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_181 [Conv] outputs: [553 -> (-1, 20, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_182 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 553 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_182 [Transpose] inputs: [553 -> (-1, 20, 80, 80)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_182 for ONNX node: Transpose_182 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 554 for ONNX tensor: 554 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_182 [Transpose] outputs: [554 -> (-1, 80, 80, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_183 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 554 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_183 [Shape] inputs: [554 -> (-1, 80, 80, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_183 for ONNX node: Shape_183 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 555 for ONNX tensor: 555 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_183 [Shape] outputs: [555 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_184 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_184 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_184 [Constant] outputs: [556 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_185 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 555 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 556 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_185 [Gather] inputs: [555 -> (4)], [556 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 556 for ONNX initializer: 556 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_185 for ONNX node: Gather_185 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 557 for ONNX tensor: 557 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_185 [Gather] outputs: [557 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_186 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 557 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_186 [Unsqueeze] inputs: [557 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_186 for ONNX node: Unsqueeze_186 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 560 for ONNX tensor: 560 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_186 [Unsqueeze] outputs: [560 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_187 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 560 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 744 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 745 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_187 [Concat] inputs: [560 -> (1)], [744 -> (1)], [745 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 744 for ONNX initializer: 744 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 745 for ONNX initializer: 745 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_187 for ONNX node: Concat_187 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 563 for ONNX tensor: 563 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_187 [Concat] outputs: [563 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_188 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 554 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 563 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_188 [Reshape] inputs: [554 -> (-1, 80, 80, 20)], [563 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_188 for ONNX node: Reshape_188 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 564 for ONNX tensor: 564 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_188 [Reshape] outputs: [564 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_189 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 464 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 297 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 298 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_189 [Conv] inputs: [464 -> (-1, 64, 40, 40)], [297 -> (20, 64, 1, 1)], [298 -> (20)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_189 for ONNX node: Conv_189 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 20 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 20, 40, 40) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 565 for ONNX tensor: 565 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_189 [Conv] outputs: [565 -> (-1, 20, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_190 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 565 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_190 [Transpose] inputs: [565 -> (-1, 20, 40, 40)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_190 for ONNX node: Transpose_190 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 566 for ONNX tensor: 566 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_190 [Transpose] outputs: [566 -> (-1, 40, 40, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_191 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 566 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_191 [Shape] inputs: [566 -> (-1, 40, 40, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_191 for ONNX node: Shape_191 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 567 for ONNX tensor: 567 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_191 [Shape] outputs: [567 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_192 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_192 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_192 [Constant] outputs: [568 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_193 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 567 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 568 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_193 [Gather] inputs: [567 -> (4)], [568 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 568 for ONNX initializer: 568 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_193 for ONNX node: Gather_193 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 569 for ONNX tensor: 569 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_193 [Gather] outputs: [569 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_194 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 569 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_194 [Unsqueeze] inputs: [569 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_194 for ONNX node: Unsqueeze_194 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 572 for ONNX tensor: 572 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_194 [Unsqueeze] outputs: [572 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_195 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 572 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 746 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 747 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_195 [Concat] inputs: [572 -> (1)], [746 -> (1)], [747 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 746 for ONNX initializer: 746 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 747 for ONNX initializer: 747 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_195 for ONNX node: Concat_195 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 575 for ONNX tensor: 575 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_195 [Concat] outputs: [575 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_196 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 566 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 575 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_196 [Reshape] inputs: [566 -> (-1, 40, 40, 20)], [575 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_196 for ONNX node: Reshape_196 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 576 for ONNX tensor: 576 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_196 [Reshape] outputs: [576 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Conv_197 [Conv] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 478 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 299 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 300 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Conv_197 [Conv] inputs: [478 -> (-1, 64, 20, 20)], [299 -> (20, 64, 1, 1)], [300 -> (20)], [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:448: Convolution input dimensions: (-1, 64, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Conv_197 for ONNX node: Conv_197 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:537: Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 20 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:538: Convolution output dimensions: (-1, 20, 20, 20) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 577 for ONNX tensor: 577 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Conv_197 [Conv] outputs: [577 -> (-1, 20, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Transpose_198 [Transpose] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 577 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Transpose_198 [Transpose] inputs: [577 -> (-1, 20, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Transpose_198 for ONNX node: Transpose_198 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 578 for ONNX tensor: 578 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Transpose_198 [Transpose] outputs: [578 -> (-1, 20, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Shape_199 [Shape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 578 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Shape_199 [Shape] inputs: [578 -> (-1, 20, 20, 20)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Shape_199 for ONNX node: Shape_199 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 579 for ONNX tensor: 579 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Shape_199 [Shape] outputs: [579 -> (4)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Constant_200 [Constant] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Constant_200 [Constant] inputs: [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Constant_200 [Constant] outputs: [580 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Gather_201 [Gather] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 579 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 580 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Gather_201 [Gather] inputs: [579 -> (4)], [580 -> ()], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 580 for ONNX initializer: 580 [07/29/2021-16:41:58] [V] [TRT] builtin_op_importers.cpp:996: Using Gather axis: 0 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Gather_201 for ONNX node: Gather_201 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 581 for ONNX tensor: 581 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Gather_201 [Gather] outputs: [581 -> ()], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Unsqueeze_202 [Unsqueeze] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 581 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Unsqueeze_202 [Unsqueeze] inputs: [581 -> ()], [07/29/2021-16:41:58] [V] [TRT] onnx2trt_utils.cpp:1815: Original shape: (), unsqueezing to: (1,) [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Unsqueeze_202 for ONNX node: Unsqueeze_202 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 584 for ONNX tensor: 584 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Unsqueeze_202 [Unsqueeze] outputs: [584 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_203 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 584 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 748 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 749 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_203 [Concat] inputs: [584 -> (1)], [748 -> (1)], [749 -> (1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 748 for ONNX initializer: 748 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:150: Registering constant layer: 749 for ONNX initializer: 749 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_203 for ONNX node: Concat_203 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 587 for ONNX tensor: 587 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_203 [Concat] outputs: [587 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Reshape_204 [Reshape] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 578 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 587 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Reshape_204 [Reshape] inputs: [578 -> (-1, 20, 20, 20)], [587 -> (3)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Reshape_204 for ONNX node: Reshape_204 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 588 for ONNX tensor: 588 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Reshape_204 [Reshape] outputs: [588 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Concat_205 [Concat] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 564 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 576 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 588 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Concat_205 [Concat] inputs: [564 -> (-1, -1, -1)], [576 -> (-1, -1, -1)], [588 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Concat_205 for ONNX node: Concat_205 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 589_1 for ONNX tensor: 589 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Concat_205 [Concat] outputs: [589 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:103: Parsing node: Softmax_206 [Softmax] [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:119: Searching for input: 552 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:125: Softmax_206 [Softmax] inputs: [552 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:154: Registering layer: Softmax_206 for ONNX node: Softmax_206 [07/29/2021-16:41:58] [V] [TRT] ImporterContext.hpp:120: Registering tensor: 590_2 for ONNX tensor: 590 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:179: Softmax_206 [Softmax] outputs: [590 -> (-1, -1, -1)], [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:510: Marking output_0 as output: output [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:510: Marking 590_2 as output: 590 [07/29/2021-16:41:58] [V] [TRT] ModelImporter.cpp:510: Marking 589_1 as output: 589 ----- Parsing of ONNX model models/weights/Retinaface_m25_dynamic_batch.onnx is Done ---- [07/29/2021-16:41:58] [V] [TRT] Applying generic optimizations to the graph for inference. [07/29/2021-16:41:58] [V] [TRT] Original: 128 layers [07/29/2021-16:41:58] [V] [TRT] After dead-layer removal: 128 layers [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_148 with Reshape_154 [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_173 with Reshape_179 [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_198 with Reshape_204 [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_140 with Reshape_146 [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_165 with Reshape_171 [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_190 with Reshape_196 [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_132 with Reshape_138 [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_157 with Reshape_163 [07/29/2021-16:41:58] [V] [TRT] BinaryFusion: Fusing Transpose_182 with Reshape_188 [07/29/2021-16:41:58] [V] [TRT] After Myelin optimization: 119 layers [07/29/2021-16:41:58] [V] [TRT] After scale fusion: 119 layers [07/29/2021-16:41:58] [V] [TRT] BinaryFusionBase: Fusing LeakyRelu_57 with Add_79 [07/29/2021-16:41:58] [V] [TRT] BinaryFusionBase: Fusing LeakyRelu_55 with Add_101 [07/29/2021-16:41:58] [V] [TRT] After vertical fusions: 117 layers [07/29/2021-16:41:58] [V] [TRT] After dupe layer removal: 117 layers [07/29/2021-16:41:58] [V] [TRT] After final dead-layer removal: 117 layers [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_122 || Conv_123 [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_125 || Conv_126 [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_113 || Conv_114 [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_116 || Conv_117 [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_147 || Conv_172 || Conv_197 [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_104 || Conv_105 [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_107 || Conv_108 [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_139 || Conv_164 || Conv_189 [07/29/2021-16:41:58] [V] [TRT] Merging layers: Conv_131 || Conv_156 || Conv_181 [07/29/2021-16:41:58] [V] [TRT] After tensor merging: 105 layers [07/29/2021-16:41:58] [V] [TRT] Eliminating concatenation Concat_129 [07/29/2021-16:41:58] [V] [TRT] Generating copy for Conv_122 || Conv_123 to 477 [07/29/2021-16:41:58] [V] [TRT] Generating copy for Conv_125 || Conv_126 to 477 [07/29/2021-16:41:58] [V] [TRT] Retargeting 729 to 477 [07/29/2021-16:41:58] [V] [TRT] Eliminating concatenation Concat_120 [07/29/2021-16:41:58] [V] [TRT] Generating copy for Conv_113 || Conv_114 to 463 [07/29/2021-16:41:58] [V] [TRT] Generating copy for Conv_116 || Conv_117 to 463 [07/29/2021-16:41:58] [V] [TRT] Retargeting 714 to 463 [07/29/2021-16:41:58] [V] [TRT] Eliminating concatenation Concat_111 [07/29/2021-16:41:58] [V] [TRT] Generating copy for Conv_104 || Conv_105 to 449 [07/29/2021-16:41:58] [V] [TRT] Generating copy for Conv_107 || Conv_108 to 449 [07/29/2021-16:41:58] [V] [TRT] Retargeting 699 to 449 [07/29/2021-16:41:58] [V] [TRT] Eliminating concatenation Concat_155 [07/29/2021-16:41:58] [V] [TRT] Generating copy for 490 to output [07/29/2021-16:41:58] [V] [TRT] Generating copy for 502 to output [07/29/2021-16:41:58] [V] [TRT] Generating copy for 514 to output [07/29/2021-16:41:58] [V] [TRT] Eliminating concatenation Concat_205 [07/29/2021-16:41:58] [V] [TRT] Generating copy for 564 to 589 [07/29/2021-16:41:58] [V] [TRT] Generating copy for 576 to 589 [07/29/2021-16:41:58] [V] [TRT] Generating copy for 588 to 589 [07/29/2021-16:41:58] [V] [TRT] Eliminating concatenation Concat_180 [07/29/2021-16:41:58] [V] [TRT] Generating copy for 527 to 552 [07/29/2021-16:41:58] [V] [TRT] Generating copy for 539 to 552 [07/29/2021-16:41:58] [V] [TRT] Generating copy for 551 to 552 [07/29/2021-16:41:58] [V] [TRT] After concat removal: 114 layers [07/29/2021-16:41:58] [V] [TRT] Graph construction and optimization completed in 0.0653664 seconds. [07/29/2021-16:41:59] [07/29/2021-16:41:59] [V] [TRT] Constructing optimization profile number 0 [1/1]. [07/29/2021-16:41:59] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:41:59] [V] [TRT] Tactic: 1002 time 1.67189 [07/29/2021-16:41:59] [V] [TRT] Tactic: 0 time 0.262616 [07/29/2021-16:41:59] [V] [TRT] Fastest Tactic: 0 Time: 0.262616 [07/29/2021-16:41:59] [V] [TRT] *************** Autotuning format combination: Float(1,640,409600,1228800) -> Float(1,320,102400,819200) *************** [07/29/2021-16:41:59] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:41:59] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:41:59] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:41:59] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:41:59] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:41:59] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:41:59] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:41:59] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:00] [V] [TRT] --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [07/29/2021-16:42:00] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:00] [V] [TRT] --------------- Timing Runner: Conv_0 (CaskConvolution) [07/29/2021-16:42:00] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:00] [V] [TRT] Tactic: 1825138533642645384 time 1.71763 [07/29/2021-16:42:00] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:00] [V] [TRT] Tactic: 2842488832350522458 time 0.955608 [07/29/2021-16:42:00] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:00] [V] [TRT] Tactic: 3915320020053085238 time 1.71854 [07/29/2021-16:42:00] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:00] [V] [TRT] Tactic: 6448355332020552203 time 2.50147 [07/29/2021-16:42:00] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:00] [V] [TRT] Tactic: 6808617066150061604 time 0.872752 [07/29/2021-16:42:00] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:00] [V] [TRT] Tactic: -8060443123034038864 time 0.882652 [07/29/2021-16:42:00] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:00] [V] [TRT] Tactic: -4420849921117327522 time 0.551196 [07/29/2021-16:42:00] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:00] [V] [TRT] Tactic: -3946921629105938337 time 0.466072 [07/29/2021-16:42:00] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.466072 [07/29/2021-16:42:00] [V] [TRT] --------------- Timing Runner: Conv_0 (CudaConvolution) [07/29/2021-16:42:00] [V] [TRT] Tactic: 0 time 0.55552 [07/29/2021-16:42:00] [V] [TRT] Tactic: 1 time 0.74908 [07/29/2021-16:42:00] [V] [TRT] Tactic: 2 skipped. Scratch requested: 88473600, available: 16777216 [07/29/2021-16:42:01] [V] [TRT] Tactic: 5 time 13.2198 [07/29/2021-16:42:01] [V] [TRT] Tactic: 56 time 0.36474 [07/29/2021-16:42:01] [V] [TRT] Tactic: 57 time 0.478908 [07/29/2021-16:42:01] [V] [TRT] Tactic: 58 skipped. Scratch requested: 88473600, available: 16777216 [07/29/2021-16:42:01] [V] [TRT] Tactic: 61 time 10.8716 [07/29/2021-16:42:01] [I] [TRT] Some tactics do not have sufficient workspace memory to run. Increasing workspace size may increase performance, please check verbose output. [07/29/2021-16:42:01] [V] [TRT] Fastest Tactic: 56 Time: 0.36474 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [07/29/2021-16:42:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: Conv_0 (CublasConvolution) [07/29/2021-16:42:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 56 [07/29/2021-16:42:01] [V] [TRT] [07/29/2021-16:42:01] [V] [TRT] *************** Autotuning format combination: Float(3,1920,1,1228800) -> Float(8,2560,1,819200) *************** [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: Conv_0 (FusedConvActConvolution) [07/29/2021-16:42:01] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: Conv_0 (CaskConvolution) [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] Tactic: 861694390046228376 time 1.0864 [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] Tactic: 5821621277990374316 time 1.09387 [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] Tactic: -3853827649136781465 time 1.14385 [07/29/2021-16:42:01] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 1.0864 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: Conv_0 (CudaConvolution) [07/29/2021-16:42:01] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: Conv_0 (CudaDepthwiseConvolution) [07/29/2021-16:42:01] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: Conv_0 (CublasConvolution) [07/29/2021-16:42:01] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:01] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] Conv_0 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:01] [V] [TRT] Tactic: 1002 time 0.19208 [07/29/2021-16:42:01] [V] [TRT] Tactic: 0 time 0.120336 [07/29/2021-16:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.120336 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:01] [V] [TRT] Tactic: 1002 time 0.3675 [07/29/2021-16:42:01] [V] [TRT] Tactic: 0 time 9.69911 [07/29/2021-16:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.3675 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:01] [V] [TRT] Tactic: 1002 time 0.186088 [07/29/2021-16:42:01] [V] [TRT] Tactic: 0 time 0.133896 [07/29/2021-16:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.133896 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:01] [V] [TRT] Tactic: 1002 time 0.324152 [07/29/2021-16:42:01] [V] [TRT] Tactic: 0 time 9.77338 [07/29/2021-16:42:01] [V] [TRT] Fastest Tactic: 1002 Time: 0.324152 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:01] [V] [TRT] Tactic: 1002 time 1.00937 [07/29/2021-16:42:01] [V] [TRT] Tactic: 0 time 0.96732 [07/29/2021-16:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.96732 [07/29/2021-16:42:01] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:01] [V] [TRT] Tactic: 1002 time 0.268824 [07/29/2021-16:42:01] [V] [TRT] Tactic: 0 time 0.166064 [07/29/2021-16:42:01] [V] [TRT] Fastest Tactic: 0 Time: 0.166064 [07/29/2021-16:42:01] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400,819200) -> Float(1,320,102400,819200) *************** [07/29/2021-16:42:04] [V] [TRT] --------------- Timing Runner: LeakyRelu_1 (PointWise) [07/29/2021-16:42:04] [V] [TRT] Tactic: 128 time 0.242408 [07/29/2021-16:42:04] [V] [TRT] Tactic: 256 time 0.248972 [07/29/2021-16:42:04] [V] [TRT] Tactic: 512 time 0.272752 [07/29/2021-16:42:04] [V] [TRT] Tactic: -32 time 0.366824 [07/29/2021-16:42:04] [V] [TRT] Tactic: -64 time 0.256688 [07/29/2021-16:42:04] [V] [TRT] Tactic: -128 time 0.253772 [07/29/2021-16:42:04] [V] [TRT] Fastest Tactic: 128 Time: 0.242408 [07/29/2021-16:42:04] [V] [TRT] --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [07/29/2021-16:42:04] [V] [TRT] Tactic: 0 time 0.152876 [07/29/2021-16:42:04] [V] [TRT] Tactic: 1 time 0.12412 [07/29/2021-16:42:04] [V] [TRT] Tactic: 2 time 0.112284 [07/29/2021-16:42:04] [V] [TRT] Tactic: 3 time 0.128364 [07/29/2021-16:42:04] [V] [TRT] Tactic: 4 time 0.115908 [07/29/2021-16:42:04] [V] [TRT] Tactic: 5 time 0.112948 [07/29/2021-16:42:04] [V] [TRT] Tactic: 6 time 0.137712 [07/29/2021-16:42:04] [V] [TRT] Tactic: 7 time 0.120728 [07/29/2021-16:42:04] [V] [TRT] Tactic: 8 time 0.117184 [07/29/2021-16:42:04] [V] [TRT] Tactic: 9 time 0.11942 [07/29/2021-16:42:04] [V] [TRT] Tactic: 28 time 0.149984 [07/29/2021-16:42:04] [V] [TRT] Fastest Tactic: 2 Time: 0.112284 [07/29/2021-16:42:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [07/29/2021-16:42:04] [V] [TRT] [07/29/2021-16:42:04] [V] [TRT] *************** Autotuning format combination: Float(8,2560,1,819200) -> Float(8,2560,1,819200) *************** [07/29/2021-16:42:04] [V] [TRT] --------------- Timing Runner: LeakyRelu_1 (PointWise) [07/29/2021-16:42:04] [V] [TRT] Tactic: 128 time 0.242708 [07/29/2021-16:42:04] [V] [TRT] Tactic: 256 time 0.248848 [07/29/2021-16:42:04] [V] [TRT] Tactic: 512 time 0.27332 [07/29/2021-16:42:04] [V] [TRT] Tactic: -32 time 0.36732 [07/29/2021-16:42:04] [V] [TRT] Tactic: -64 time 0.257892 [07/29/2021-16:42:04] [V] [TRT] Tactic: -128 time 0.253668 [07/29/2021-16:42:04] [V] [TRT] Fastest Tactic: 128 Time: 0.242708 [07/29/2021-16:42:04] [V] [TRT] --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [07/29/2021-16:42:04] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:04] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:04] [V] [TRT] [07/29/2021-16:42:04] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400:32,102400) -> Float(1,320,102400:32,102400) *************** [07/29/2021-16:42:05] [V] [TRT] --------------- Timing Runner: LeakyRelu_1 (PointWise) [07/29/2021-16:42:05] [V] [TRT] Tactic: 128 time 0.943556 [07/29/2021-16:42:05] [V] [TRT] Tactic: 256 time 0.968124 [07/29/2021-16:42:05] [V] [TRT] Tactic: 512 time 1.06399 [07/29/2021-16:42:05] [V] [TRT] Tactic: -32 time 1.42064 [07/29/2021-16:42:05] [V] [TRT] Tactic: -64 time 0.963836 [07/29/2021-16:42:05] [V] [TRT] Tactic: -128 time 0.968972 [07/29/2021-16:42:05] [V] [TRT] Fastest Tactic: 128 Time: 0.943556 [07/29/2021-16:42:05] [V] [TRT] --------------- Timing Runner: LeakyRelu_1 (PointWiseV2) [07/29/2021-16:42:05] [V] [TRT] Tactic: 24 time 0.463828 [07/29/2021-16:42:05] [V] [TRT] Tactic: 25 time 0.488544 [07/29/2021-16:42:05] [V] [TRT] Tactic: 26 time 0.50212 [07/29/2021-16:42:05] [V] [TRT] Tactic: 27 time 0.510164 [07/29/2021-16:42:05] [V] [TRT] Tactic: 31 time 0.463948 [07/29/2021-16:42:05] [V] [TRT] Fastest Tactic: 24 Time: 0.463828 [07/29/2021-16:42:05] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/29/2021-16:42:05] [V] [TRT] [07/29/2021-16:42:05] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400,819200) -> Float(1,320,102400,819200) *************** [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:05] [V] [TRT] --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [07/29/2021-16:42:05] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:05] [V] [TRT] --------------- Timing Runner: Conv_2 (CaskConvolution) [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:05] [V] [TRT] Tactic: 1825138533642645384 time 6.34246 [07/29/2021-16:42:05] [V] [TRT] Conv_2 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: 2775507031594384867 time 4.95958 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: 2842488832350522458 time 2.15593 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: 3915320020053085238 time 4.04816 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: 6448355332020552203 time 5.79448 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: 6808617066150061604 time 1.90049 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: -8060443123034038864 time 2.07796 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: -4420849921117327522 time 1.2352 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: -3946921629105938337 time 1.01661 [07/29/2021-16:42:06] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 1.01661 [07/29/2021-16:42:06] [V] [TRT] --------------- Timing Runner: Conv_2 (CudaConvolution) [07/29/2021-16:42:06] [V] [TRT] Tactic: 0 time 1.09004 [07/29/2021-16:42:06] [V] [TRT] Tactic: 1 time 1.06908 [07/29/2021-16:42:06] [V] [TRT] Tactic: 2 skipped. Scratch requested: 88473600, available: 16777216 [07/29/2021-16:42:06] [V] [TRT] Tactic: 5 skipped. Scratch requested: 53578240, available: 16777216 [07/29/2021-16:42:06] [V] [TRT] Tactic: 6 skipped. Scratch requested: 52560384, available: 16777216 [07/29/2021-16:42:06] [V] [TRT] Tactic: 56 time 1.0792 [07/29/2021-16:42:06] [V] [TRT] Tactic: 57 time 1.08255 [07/29/2021-16:42:06] [V] [TRT] Tactic: 58 skipped. Scratch requested: 88473600, available: 16777216 [07/29/2021-16:42:06] [V] [TRT] Tactic: 61 skipped. Scratch requested: 53578240, available: 16777216 [07/29/2021-16:42:06] [V] [TRT] Tactic: 62 skipped. Scratch requested: 52560384, available: 16777216 [07/29/2021-16:42:06] [V] [TRT] Fastest Tactic: 1 Time: 1.06908 [07/29/2021-16:42:06] [V] [TRT] --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [07/29/2021-16:42:06] [V] [TRT] Tactic: -1 time 0.299704 [07/29/2021-16:42:06] [V] [TRT] Fastest Tactic: -1 Time: 0.299704 [07/29/2021-16:42:06] [V] [TRT] --------------- Timing Runner: Conv_2 (CublasConvolution) [07/29/2021-16:42:06] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:06] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:06] [V] [TRT] [07/29/2021-16:42:06] [V] [TRT] *************** Autotuning format combination: Float(8,2560,1,819200) -> Float(8,2560,1,819200) *************** [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:06] [V] [TRT] --------------- Timing Runner: Conv_2 (FusedConvActConvolution) [07/29/2021-16:42:06] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:06] [V] [TRT] --------------- Timing Runner: Conv_2 (CaskConvolution) [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: 861694390046228376 time 9.46622 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:06] [V] [TRT] Tactic: 5821621277990374316 time 10.0347 [07/29/2021-16:42:06] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -3853827649136781465 time 10.0853 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 9.46622 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_2 (CudaConvolution) [07/29/2021-16:42:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_2 (CudaDepthwiseConvolution) [07/29/2021-16:42:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_2 (CublasConvolution) [07/29/2021-16:42:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:07] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] [07/29/2021-16:42:07] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_2 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400,819200) -> Float(1,320,102400,819200) *************** [07/29/2021-16:42:07] [V] [TRT] *************** Autotuning format combination: Float(8,2560,1,819200) -> Float(8,2560,1,819200) *************** [07/29/2021-16:42:07] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400:32,102400) -> Float(1,320,102400:32,102400) *************** [07/29/2021-16:42:07] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400,819200) -> Float(1,320,102400,1638400) *************** [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [07/29/2021-16:42:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (CaskConvolution) [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 1754569683116234317 time 0.416964 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 1825138533642645384 time 0.41824 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 2733356012094739613 time 0.2068 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 3915320020053085238 time 0.4172 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 6808617066150061604 time 0.208912 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 9091006216302412844 time 0.20614 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -8060443123034038864 time 0.211508 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -4420849921117327522 time 0.20214 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -3946921629105938337 time 0.208252 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.20214 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaConvolution) [07/29/2021-16:42:07] [V] [TRT] Tactic: 0 time 0.921884 [07/29/2021-16:42:07] [V] [TRT] Tactic: 1 time 0.92082 [07/29/2021-16:42:07] [V] [TRT] Tactic: 2 skipped. Scratch requested: 26214400, available: 16777216 [07/29/2021-16:42:07] [V] [TRT] Tactic: 5 skipped. Scratch requested: 126944256, available: 16777216 [07/29/2021-16:42:07] [V] [TRT] Tactic: 56 time 0.92112 [07/29/2021-16:42:07] [V] [TRT] Tactic: 57 time 0.932924 [07/29/2021-16:42:07] [V] [TRT] Tactic: 58 skipped. Scratch requested: 26214400, available: 16777216 [07/29/2021-16:42:07] [V] [TRT] Tactic: 61 skipped. Scratch requested: 126944256, available: 16777216 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: 1 Time: 0.92082 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [07/29/2021-16:42:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (CublasConvolution) [07/29/2021-16:42:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:07] [V] [TRT] *************** Autotuning format combination: Float(8,2560,1,819200) -> Float(16,5120,1,1638400) *************** [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (FusedConvActConvolution) [07/29/2021-16:42:07] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (CaskConvolution) [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 861694390046228376 time 0.347036 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 5258189349241541167 time 0.322524 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 5821621277990374316 time 0.343696 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: 5863767799113001648 time 0.515772 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -9147980667639709536 time 0.333596 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -8892196987859366827 time 0.330204 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -8850904373104590857 time 0.3239 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -8010679767156598961 time 0.506952 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -7751035352149795660 time 0.333108 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -5115676123557684531 time 0.335432 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -493597327599791285 time 0.31828 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Tactic: -423878181466897819 time 0.51194 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: -493597327599791285 Time: 0.31828 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaConvolution) [07/29/2021-16:42:07] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (CudaDepthwiseConvolution) [07/29/2021-16:42:07] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: Conv_4 (CublasConvolution) [07/29/2021-16:42:07] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:07] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -493597327599791285 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:07] [V] [TRT] Tactic: 1002 time 0.282036 [07/29/2021-16:42:07] [V] [TRT] Tactic: 0 time 0.237296 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: 0 Time: 0.237296 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:07] [V] [TRT] Tactic: 1002 time 0.424288 [07/29/2021-16:42:07] [V] [TRT] Tactic: 0 time 9.89208 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.424288 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:07] [V] [TRT] Tactic: 1002 time 0.269388 [07/29/2021-16:42:07] [V] [TRT] Tactic: 0 time 1.73898 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.269388 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:07] [V] [TRT] Tactic: 1002 time 0.374872 [07/29/2021-16:42:07] [V] [TRT] Tactic: 0 time 10.2271 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: 1002 Time: 0.374872 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:07] [V] [TRT] Tactic: 1002 time 2.01891 [07/29/2021-16:42:07] [V] [TRT] Tactic: 0 time 1.93006 [07/29/2021-16:42:07] [V] [TRT] Fastest Tactic: 0 Time: 1.93006 [07/29/2021-16:42:07] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:07] [V] [TRT] Tactic: 1002 time 0.347128 [07/29/2021-16:42:08] [V] [TRT] Tactic: 0 time 0.229628 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: 0 Time: 0.229628 [07/29/2021-16:42:08] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400,1638400) -> Float(1,320,102400,1638400) *************** [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: LeakyRelu_5 (PointWise) [07/29/2021-16:42:08] [V] [TRT] Tactic: 128 time 0.2246 [07/29/2021-16:42:08] [V] [TRT] Tactic: 256 time 0.225856 [07/29/2021-16:42:08] [V] [TRT] Tactic: 512 time 0.241544 [07/29/2021-16:42:08] [V] [TRT] Tactic: -32 time 0.34016 [07/29/2021-16:42:08] [V] [TRT] Tactic: -64 time 0.259416 [07/29/2021-16:42:08] [V] [TRT] Tactic: -128 time 0.23916 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: 128 Time: 0.2246 [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: LeakyRelu_5 (PointWiseV2) [07/29/2021-16:42:08] [V] [TRT] Tactic: 0 time 0.21822 [07/29/2021-16:42:08] [V] [TRT] Tactic: 1 time 0.229868 [07/29/2021-16:42:08] [V] [TRT] Tactic: 2 time 0.21954 [07/29/2021-16:42:08] [V] [TRT] Tactic: 3 time 0.24518 [07/29/2021-16:42:08] [V] [TRT] Tactic: 4 time 0.228952 [07/29/2021-16:42:08] [V] [TRT] Tactic: 5 time 0.227476 [07/29/2021-16:42:08] [V] [TRT] Tactic: 6 time 0.267844 [07/29/2021-16:42:08] [V] [TRT] Tactic: 7 time 0.238564 [07/29/2021-16:42:08] [V] [TRT] Tactic: 8 time 0.235088 [07/29/2021-16:42:08] [V] [TRT] Tactic: 9 time 0.236008 [07/29/2021-16:42:08] [V] [TRT] Tactic: 28 time 0.217948 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: 28 Time: 0.217948 [07/29/2021-16:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/29/2021-16:42:08] [V] [TRT] [07/29/2021-16:42:08] [V] [TRT] *************** Autotuning format combination: Float(16,5120,1,1638400) -> Float(16,5120,1,1638400) *************** [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: LeakyRelu_5 (PointWise) [07/29/2021-16:42:08] [V] [TRT] Tactic: 128 time 0.225788 [07/29/2021-16:42:08] [V] [TRT] Tactic: 256 time 0.227572 [07/29/2021-16:42:08] [V] [TRT] Tactic: 512 time 0.24326 [07/29/2021-16:42:08] [V] [TRT] Tactic: -32 time 0.341828 [07/29/2021-16:42:08] [V] [TRT] Tactic: -64 time 0.259212 [07/29/2021-16:42:08] [V] [TRT] Tactic: -128 time 0.239932 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: 128 Time: 0.225788 [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: LeakyRelu_5 (PointWiseV2) [07/29/2021-16:42:08] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:08] [V] [TRT] [07/29/2021-16:42:08] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400:32,102400) -> Float(1,320,102400:32,102400) *************** [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: LeakyRelu_5 (PointWise) [07/29/2021-16:42:08] [V] [TRT] Tactic: 128 time 0.443048 [07/29/2021-16:42:08] [V] [TRT] Tactic: 256 time 0.446196 [07/29/2021-16:42:08] [V] [TRT] Tactic: 512 time 0.476504 [07/29/2021-16:42:08] [V] [TRT] Tactic: -32 time 0.67256 [07/29/2021-16:42:08] [V] [TRT] Tactic: -64 time 0.507956 [07/29/2021-16:42:08] [V] [TRT] Tactic: -128 time 0.471504 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: 128 Time: 0.443048 [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: LeakyRelu_5 (PointWiseV2) [07/29/2021-16:42:08] [V] [TRT] Tactic: 24 time 0.488016 [07/29/2021-16:42:08] [V] [TRT] Tactic: 25 time 0.505196 [07/29/2021-16:42:08] [V] [TRT] Tactic: 26 time 0.51454 [07/29/2021-16:42:08] [V] [TRT] Tactic: 27 time 0.519852 [07/29/2021-16:42:08] [V] [TRT] Tactic: 31 time 0.489012 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: 24 Time: 0.488016 [07/29/2021-16:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:08] [V] [TRT] [07/29/2021-16:42:08] [V] [TRT] *************** Autotuning format combination: Float(1,320,102400,1638400) -> Float(1,160,25600,409600) *************** [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: Conv_6 (FusedConvActConvolution) [07/29/2021-16:42:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: Conv_6 (CaskConvolution) [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: 1825138533642645384 time 2.02435 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: 2842488832350522458 time 1.22308 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: 3915320020053085238 time 2.09221 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: 6448355332020552203 time 3.00502 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: 6808617066150061604 time 1.05425 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: -8060443123034038864 time 1.08865 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: -4420849921117327522 time 0.666448 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: -3946921629105938337 time 0.592128 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.592128 [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaConvolution) [07/29/2021-16:42:08] [V] [TRT] Tactic: 0 time 0.545212 [07/29/2021-16:42:08] [V] [TRT] Tactic: 1 time 0.542852 [07/29/2021-16:42:08] [V] [TRT] Tactic: 2 skipped. Scratch requested: 22118400, available: 16777216 [07/29/2021-16:42:08] [V] [TRT] Tactic: 5 skipped. Scratch requested: 33917440, available: 16777216 [07/29/2021-16:42:08] [V] [TRT] Tactic: 56 time 0.54314 [07/29/2021-16:42:08] [V] [TRT] Tactic: 57 time 0.53918 [07/29/2021-16:42:08] [V] [TRT] Tactic: 58 skipped. Scratch requested: 22118400, available: 16777216 [07/29/2021-16:42:08] [V] [TRT] Tactic: 61 skipped. Scratch requested: 33917440, available: 16777216 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: 57 Time: 0.53918 [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaDepthwiseConvolution) [07/29/2021-16:42:08] [V] [TRT] Tactic: -1 time 0.24722 [07/29/2021-16:42:08] [V] [TRT] Fastest Tactic: -1 Time: 0.24722 [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: Conv_6 (CublasConvolution) [07/29/2021-16:42:08] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:08] [V] [TRT] [07/29/2021-16:42:08] [V] [TRT] *************** Autotuning format combination: Float(16,5120,1,1638400) -> Float(16,2560,1,409600) *************** [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: Conv_6 (FusedConvActConvolution) [07/29/2021-16:42:08] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:08] [V] [TRT] --------------- Timing Runner: Conv_6 (CaskConvolution) [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: 861694390046228376 time 4.75615 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:08] [V] [TRT] Tactic: 5821621277990374316 time 5.51784 [07/29/2021-16:42:08] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -3853827649136781465 time 5.55496 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 4.75615 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaConvolution) [07/29/2021-16:42:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_6 (CudaDepthwiseConvolution) [07/29/2021-16:42:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_6 (CublasConvolution) [07/29/2021-16:42:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:09] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] [07/29/2021-16:42:09] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_6 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.07358 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.062508 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.062508 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.11402 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.555604 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.11402 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.068628 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.07186 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.068628 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.095872 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 1.01571 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.095872 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.142936 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.099792 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.099792 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.094968 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.061148 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.061148 [07/29/2021-16:42:09] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600,409600) -> Float(1,160,25600,409600) *************** [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: LeakyRelu_7 (PointWise) [07/29/2021-16:42:09] [V] [TRT] Tactic: 128 time 0.06124 [07/29/2021-16:42:09] [V] [TRT] Tactic: 256 time 0.061736 [07/29/2021-16:42:09] [V] [TRT] Tactic: 512 time 0.066244 [07/29/2021-16:42:09] [V] [TRT] Tactic: -32 time 0.10256 [07/29/2021-16:42:09] [V] [TRT] Tactic: -64 time 0.072664 [07/29/2021-16:42:09] [V] [TRT] Tactic: -128 time 0.065884 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 128 Time: 0.06124 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: LeakyRelu_7 (PointWiseV2) [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.058128 [07/29/2021-16:42:09] [V] [TRT] Tactic: 1 time 0.061196 [07/29/2021-16:42:09] [V] [TRT] Tactic: 2 time 0.058512 [07/29/2021-16:42:09] [V] [TRT] Tactic: 3 time 0.065208 [07/29/2021-16:42:09] [V] [TRT] Tactic: 4 time 0.061016 [07/29/2021-16:42:09] [V] [TRT] Tactic: 5 time 0.060308 [07/29/2021-16:42:09] [V] [TRT] Tactic: 6 time 0.071364 [07/29/2021-16:42:09] [V] [TRT] Tactic: 7 time 0.06346 [07/29/2021-16:42:09] [V] [TRT] Tactic: 8 time 0.061636 [07/29/2021-16:42:09] [V] [TRT] Tactic: 9 time 0.06094 [07/29/2021-16:42:09] [V] [TRT] Tactic: 28 time 0.058216 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.058128 [07/29/2021-16:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/29/2021-16:42:09] [V] [TRT] [07/29/2021-16:42:09] [V] [TRT] *************** Autotuning format combination: Float(16,2560,1,409600) -> Float(16,2560,1,409600) *************** [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: LeakyRelu_7 (PointWise) [07/29/2021-16:42:09] [V] [TRT] Tactic: 128 time 0.061292 [07/29/2021-16:42:09] [V] [TRT] Tactic: 256 time 0.061756 [07/29/2021-16:42:09] [V] [TRT] Tactic: 512 time 0.065264 [07/29/2021-16:42:09] [V] [TRT] Tactic: -32 time 0.101916 [07/29/2021-16:42:09] [V] [TRT] Tactic: -64 time 0.072736 [07/29/2021-16:42:09] [V] [TRT] Tactic: -128 time 0.066212 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 128 Time: 0.061292 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: LeakyRelu_7 (PointWiseV2) [07/29/2021-16:42:09] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:09] [V] [TRT] [07/29/2021-16:42:09] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600:32,25600) -> Float(1,160,25600:32,25600) *************** [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: LeakyRelu_7 (PointWise) [07/29/2021-16:42:09] [V] [TRT] Tactic: 128 time 0.115224 [07/29/2021-16:42:09] [V] [TRT] Tactic: 256 time 0.115992 [07/29/2021-16:42:09] [V] [TRT] Tactic: 512 time 0.123576 [07/29/2021-16:42:09] [V] [TRT] Tactic: -32 time 0.175348 [07/29/2021-16:42:09] [V] [TRT] Tactic: -64 time 0.134944 [07/29/2021-16:42:09] [V] [TRT] Tactic: -128 time 0.123548 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 128 Time: 0.115224 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: LeakyRelu_7 (PointWiseV2) [07/29/2021-16:42:09] [V] [TRT] Tactic: 24 time 0.124668 [07/29/2021-16:42:09] [V] [TRT] Tactic: 25 time 0.129524 [07/29/2021-16:42:09] [V] [TRT] Tactic: 26 time 0.130796 [07/29/2021-16:42:09] [V] [TRT] Tactic: 27 time 0.134268 [07/29/2021-16:42:09] [V] [TRT] Tactic: 31 time 0.12454 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 31 Time: 0.12454 [07/29/2021-16:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:09] [V] [TRT] [07/29/2021-16:42:09] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600,409600) -> Float(1,160,25600,819200) *************** [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (FusedConvActConvolution) [07/29/2021-16:42:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (CaskConvolution) [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 1754569683116234317 time 0.1288 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 1825138533642645384 time 0.131084 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 2733356012094739613 time 0.097912 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 3915320020053085238 time 0.130584 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 6808617066150061604 time 0.104032 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 9091006216302412844 time 0.103504 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -8060443123034038864 time 0.104304 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -4420849921117327522 time 0.099788 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -3946921629105938337 time 0.09774 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.09774 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (CudaConvolution) [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.711036 [07/29/2021-16:42:09] [V] [TRT] Tactic: 1 time 0.710972 [07/29/2021-16:42:09] [V] [TRT] Tactic: 2 time 0.711436 [07/29/2021-16:42:09] [V] [TRT] Tactic: 4 skipped. Scratch requested: 338167808, available: 16777216 [07/29/2021-16:42:09] [V] [TRT] Tactic: 5 skipped. Scratch requested: 16781312, available: 16777216 [07/29/2021-16:42:09] [V] [TRT] Tactic: 56 time 0.741984 [07/29/2021-16:42:09] [V] [TRT] Tactic: 57 time 0.742276 [07/29/2021-16:42:09] [V] [TRT] Tactic: 58 time 0.735936 [07/29/2021-16:42:09] [V] [TRT] Tactic: 60 skipped. Scratch requested: 338167808, available: 16777216 [07/29/2021-16:42:09] [V] [TRT] Tactic: 61 skipped. Scratch requested: 16781312, available: 16777216 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 1 Time: 0.710972 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (CudaDepthwiseConvolution) [07/29/2021-16:42:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (CublasConvolution) [07/29/2021-16:42:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3946921629105938337 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:09] [V] [TRT] *************** Autotuning format combination: Float(16,2560,1,409600) -> Float(32,5120,1,819200) *************** [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (FusedConvActConvolution) [07/29/2021-16:42:09] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (CaskConvolution) [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 861694390046228376 time 0.120084 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 5258189349241541167 time 0.098228 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 5821621277990374316 time 0.117916 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: 5863767799113001648 time 0.142788 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -9147980667639709536 time 0.1149 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -8892196987859366827 time 0.113384 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -8850904373104590857 time 0.097332 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -8010679767156598961 time 0.140488 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -7751035352149795660 time 0.115356 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -5115676123557684531 time 0.115724 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -493597327599791285 time 0.097048 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Tactic: -423878181466897819 time 0.142756 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: -493597327599791285 Time: 0.097048 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (CudaConvolution) [07/29/2021-16:42:09] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (CudaDepthwiseConvolution) [07/29/2021-16:42:09] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: Conv_8 (CublasConvolution) [07/29/2021-16:42:09] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:09] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -493597327599791285 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.12274 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.129956 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.12274 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.141272 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.584392 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.141272 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.131008 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.185024 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.131008 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.157752 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 2.08693 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 1002 Time: 0.157752 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.257448 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.184732 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.184732 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:09] [V] [TRT] Tactic: 1002 time 0.15828 [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.112948 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 0 Time: 0.112948 [07/29/2021-16:42:09] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600,819200) -> Float(1,160,25600,819200) *************** [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: LeakyRelu_9 (PointWise) [07/29/2021-16:42:09] [V] [TRT] Tactic: 128 time 0.115056 [07/29/2021-16:42:09] [V] [TRT] Tactic: 256 time 0.116296 [07/29/2021-16:42:09] [V] [TRT] Tactic: 512 time 0.123652 [07/29/2021-16:42:09] [V] [TRT] Tactic: -32 time 0.175236 [07/29/2021-16:42:09] [V] [TRT] Tactic: -64 time 0.135216 [07/29/2021-16:42:09] [V] [TRT] Tactic: -128 time 0.123892 [07/29/2021-16:42:09] [V] [TRT] Fastest Tactic: 128 Time: 0.115056 [07/29/2021-16:42:09] [V] [TRT] --------------- Timing Runner: LeakyRelu_9 (PointWiseV2) [07/29/2021-16:42:09] [V] [TRT] Tactic: 0 time 0.112068 [07/29/2021-16:42:09] [V] [TRT] Tactic: 1 time 0.117672 [07/29/2021-16:42:09] [V] [TRT] Tactic: 2 time 0.11232 [07/29/2021-16:42:09] [V] [TRT] Tactic: 3 time 0.12554 [07/29/2021-16:42:09] [V] [TRT] Tactic: 4 time 0.117172 [07/29/2021-16:42:09] [V] [TRT] Tactic: 5 time 0.116656 [07/29/2021-16:42:09] [V] [TRT] Tactic: 6 time 0.136912 [07/29/2021-16:42:09] [V] [TRT] Tactic: 7 time 0.121416 [07/29/2021-16:42:09] [V] [TRT] Tactic: 8 time 0.119704 [07/29/2021-16:42:10] [V] [TRT] Tactic: 9 time 0.119644 [07/29/2021-16:42:10] [V] [TRT] Tactic: 28 time 0.111752 [07/29/2021-16:42:10] [V] [TRT] Fastest Tactic: 28 Time: 0.111752 [07/29/2021-16:42:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/29/2021-16:42:10] [V] [TRT] [07/29/2021-16:42:10] [V] [TRT] *************** Autotuning format combination: Float(32,5120,1,819200) -> Float(32,5120,1,819200) *************** [07/29/2021-16:42:10] [V] [TRT] --------------- Timing Runner: LeakyRelu_9 (PointWise) [07/29/2021-16:42:10] [V] [TRT] Tactic: 128 time 0.115188 [07/29/2021-16:42:10] [V] [TRT] Tactic: 256 time 0.116056 [07/29/2021-16:42:10] [V] [TRT] Tactic: 512 time 0.123716 [07/29/2021-16:42:10] [V] [TRT] Tactic: -32 time 0.174836 [07/29/2021-16:42:10] [V] [TRT] Tactic: -64 time 0.135152 [07/29/2021-16:42:10] [V] [TRT] Tactic: -128 time 0.123716 [07/29/2021-16:42:10] [V] [TRT] Fastest Tactic: 128 Time: 0.115188 [07/29/2021-16:42:10] [V] [TRT] --------------- Timing Runner: LeakyRelu_9 (PointWiseV2) [07/29/2021-16:42:10] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:10] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:10] [V] [TRT] [07/29/2021-16:42:10] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600:32,25600) -> Float(1,160,25600:32,25600) *************** [07/29/2021-16:42:11] [V] [TRT] --------------- Timing Runner: LeakyRelu_9 (PointWise) [07/29/2021-16:42:11] [V] [TRT] Tactic: 128 time 0.115216 [07/29/2021-16:42:11] [V] [TRT] Tactic: 256 time 0.116464 [07/29/2021-16:42:11] [V] [TRT] Tactic: 512 time 0.123532 [07/29/2021-16:42:11] [V] [TRT] Tactic: -32 time 0.17562 [07/29/2021-16:42:11] [V] [TRT] Tactic: -64 time 0.13488 [07/29/2021-16:42:11] [V] [TRT] Tactic: -128 time 0.124112 [07/29/2021-16:42:11] [V] [TRT] Fastest Tactic: 128 Time: 0.115216 [07/29/2021-16:42:11] [V] [TRT] --------------- Timing Runner: LeakyRelu_9 (PointWiseV2) [07/29/2021-16:42:11] [V] [TRT] Tactic: 24 time 0.124432 [07/29/2021-16:42:11] [V] [TRT] Tactic: 25 time 0.129072 [07/29/2021-16:42:11] [V] [TRT] Tactic: 26 time 0.130704 [07/29/2021-16:42:11] [V] [TRT] Tactic: 27 time 0.134448 [07/29/2021-16:42:11] [V] [TRT] Tactic: 31 time 0.124676 [07/29/2021-16:42:11] [V] [TRT] Fastest Tactic: 24 Time: 0.124432 [07/29/2021-16:42:11] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:11] [V] [TRT] [07/29/2021-16:42:11] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600,819200) -> Float(1,160,25600,819200) *************** [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:11] [V] [TRT] --------------- Timing Runner: Conv_10 (FusedConvActConvolution) [07/29/2021-16:42:11] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:11] [V] [TRT] --------------- Timing Runner: Conv_10 (CaskConvolution) [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: 1825138533642645384 time 3.93389 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: 2775507031594384867 time 3.98439 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: 2842488832350522458 time 2.3103 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: 3915320020053085238 time 4.24059 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: 6448355332020552203 time 5.87151 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: 6808617066150061604 time 2.04028 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: -8060443123034038864 time 2.23816 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: -4420849921117327522 time 1.28756 [07/29/2021-16:42:11] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:11] [V] [TRT] Tactic: -3946921629105938337 time 1.10985 [07/29/2021-16:42:11] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 1.10985 [07/29/2021-16:42:11] [V] [TRT] --------------- Timing Runner: Conv_10 (CudaConvolution) [07/29/2021-16:42:11] [V] [TRT] Tactic: 0 time 0.242264 [07/29/2021-16:42:11] [V] [TRT] Tactic: 1 time 0.242892 [07/29/2021-16:42:11] [V] [TRT] Tactic: 2 time 0.264444 [07/29/2021-16:42:11] [V] [TRT] Tactic: 4 skipped. Scratch requested: 51151360, available: 16777216 [07/29/2021-16:42:12] [V] [TRT] Tactic: 5 time 21.3001 [07/29/2021-16:42:12] [V] [TRT] Tactic: 6 time 12.7841 [07/29/2021-16:42:12] [V] [TRT] Tactic: 56 time 0.243092 [07/29/2021-16:42:12] [V] [TRT] Tactic: 57 time 0.242752 [07/29/2021-16:42:12] [V] [TRT] Tactic: 58 time 0.262112 [07/29/2021-16:42:12] [V] [TRT] Tactic: 60 skipped. Scratch requested: 51151360, available: 16777216 [07/29/2021-16:42:12] [V] [TRT] Tactic: 61 time 21.4252 [07/29/2021-16:42:13] [V] [TRT] Tactic: 62 time 12.7992 [07/29/2021-16:42:13] [V] [TRT] Fastest Tactic: 0 Time: 0.242264 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_10 (CudaDepthwiseConvolution) [07/29/2021-16:42:13] [V] [TRT] Tactic: -1 time 0.1419 [07/29/2021-16:42:13] [V] [TRT] Fastest Tactic: -1 Time: 0.1419 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_10 (CublasConvolution) [07/29/2021-16:42:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:13] [V] [TRT] [07/29/2021-16:42:13] [V] [TRT] *************** Autotuning format combination: Float(32,5120,1,819200) -> Float(32,5120,1,819200) *************** [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_10 (FusedConvActConvolution) [07/29/2021-16:42:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_10 (CaskConvolution) [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 861694390046228376 time 10.349 [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 5821621277990374316 time 10.9158 [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -3853827649136781465 time 11.0265 [07/29/2021-16:42:13] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 10.349 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_10 (CudaConvolution) [07/29/2021-16:42:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_10 (CudaDepthwiseConvolution) [07/29/2021-16:42:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_10 (CublasConvolution) [07/29/2021-16:42:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_10 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600,819200) -> Float(1,160,25600,819200) *************** [07/29/2021-16:42:13] [V] [TRT] *************** Autotuning format combination: Float(32,5120,1,819200) -> Float(32,5120,1,819200) *************** [07/29/2021-16:42:13] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600:32,25600) -> Float(1,160,25600:32,25600) *************** [07/29/2021-16:42:13] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600,819200) -> Float(1,160,25600,819200) *************** [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (FusedConvActConvolution) [07/29/2021-16:42:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (CaskConvolution) [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 1754569683116234317 time 0.176024 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 1825138533642645384 time 0.177032 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 2733356012094739613 time 0.123808 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 3915320020053085238 time 0.173068 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 6808617066150061604 time 0.12882 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 9091006216302412844 time 0.130004 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -8060443123034038864 time 0.12886 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -4420849921117327522 time 0.12346 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -3946921629105938337 time 0.123772 [07/29/2021-16:42:13] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.12346 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaConvolution) [07/29/2021-16:42:13] [V] [TRT] Tactic: 0 time 0.285472 [07/29/2021-16:42:13] [V] [TRT] Tactic: 1 time 0.236148 [07/29/2021-16:42:13] [V] [TRT] Tactic: 2 skipped. Scratch requested: 26214400, available: 16777216 [07/29/2021-16:42:13] [V] [TRT] Tactic: 4 skipped. Scratch requested: 676335616, available: 16777216 [07/29/2021-16:42:13] [V] [TRT] Tactic: 5 skipped. Scratch requested: 22421504, available: 16777216 [07/29/2021-16:42:13] [V] [TRT] Tactic: 56 time 0.284672 [07/29/2021-16:42:13] [V] [TRT] Tactic: 57 time 0.235808 [07/29/2021-16:42:13] [V] [TRT] Tactic: 58 skipped. Scratch requested: 26214400, available: 16777216 [07/29/2021-16:42:13] [V] [TRT] Tactic: 60 skipped. Scratch requested: 676335616, available: 16777216 [07/29/2021-16:42:13] [V] [TRT] Tactic: 61 skipped. Scratch requested: 22421504, available: 16777216 [07/29/2021-16:42:13] [V] [TRT] Fastest Tactic: 57 Time: 0.235808 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaDepthwiseConvolution) [07/29/2021-16:42:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (CublasConvolution) [07/29/2021-16:42:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:13] [V] [TRT] *************** Autotuning format combination: Float(32,5120,1,819200) -> Float(32,5120,1,819200) *************** [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (FusedConvActConvolution) [07/29/2021-16:42:13] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (CaskConvolution) [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 861694390046228376 time 0.163148 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 5258189349241541167 time 0.132128 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 5821621277990374316 time 0.162644 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: 5863767799113001648 time 0.145812 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -9147980667639709536 time 0.15914 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -8892196987859366827 time 0.157776 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -8850904373104590857 time 0.131448 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -8010679767156598961 time 0.143312 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -7751035352149795660 time 0.159028 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -5115676123557684531 time 0.160284 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -493597327599791285 time 0.137436 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] Tactic: -423878181466897819 time 0.145632 [07/29/2021-16:42:13] [V] [TRT] Fastest Tactic: -8850904373104590857 Time: 0.131448 [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaConvolution) [07/29/2021-16:42:13] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (CudaDepthwiseConvolution) [07/29/2021-16:42:13] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] --------------- Timing Runner: Conv_12 (CublasConvolution) [07/29/2021-16:42:13] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:13] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8850904373104590857 [07/29/2021-16:42:13] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:13] [V] [TRT] [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:14] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600,819200) -> Float(1,160,25600,819200) *************** [07/29/2021-16:42:14] [V] [TRT] *************** Autotuning format combination: Float(32,5120,1,819200) -> Float(32,5120,1,819200) *************** [07/29/2021-16:42:14] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600:32,25600) -> Float(1,160,25600:32,25600) *************** [07/29/2021-16:42:14] [V] [TRT] *************** Autotuning format combination: Float(1,160,25600,819200) -> Float(1,80,6400,204800) *************** [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:14] [V] [TRT] --------------- Timing Runner: Conv_14 (FusedConvActConvolution) [07/29/2021-16:42:14] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:14] [V] [TRT] --------------- Timing Runner: Conv_14 (CaskConvolution) [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Tactic: 1825138533642645384 time 1.1276 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Tactic: 2842488832350522458 time 0.72618 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Tactic: 3915320020053085238 time 1.11763 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Tactic: 6448355332020552203 time 1.48076 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Tactic: 6808617066150061604 time 0.672776 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Tactic: -8060443123034038864 time 0.680552 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Tactic: -4420849921117327522 time 0.470012 [07/29/2021-16:42:14] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:14] [V] [TRT] Tactic: -3946921629105938337 time 0.43266 [07/29/2021-16:42:14] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.43266 [07/29/2021-16:42:14] [V] [TRT] --------------- Timing Runner: Conv_14 (CudaConvolution) [07/29/2021-16:42:14] [V] [TRT] Tactic: 0 time 0.271268 [07/29/2021-16:42:14] [V] [TRT] Tactic: 1 time 0.359064 [07/29/2021-16:42:14] [V] [TRT] Tactic: 2 time 0.430788 [07/29/2021-16:42:14] [V] [TRT] Tactic: 5 time 17.6257 [07/29/2021-16:42:14] [V] [TRT] Tactic: 56 time 0.271612 [07/29/2021-16:42:14] [V] [TRT] Tactic: 57 time 0.359352 [07/29/2021-16:42:14] [V] [TRT] Tactic: 58 time 0.430792 [07/29/2021-16:42:14] [V] [TRT] Tactic: 61 time 17.8595 [07/29/2021-16:42:14] [V] [TRT] Fastest Tactic: 0 Time: 0.271268 [07/29/2021-16:42:14] [V] [TRT] --------------- Timing Runner: Conv_14 (CudaDepthwiseConvolution) [07/29/2021-16:42:14] [V] [TRT] Tactic: -1 time 0.087592 [07/29/2021-16:42:14] [V] [TRT] Fastest Tactic: -1 Time: 0.087592 [07/29/2021-16:42:14] [V] [TRT] --------------- Timing Runner: Conv_14 (CublasConvolution) [07/29/2021-16:42:14] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:14] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:14] [V] [TRT] [07/29/2021-16:42:14] [V] [TRT] *************** Autotuning format combination: Float(32,5120,1,819200) -> Float(32,2560,1,204800) *************** [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_14 (FusedConvActConvolution) [07/29/2021-16:42:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_14 (CaskConvolution) [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 861694390046228376 time 2.6526 [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 5821621277990374316 time 3.0943 [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -3853827649136781465 time 3.03686 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 2.6526 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_14 (CudaConvolution) [07/29/2021-16:42:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_14 (CudaDepthwiseConvolution) [07/29/2021-16:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_14 (CublasConvolution) [07/29/2021-16:42:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_14 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.03386 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.03728 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.03386 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.038856 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.069944 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.038856 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.033112 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.04956 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.033112 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.047944 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.086744 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.047944 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.0489 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.048948 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.0489 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.047416 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.03214 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 0 Time: 0.03214 [07/29/2021-16:42:15] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,204800) -> Float(1,80,6400,204800) *************** [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_15 (PointWise) [07/29/2021-16:42:15] [V] [TRT] Tactic: 128 time 0.033308 [07/29/2021-16:42:15] [V] [TRT] Tactic: 256 time 0.034184 [07/29/2021-16:42:15] [V] [TRT] Tactic: 512 time 0.036504 [07/29/2021-16:42:15] [V] [TRT] Tactic: -32 time 0.067136 [07/29/2021-16:42:15] [V] [TRT] Tactic: -64 time 0.046052 [07/29/2021-16:42:15] [V] [TRT] Tactic: -128 time 0.036988 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 128 Time: 0.033308 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_15 (PointWiseV2) [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.031104 [07/29/2021-16:42:15] [V] [TRT] Tactic: 1 time 0.033252 [07/29/2021-16:42:15] [V] [TRT] Tactic: 2 time 0.03118 [07/29/2021-16:42:15] [V] [TRT] Tactic: 3 time 0.035044 [07/29/2021-16:42:15] [V] [TRT] Tactic: 4 time 0.032468 [07/29/2021-16:42:15] [V] [TRT] Tactic: 5 time 0.0328 [07/29/2021-16:42:15] [V] [TRT] Tactic: 6 time 0.038032 [07/29/2021-16:42:15] [V] [TRT] Tactic: 7 time 0.033856 [07/29/2021-16:42:15] [V] [TRT] Tactic: 8 time 0.033 [07/29/2021-16:42:15] [V] [TRT] Tactic: 9 time 0.032008 [07/29/2021-16:42:15] [V] [TRT] Tactic: 28 time 0.031032 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 28 Time: 0.031032 [07/29/2021-16:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/29/2021-16:42:15] [V] [TRT] [07/29/2021-16:42:15] [V] [TRT] *************** Autotuning format combination: Float(32,2560,1,204800) -> Float(32,2560,1,204800) *************** [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_15 (PointWise) [07/29/2021-16:42:15] [V] [TRT] Tactic: 128 time 0.033188 [07/29/2021-16:42:15] [V] [TRT] Tactic: 256 time 0.034368 [07/29/2021-16:42:15] [V] [TRT] Tactic: 512 time 0.035868 [07/29/2021-16:42:15] [V] [TRT] Tactic: -32 time 0.066564 [07/29/2021-16:42:15] [V] [TRT] Tactic: -64 time 0.045588 [07/29/2021-16:42:15] [V] [TRT] Tactic: -128 time 0.037016 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 128 Time: 0.033188 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_15 (PointWiseV2) [07/29/2021-16:42:15] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:15] [V] [TRT] [07/29/2021-16:42:15] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400:32,6400) -> Float(1,80,6400:32,6400) *************** [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_15 (PointWise) [07/29/2021-16:42:15] [V] [TRT] Tactic: 128 time 0.03324 [07/29/2021-16:42:15] [V] [TRT] Tactic: 256 time 0.033696 [07/29/2021-16:42:15] [V] [TRT] Tactic: 512 time 0.035936 [07/29/2021-16:42:15] [V] [TRT] Tactic: -32 time 0.066668 [07/29/2021-16:42:15] [V] [TRT] Tactic: -64 time 0.045548 [07/29/2021-16:42:15] [V] [TRT] Tactic: -128 time 0.0371 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 128 Time: 0.03324 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_15 (PointWiseV2) [07/29/2021-16:42:15] [V] [TRT] Tactic: 24 time 0.033256 [07/29/2021-16:42:15] [V] [TRT] Tactic: 25 time 0.034988 [07/29/2021-16:42:15] [V] [TRT] Tactic: 26 time 0.036216 [07/29/2021-16:42:15] [V] [TRT] Tactic: 27 time 0.034508 [07/29/2021-16:42:15] [V] [TRT] Tactic: 31 time 0.032812 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 31 Time: 0.032812 [07/29/2021-16:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/29/2021-16:42:15] [V] [TRT] [07/29/2021-16:42:15] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,204800) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (FusedConvActConvolution) [07/29/2021-16:42:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (CaskConvolution) [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 1754569683116234317 time 0.056664 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 1825138533642645384 time 0.058356 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 2733356012094739613 time 0.057344 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 3915320020053085238 time 0.057956 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 6808617066150061604 time 0.054136 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 9091006216302412844 time 0.054964 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -8060443123034038864 time 0.05428 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -4420849921117327522 time 0.064428 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -3946921629105938337 time 0.057488 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.054136 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (CudaConvolution) [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.14802 [07/29/2021-16:42:15] [V] [TRT] Tactic: 1 time 0.108304 [07/29/2021-16:42:15] [V] [TRT] Tactic: 2 time 0.182288 [07/29/2021-16:42:15] [V] [TRT] Tactic: 4 skipped. Scratch requested: 306716672, available: 16777216 [07/29/2021-16:42:15] [V] [TRT] Tactic: 5 skipped. Scratch requested: 16990208, available: 16777216 [07/29/2021-16:42:15] [V] [TRT] Tactic: 56 time 0.148068 [07/29/2021-16:42:15] [V] [TRT] Tactic: 57 time 0.10822 [07/29/2021-16:42:15] [V] [TRT] Tactic: 58 time 0.181668 [07/29/2021-16:42:15] [V] [TRT] Tactic: 60 skipped. Scratch requested: 306716672, available: 16777216 [07/29/2021-16:42:15] [V] [TRT] Tactic: 61 skipped. Scratch requested: 16990208, available: 16777216 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 57 Time: 0.10822 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (CudaDepthwiseConvolution) [07/29/2021-16:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (CublasConvolution) [07/29/2021-16:42:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:15] [V] [TRT] *************** Autotuning format combination: Float(32,2560,1,204800) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (FusedConvActConvolution) [07/29/2021-16:42:15] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (CaskConvolution) [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 861694390046228376 time 0.054084 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 5258189349241541167 time 0.054556 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 5821621277990374316 time 0.053648 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: 5863767799113001648 time 0.072172 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -9147980667639709536 time 0.053592 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -8892196987859366827 time 0.05366 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -8850904373104590857 time 0.05432 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -8010679767156598961 time 0.07156 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -7751035352149795660 time 0.053576 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -5115676123557684531 time 0.053908 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -493597327599791285 time 0.058468 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Tactic: -423878181466897819 time 0.07238 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: -7751035352149795660 Time: 0.053576 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (CudaConvolution) [07/29/2021-16:42:15] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (CudaDepthwiseConvolution) [07/29/2021-16:42:15] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: Conv_16 (CublasConvolution) [07/29/2021-16:42:15] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:15] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7751035352149795660 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.064572 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.071336 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.064572 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.072432 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.131172 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.072432 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.069096 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.092752 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.069096 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.088256 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.165112 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.088256 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.090704 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.092016 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 1002 Time: 0.090704 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:15] [V] [TRT] Tactic: 1002 time 0.083548 [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.060084 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 0 Time: 0.060084 [07/29/2021-16:42:15] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_17 (PointWise) [07/29/2021-16:42:15] [V] [TRT] Tactic: 128 time 0.06122 [07/29/2021-16:42:15] [V] [TRT] Tactic: 256 time 0.061508 [07/29/2021-16:42:15] [V] [TRT] Tactic: 512 time 0.0655 [07/29/2021-16:42:15] [V] [TRT] Tactic: -32 time 0.10184 [07/29/2021-16:42:15] [V] [TRT] Tactic: -64 time 0.072244 [07/29/2021-16:42:15] [V] [TRT] Tactic: -128 time 0.06572 [07/29/2021-16:42:15] [V] [TRT] Fastest Tactic: 128 Time: 0.06122 [07/29/2021-16:42:15] [V] [TRT] --------------- Timing Runner: LeakyRelu_17 (PointWiseV2) [07/29/2021-16:42:15] [V] [TRT] Tactic: 0 time 0.058068 [07/29/2021-16:42:15] [V] [TRT] Tactic: 1 time 0.061384 [07/29/2021-16:42:15] [V] [TRT] Tactic: 2 time 0.058552 [07/29/2021-16:42:15] [V] [TRT] Tactic: 3 time 0.065116 [07/29/2021-16:42:15] [V] [TRT] Tactic: 4 time 0.060652 [07/29/2021-16:42:15] [V] [TRT] Tactic: 5 time 0.060404 [07/29/2021-16:42:15] [V] [TRT] Tactic: 6 time 0.071064 [07/29/2021-16:42:15] [V] [TRT] Tactic: 7 time 0.062676 [07/29/2021-16:42:15] [V] [TRT] Tactic: 8 time 0.061548 [07/29/2021-16:42:16] [V] [TRT] Tactic: 9 time 0.061252 [07/29/2021-16:42:16] [V] [TRT] Tactic: 28 time 0.058784 [07/29/2021-16:42:16] [V] [TRT] Fastest Tactic: 0 Time: 0.058068 [07/29/2021-16:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/29/2021-16:42:16] [V] [TRT] [07/29/2021-16:42:16] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:16] [V] [TRT] --------------- Timing Runner: LeakyRelu_17 (PointWise) [07/29/2021-16:42:16] [V] [TRT] Tactic: 128 time 0.06074 [07/29/2021-16:42:16] [V] [TRT] Tactic: 256 time 0.06132 [07/29/2021-16:42:16] [V] [TRT] Tactic: 512 time 0.065444 [07/29/2021-16:42:16] [V] [TRT] Tactic: -32 time 0.101644 [07/29/2021-16:42:16] [V] [TRT] Tactic: -64 time 0.072464 [07/29/2021-16:42:16] [V] [TRT] Tactic: -128 time 0.065996 [07/29/2021-16:42:16] [V] [TRT] Fastest Tactic: 128 Time: 0.06074 [07/29/2021-16:42:16] [V] [TRT] --------------- Timing Runner: LeakyRelu_17 (PointWiseV2) [07/29/2021-16:42:16] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:16] [V] [TRT] [07/29/2021-16:42:16] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400:32,12800) -> Float(1,80,6400:32,12800) *************** [07/29/2021-16:42:16] [V] [TRT] --------------- Timing Runner: LeakyRelu_17 (PointWise) [07/29/2021-16:42:16] [V] [TRT] Tactic: 128 time 0.0611 [07/29/2021-16:42:16] [V] [TRT] Tactic: 256 time 0.06156 [07/29/2021-16:42:16] [V] [TRT] Tactic: 512 time 0.065348 [07/29/2021-16:42:16] [V] [TRT] Tactic: -32 time 0.10194 [07/29/2021-16:42:16] [V] [TRT] Tactic: -64 time 0.07262 [07/29/2021-16:42:16] [V] [TRT] Tactic: -128 time 0.066072 [07/29/2021-16:42:16] [V] [TRT] Fastest Tactic: 128 Time: 0.0611 [07/29/2021-16:42:16] [V] [TRT] --------------- Timing Runner: LeakyRelu_17 (PointWiseV2) [07/29/2021-16:42:16] [V] [TRT] Tactic: 24 time 0.063736 [07/29/2021-16:42:16] [V] [TRT] Tactic: 25 time 0.065644 [07/29/2021-16:42:16] [V] [TRT] Tactic: 26 time 0.067364 [07/29/2021-16:42:16] [V] [TRT] Tactic: 27 time 0.070928 [07/29/2021-16:42:16] [V] [TRT] Tactic: 31 time 0.063652 [07/29/2021-16:42:16] [V] [TRT] Fastest Tactic: 31 Time: 0.063652 [07/29/2021-16:42:16] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:16] [V] [TRT] [07/29/2021-16:42:16] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:16] [V] [TRT] --------------- Timing Runner: Conv_18 (FusedConvActConvolution) [07/29/2021-16:42:16] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:16] [V] [TRT] --------------- Timing Runner: Conv_18 (CaskConvolution) [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: 1825138533642645384 time 2.25588 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: 2775507031594384867 time 2.02001 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: 2842488832350522458 time 1.40379 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: 3915320020053085238 time 2.26371 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: 6448355332020552203 time 3.0033 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: 6808617066150061604 time 1.30843 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: -8060443123034038864 time 1.32139 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: -4420849921117327522 time 0.882404 [07/29/2021-16:42:16] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:16] [V] [TRT] Tactic: -3946921629105938337 time 0.791156 [07/29/2021-16:42:16] [V] [TRT] Fastest Tactic: -3946921629105938337 Time: 0.791156 [07/29/2021-16:42:16] [V] [TRT] --------------- Timing Runner: Conv_18 (CudaConvolution) [07/29/2021-16:42:16] [V] [TRT] Tactic: 0 time 0.127276 [07/29/2021-16:42:16] [V] [TRT] Tactic: 1 time 0.127852 [07/29/2021-16:42:16] [V] [TRT] Tactic: 2 time 0.133916 [07/29/2021-16:42:16] [V] [TRT] Tactic: 4 time 8.85176 [07/29/2021-16:42:16] [V] [TRT] Tactic: 5 time 10.8858 [07/29/2021-16:42:17] [V] [TRT] Tactic: 6 time 6.1367 [07/29/2021-16:42:17] [V] [TRT] Tactic: 56 time 0.127244 [07/29/2021-16:42:17] [V] [TRT] Tactic: 57 time 0.127064 [07/29/2021-16:42:17] [V] [TRT] Tactic: 58 time 0.133404 [07/29/2021-16:42:17] [V] [TRT] Tactic: 60 time 8.79374 [07/29/2021-16:42:17] [V] [TRT] Tactic: 61 time 10.865 [07/29/2021-16:42:17] [V] [TRT] Tactic: 62 time 6.15922 [07/29/2021-16:42:17] [V] [TRT] Fastest Tactic: 57 Time: 0.127064 [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_18 (CudaDepthwiseConvolution) [07/29/2021-16:42:17] [V] [TRT] Tactic: -1 time 0.07072 [07/29/2021-16:42:17] [V] [TRT] Fastest Tactic: -1 Time: 0.07072 [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_18 (CublasConvolution) [07/29/2021-16:42:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:17] [V] [TRT] [07/29/2021-16:42:17] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_18 (FusedConvActConvolution) [07/29/2021-16:42:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_18 (CaskConvolution) [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: 861694390046228376 time 5.2122 [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: 5821621277990374316 time 5.69207 [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: -3853827649136781465 time 5.7237 [07/29/2021-16:42:17] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 5.2122 [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_18 (CudaConvolution) [07/29/2021-16:42:17] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_18 (CudaDepthwiseConvolution) [07/29/2021-16:42:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_18 (CublasConvolution) [07/29/2021-16:42:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_18 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:17] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:17] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:17] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400:32,12800) -> Float(1,80,6400:32,12800) *************** [07/29/2021-16:42:17] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_20 (FusedConvActConvolution) [07/29/2021-16:42:17] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_20 (CaskConvolution) [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: 1754569683116234317 time 0.078364 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: 1825138533642645384 time 0.078648 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: 2733356012094739613 time 0.086164 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: 3915320020053085238 time 0.07856 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: 6808617066150061604 time 0.070812 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: 9091006216302412844 time 0.072728 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: -8060443123034038864 time 0.071116 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: -4420849921117327522 time 0.090864 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Tactic: -3946921629105938337 time 0.084524 [07/29/2021-16:42:17] [V] [TRT] Fastest Tactic: 6808617066150061604 Time: 0.070812 [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_20 (CudaConvolution) [07/29/2021-16:42:17] [V] [TRT] Tactic: 0 time 0.173524 [07/29/2021-16:42:17] [V] [TRT] Tactic: 1 time 0.122984 [07/29/2021-16:42:17] [V] [TRT] Tactic: 2 time 0.241768 [07/29/2021-16:42:17] [V] [TRT] Tactic: 4 skipped. Scratch requested: 613433344, available: 16777216 [07/29/2021-16:42:17] [V] [TRT] Tactic: 5 skipped. Scratch requested: 22839296, available: 16777216 [07/29/2021-16:42:17] [V] [TRT] Tactic: 56 time 0.173368 [07/29/2021-16:42:17] [V] [TRT] Tactic: 57 time 0.122836 [07/29/2021-16:42:17] [V] [TRT] Tactic: 58 time 0.243132 [07/29/2021-16:42:17] [V] [TRT] Tactic: 60 skipped. Scratch requested: 613433344, available: 16777216 [07/29/2021-16:42:17] [V] [TRT] Tactic: 61 skipped. Scratch requested: 22839296, available: 16777216 [07/29/2021-16:42:17] [V] [TRT] Fastest Tactic: 57 Time: 0.122836 [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_20 (CudaDepthwiseConvolution) [07/29/2021-16:42:17] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:17] [V] [TRT] --------------- Timing Runner: Conv_20 (CublasConvolution) [07/29/2021-16:42:17] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:17] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 6808617066150061604 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:17] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_20 (FusedConvActConvolution) [07/29/2021-16:42:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_20 (CaskConvolution) [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 861694390046228376 time 0.086968 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 5258189349241541167 time 0.071392 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 5821621277990374316 time 0.087316 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 5863767799113001648 time 0.092968 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -9147980667639709536 time 0.085224 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -8892196987859366827 time 0.085032 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -8850904373104590857 time 0.071228 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -8010679767156598961 time 0.090992 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -7751035352149795660 time 0.085484 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -5115676123557684531 time 0.086444 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -493597327599791285 time 0.07584 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -423878181466897819 time 0.09254 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: -8850904373104590857 Time: 0.071228 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_20 (CudaConvolution) [07/29/2021-16:42:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_20 (CudaDepthwiseConvolution) [07/29/2021-16:42:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_20 (CublasConvolution) [07/29/2021-16:42:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8850904373104590857 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:18] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:18] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400:32,12800) -> Float(1,80,6400:32,12800) *************** [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:18] [V] [TRT] Tactic: 1002 time 0.06514 [07/29/2021-16:42:18] [V] [TRT] Tactic: 0 time 0.072792 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.06514 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:18] [V] [TRT] Tactic: 1002 time 0.072576 [07/29/2021-16:42:18] [V] [TRT] Tactic: 0 time 0.132288 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.072576 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:18] [V] [TRT] Tactic: 1002 time 0.06998 [07/29/2021-16:42:18] [V] [TRT] Tactic: 0 time 0.093096 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.06998 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:18] [V] [TRT] Tactic: 1002 time 0.08896 [07/29/2021-16:42:18] [V] [TRT] Tactic: 0 time 0.164572 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.08896 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:18] [V] [TRT] Tactic: 1002 time 0.08978 [07/29/2021-16:42:18] [V] [TRT] Tactic: 0 time 0.091612 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: 1002 Time: 0.08978 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:18] [V] [TRT] Tactic: 1002 time 0.083788 [07/29/2021-16:42:18] [V] [TRT] Tactic: 0 time 0.060356 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.060356 [07/29/2021-16:42:18] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (FusedConvActConvolution) [07/29/2021-16:42:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (CaskConvolution) [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 1825138533642645384 time 0.962716 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 2842488832350522458 time 0.697748 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 3915320020053085238 time 0.963932 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 6448355332020552203 time 1.24364 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 6808617066150061604 time 0.703168 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -8060443123034038864 time 0.70928 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -4420849921117327522 time 0.466924 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -3946921629105938337 time 0.608292 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.466924 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (CudaConvolution) [07/29/2021-16:42:18] [V] [TRT] Tactic: 0 time 0.049088 [07/29/2021-16:42:18] [V] [TRT] Tactic: 1 time 0.050072 [07/29/2021-16:42:18] [V] [TRT] Tactic: 2 time 0.049964 [07/29/2021-16:42:18] [V] [TRT] Tactic: 5 time 9.11743 [07/29/2021-16:42:18] [V] [TRT] Tactic: 56 time 0.050044 [07/29/2021-16:42:18] [V] [TRT] Tactic: 57 time 0.050016 [07/29/2021-16:42:18] [V] [TRT] Tactic: 58 time 0.049816 [07/29/2021-16:42:18] [V] [TRT] Tactic: 61 time 9.10835 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: 0 Time: 0.049088 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (CudaDepthwiseConvolution) [07/29/2021-16:42:18] [V] [TRT] Tactic: -1 time 0.04792 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: -1 Time: 0.04792 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (CublasConvolution) [07/29/2021-16:42:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:18] [V] [TRT] [07/29/2021-16:42:18] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,2560,1,102400) *************** [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (FusedConvActConvolution) [07/29/2021-16:42:18] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (CaskConvolution) [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 861694390046228376 time 2.0697 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: 5821621277990374316 time 2.07275 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] Tactic: -3853827649136781465 time 2.08624 [07/29/2021-16:42:18] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 2.0697 [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (CudaConvolution) [07/29/2021-16:42:18] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (CudaDepthwiseConvolution) [07/29/2021-16:42:18] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] --------------- Timing Runner: Conv_22 (CublasConvolution) [07/29/2021-16:42:18] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:18] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:18] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:18] [V] [TRT] [07/29/2021-16:42:19] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_22 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.01174 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.019844 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.01174 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.0161 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.032312 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.0161 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.011672 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.020216 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.011672 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.023792 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.04112 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.023792 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.026688 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.020772 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.020772 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.023848 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.013328 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.013328 [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_23 (PointWise) [07/29/2021-16:42:19] [V] [TRT] Tactic: 128 time 0.016 [07/29/2021-16:42:19] [V] [TRT] Tactic: 256 time 0.016068 [07/29/2021-16:42:19] [V] [TRT] Tactic: 512 time 0.016936 [07/29/2021-16:42:19] [V] [TRT] Tactic: -32 time 0.027456 [07/29/2021-16:42:19] [V] [TRT] Tactic: -64 time 0.020564 [07/29/2021-16:42:19] [V] [TRT] Tactic: -128 time 0.018004 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 128 Time: 0.016 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_23 (PointWiseV2) [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.01028 [07/29/2021-16:42:19] [V] [TRT] Tactic: 1 time 0.008948 [07/29/2021-16:42:19] [V] [TRT] Tactic: 2 time 0.008456 [07/29/2021-16:42:19] [V] [TRT] Tactic: 3 time 0.008112 [07/29/2021-16:42:19] [V] [TRT] Tactic: 4 time 0.00774 [07/29/2021-16:42:19] [V] [TRT] Tactic: 5 time 0.00758 [07/29/2021-16:42:19] [V] [TRT] Tactic: 6 time 0.0087 [07/29/2021-16:42:19] [V] [TRT] Tactic: 7 time 0.007452 [07/29/2021-16:42:19] [V] [TRT] Tactic: 8 time 0.007176 [07/29/2021-16:42:19] [V] [TRT] Tactic: 9 time 0.007788 [07/29/2021-16:42:19] [V] [TRT] Tactic: 28 time 0.010492 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 8 Time: 0.007176 [07/29/2021-16:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/29/2021-16:42:19] [V] [TRT] [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(64,2560,1,102400) -> Float(64,2560,1,102400) *************** [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_23 (PointWise) [07/29/2021-16:42:19] [V] [TRT] Tactic: 128 time 0.015848 [07/29/2021-16:42:19] [V] [TRT] Tactic: 256 time 0.016088 [07/29/2021-16:42:19] [V] [TRT] Tactic: 512 time 0.017056 [07/29/2021-16:42:19] [V] [TRT] Tactic: -32 time 0.02704 [07/29/2021-16:42:19] [V] [TRT] Tactic: -64 time 0.02042 [07/29/2021-16:42:19] [V] [TRT] Tactic: -128 time 0.018052 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 128 Time: 0.015848 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_23 (PointWiseV2) [07/29/2021-16:42:19] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:19] [V] [TRT] [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,3200) -> Float(1,40,1600:32,3200) *************** [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_23 (PointWise) [07/29/2021-16:42:19] [V] [TRT] Tactic: 128 time 0.015768 [07/29/2021-16:42:19] [V] [TRT] Tactic: 256 time 0.016124 [07/29/2021-16:42:19] [V] [TRT] Tactic: 512 time 0.017352 [07/29/2021-16:42:19] [V] [TRT] Tactic: -32 time 0.02684 [07/29/2021-16:42:19] [V] [TRT] Tactic: -64 time 0.020484 [07/29/2021-16:42:19] [V] [TRT] Tactic: -128 time 0.01824 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 128 Time: 0.015768 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_23 (PointWiseV2) [07/29/2021-16:42:19] [V] [TRT] Tactic: 24 time 0.009872 [07/29/2021-16:42:19] [V] [TRT] Tactic: 25 time 0.009524 [07/29/2021-16:42:19] [V] [TRT] Tactic: 26 time 0.009052 [07/29/2021-16:42:19] [V] [TRT] Tactic: 27 time 0.008588 [07/29/2021-16:42:19] [V] [TRT] Tactic: 31 time 0.009712 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 27 Time: 0.008588 [07/29/2021-16:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [07/29/2021-16:42:19] [V] [TRT] [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [07/29/2021-16:42:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (CaskConvolution) [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 1754569683116234317 time 0.036048 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 1825138533642645384 time 0.035868 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 2733356012094739613 time 0.031396 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 3915320020053085238 time 0.0359 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 6808617066150061604 time 0.031528 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 9091006216302412844 time 0.031008 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -8060443123034038864 time 0.031928 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -4420849921117327522 time 0.03982 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -3946921629105938337 time 0.034276 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.031008 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (CudaConvolution) [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.059144 [07/29/2021-16:42:19] [V] [TRT] Tactic: 1 time 0.0454 [07/29/2021-16:42:19] [V] [TRT] Tactic: 2 time 0.103516 [07/29/2021-16:42:19] [V] [TRT] Tactic: 4 skipped. Scratch requested: 294158336, available: 16777216 [07/29/2021-16:42:19] [V] [TRT] Tactic: 5 skipped. Scratch requested: 17825792, available: 16777216 [07/29/2021-16:42:19] [V] [TRT] Tactic: 56 time 0.059172 [07/29/2021-16:42:19] [V] [TRT] Tactic: 57 time 0.045352 [07/29/2021-16:42:19] [V] [TRT] Tactic: 58 time 0.102992 [07/29/2021-16:42:19] [V] [TRT] Tactic: 60 skipped. Scratch requested: 294158336, available: 16777216 [07/29/2021-16:42:19] [V] [TRT] Tactic: 61 skipped. Scratch requested: 17825792, available: 16777216 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 57 Time: 0.045352 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [07/29/2021-16:42:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (CublasConvolution) [07/29/2021-16:42:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(64,2560,1,102400) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (FusedConvActConvolution) [07/29/2021-16:42:19] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (CaskConvolution) [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 861694390046228376 time 0.038536 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 5258189349241541167 time 0.033196 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 5821621277990374316 time 0.038364 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: 5863767799113001648 time 0.046336 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -9147980667639709536 time 0.037976 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -8892196987859366827 time 0.037448 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -8850904373104590857 time 0.033432 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -8010679767156598961 time 0.045708 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -7751035352149795660 time 0.037888 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -5115676123557684531 time 0.038044 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -493597327599791285 time 0.0347 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Tactic: -423878181466897819 time 0.045928 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 5258189349241541167 Time: 0.033196 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (CudaConvolution) [07/29/2021-16:42:19] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (CudaDepthwiseConvolution) [07/29/2021-16:42:19] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: Conv_24 (CublasConvolution) [07/29/2021-16:42:19] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5258189349241541167 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.034412 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.043016 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.034412 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.038792 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.062268 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.038792 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.03534 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.044232 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.03534 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.050092 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.078008 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 1002 Time: 0.050092 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.049532 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.0427 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.0427 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:19] [V] [TRT] Tactic: 1002 time 0.04796 [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.032968 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.032968 [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_25 (PointWise) [07/29/2021-16:42:19] [V] [TRT] Tactic: 128 time 0.033328 [07/29/2021-16:42:19] [V] [TRT] Tactic: 256 time 0.033704 [07/29/2021-16:42:19] [V] [TRT] Tactic: 512 time 0.0357 [07/29/2021-16:42:19] [V] [TRT] Tactic: -32 time 0.066192 [07/29/2021-16:42:19] [V] [TRT] Tactic: -64 time 0.045616 [07/29/2021-16:42:19] [V] [TRT] Tactic: -128 time 0.036848 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 128 Time: 0.033328 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [07/29/2021-16:42:19] [V] [TRT] Tactic: 0 time 0.031072 [07/29/2021-16:42:19] [V] [TRT] Tactic: 1 time 0.033252 [07/29/2021-16:42:19] [V] [TRT] Tactic: 2 time 0.031488 [07/29/2021-16:42:19] [V] [TRT] Tactic: 3 time 0.035336 [07/29/2021-16:42:19] [V] [TRT] Tactic: 4 time 0.032512 [07/29/2021-16:42:19] [V] [TRT] Tactic: 5 time 0.032892 [07/29/2021-16:42:19] [V] [TRT] Tactic: 6 time 0.03802 [07/29/2021-16:42:19] [V] [TRT] Tactic: 7 time 0.033784 [07/29/2021-16:42:19] [V] [TRT] Tactic: 8 time 0.03298 [07/29/2021-16:42:19] [V] [TRT] Tactic: 9 time 0.03194 [07/29/2021-16:42:19] [V] [TRT] Tactic: 28 time 0.031484 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 0 Time: 0.031072 [07/29/2021-16:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 0 [07/29/2021-16:42:19] [V] [TRT] [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_25 (PointWise) [07/29/2021-16:42:19] [V] [TRT] Tactic: 128 time 0.033308 [07/29/2021-16:42:19] [V] [TRT] Tactic: 256 time 0.03326 [07/29/2021-16:42:19] [V] [TRT] Tactic: 512 time 0.035724 [07/29/2021-16:42:19] [V] [TRT] Tactic: -32 time 0.066092 [07/29/2021-16:42:19] [V] [TRT] Tactic: -64 time 0.045764 [07/29/2021-16:42:19] [V] [TRT] Tactic: -128 time 0.03688 [07/29/2021-16:42:19] [V] [TRT] Fastest Tactic: 256 Time: 0.03326 [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [07/29/2021-16:42:19] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:19] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [07/29/2021-16:42:19] [V] [TRT] [07/29/2021-16:42:19] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:19] [V] [TRT] --------------- Timing Runner: LeakyRelu_25 (PointWise) [07/29/2021-16:42:19] [V] [TRT] Tactic: 128 time 0.03344 [07/29/2021-16:42:19] [V] [TRT] Tactic: 256 time 0.03364 [07/29/2021-16:42:19] [V] [TRT] Tactic: 512 time 0.035428 [07/29/2021-16:42:20] [V] [TRT] Tactic: -32 time 0.06604 [07/29/2021-16:42:20] [V] [TRT] Tactic: -64 time 0.045752 [07/29/2021-16:42:20] [V] [TRT] Tactic: -128 time 0.036868 [07/29/2021-16:42:20] [V] [TRT] Fastest Tactic: 128 Time: 0.03344 [07/29/2021-16:42:20] [V] [TRT] --------------- Timing Runner: LeakyRelu_25 (PointWiseV2) [07/29/2021-16:42:20] [V] [TRT] Tactic: 24 time 0.032984 [07/29/2021-16:42:20] [V] [TRT] Tactic: 25 time 0.034868 [07/29/2021-16:42:20] [V] [TRT] Tactic: 26 time 0.03608 [07/29/2021-16:42:20] [V] [TRT] Tactic: 27 time 0.034088 [07/29/2021-16:42:20] [V] [TRT] Tactic: 31 time 0.033008 [07/29/2021-16:42:20] [V] [TRT] Fastest Tactic: 24 Time: 0.032984 [07/29/2021-16:42:20] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/29/2021-16:42:20] [V] [TRT] [07/29/2021-16:42:20] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:20] [V] [TRT] --------------- Timing Runner: Conv_26 (FusedConvActConvolution) [07/29/2021-16:42:20] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:20] [V] [TRT] --------------- Timing Runner: Conv_26 (CaskConvolution) [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: 1825138533642645384 time 1.90886 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: 2775507031594384867 time 1.68972 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: 2842488832350522458 time 1.36522 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: 3915320020053085238 time 1.90761 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: 6448355332020552203 time 2.47926 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: 6808617066150061604 time 1.36926 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: -8060443123034038864 time 1.39057 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: -4420849921117327522 time 0.894744 [07/29/2021-16:42:20] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:20] [V] [TRT] Tactic: -3946921629105938337 time 1.18319 [07/29/2021-16:42:20] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.894744 [07/29/2021-16:42:20] [V] [TRT] --------------- Timing Runner: Conv_26 (CudaConvolution) [07/29/2021-16:42:20] [V] [TRT] Tactic: 0 time 0.335564 [07/29/2021-16:42:20] [V] [TRT] Tactic: 1 time 0.332844 [07/29/2021-16:42:20] [V] [TRT] Tactic: 2 time 0.658 [07/29/2021-16:42:20] [V] [TRT] Tactic: 4 time 4.8311 [07/29/2021-16:42:20] [V] [TRT] Tactic: 5 time 7.53488 [07/29/2021-16:42:20] [V] [TRT] Tactic: 6 time 2.79236 [07/29/2021-16:42:20] [V] [TRT] Tactic: 56 time 0.3392 [07/29/2021-16:42:20] [V] [TRT] Tactic: 57 time 0.339376 [07/29/2021-16:42:20] [V] [TRT] Tactic: 58 time 0.646192 [07/29/2021-16:42:20] [V] [TRT] Tactic: 60 time 4.82359 [07/29/2021-16:42:21] [V] [TRT] Tactic: 61 time 7.44232 [07/29/2021-16:42:21] [V] [TRT] Tactic: 62 time 2.7501 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 1 Time: 0.332844 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_26 (CudaDepthwiseConvolution) [07/29/2021-16:42:21] [V] [TRT] Tactic: -1 time 0.041132 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: -1 Time: 0.041132 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_26 (CublasConvolution) [07/29/2021-16:42:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:21] [V] [TRT] [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_26 (FusedConvActConvolution) [07/29/2021-16:42:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_26 (CaskConvolution) [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 861694390046228376 time 4.06758 [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 5821621277990374316 time 4.07705 [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -3853827649136781465 time 4.09507 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 4.06758 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_26 (CudaConvolution) [07/29/2021-16:42:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_26 (CudaDepthwiseConvolution) [07/29/2021-16:42:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_26 (CublasConvolution) [07/29/2021-16:42:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_26 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (FusedConvActConvolution) [07/29/2021-16:42:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (CaskConvolution) [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 1754569683116234317 time 0.056192 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 1825138533642645384 time 0.055824 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 2733356012094739613 time 0.049976 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 3915320020053085238 time 0.055868 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 6808617066150061604 time 0.049608 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 9091006216302412844 time 0.047008 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -8060443123034038864 time 0.050212 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -4420849921117327522 time 0.066164 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -3946921629105938337 time 0.053572 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.047008 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaConvolution) [07/29/2021-16:42:21] [V] [TRT] Tactic: 0 time 0.087184 [07/29/2021-16:42:21] [V] [TRT] Tactic: 1 time 0.063876 [07/29/2021-16:42:21] [V] [TRT] Tactic: 2 time 0.166832 [07/29/2021-16:42:21] [V] [TRT] Tactic: 4 skipped. Scratch requested: 588316672, available: 16777216 [07/29/2021-16:42:21] [V] [TRT] Tactic: 5 skipped. Scratch requested: 24510464, available: 16777216 [07/29/2021-16:42:21] [V] [TRT] Tactic: 56 time 0.087704 [07/29/2021-16:42:21] [V] [TRT] Tactic: 57 time 0.063616 [07/29/2021-16:42:21] [V] [TRT] Tactic: 58 time 0.166576 [07/29/2021-16:42:21] [V] [TRT] Tactic: 60 skipped. Scratch requested: 588316672, available: 16777216 [07/29/2021-16:42:21] [V] [TRT] Tactic: 61 skipped. Scratch requested: 24510464, available: 16777216 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 57 Time: 0.063616 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) [07/29/2021-16:42:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (CublasConvolution) [07/29/2021-16:42:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (FusedConvActConvolution) [07/29/2021-16:42:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (CaskConvolution) [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 861694390046228376 time 0.06006 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 5258189349241541167 time 0.053012 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 5821621277990374316 time 0.059896 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 5863767799113001648 time 0.061336 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -9147980667639709536 time 0.058212 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -8892196987859366827 time 0.05846 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -8850904373104590857 time 0.053188 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -8010679767156598961 time 0.060292 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -7751035352149795660 time 0.058444 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -5115676123557684531 time 0.059592 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -493597327599791285 time 0.049788 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: -423878181466897819 time 0.061412 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: -493597327599791285 Time: 0.049788 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaConvolution) [07/29/2021-16:42:21] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (CudaDepthwiseConvolution) [07/29/2021-16:42:21] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_28 (CublasConvolution) [07/29/2021-16:42:21] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -493597327599791285 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,5120,1,204800) *************** [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,6400) -> Float(1,40,1600:32,6400) *************** [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:21] [V] [TRT] Tactic: 1002 time 0.034612 [07/29/2021-16:42:21] [V] [TRT] Tactic: 0 time 0.043036 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.034612 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:21] [V] [TRT] Tactic: 1002 time 0.038528 [07/29/2021-16:42:21] [V] [TRT] Tactic: 0 time 0.062224 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.038528 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:21] [V] [TRT] Tactic: 1002 time 0.035736 [07/29/2021-16:42:21] [V] [TRT] Tactic: 0 time 0.044756 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.035736 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:21] [V] [TRT] Tactic: 1002 time 0.050616 [07/29/2021-16:42:21] [V] [TRT] Tactic: 0 time 0.078716 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 1002 Time: 0.050616 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:21] [V] [TRT] Tactic: 1002 time 0.0496 [07/29/2021-16:42:21] [V] [TRT] Tactic: 0 time 0.042432 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.042432 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:21] [V] [TRT] Tactic: 1002 time 0.04816 [07/29/2021-16:42:21] [V] [TRT] Tactic: 0 time 0.033052 [07/29/2021-16:42:21] [V] [TRT] Fastest Tactic: 0 Time: 0.033052 [07/29/2021-16:42:21] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,20,400,51200) *************** [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [07/29/2021-16:42:21] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:21] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 1825138533642645384 time 1.32556 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 2842488832350522458 time 1.12603 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:21] [V] [TRT] Tactic: 3915320020053085238 time 1.30898 [07/29/2021-16:42:21] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 6448355332020552203 time 1.33171 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 6808617066150061604 time 1.0906 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: -8060443123034038864 time 1.11686 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: -4420849921117327522 time 0.808396 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: -3946921629105938337 time 1.04737 [07/29/2021-16:42:22] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.808396 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [07/29/2021-16:42:22] [V] [TRT] Tactic: 0 time 0.02192 [07/29/2021-16:42:22] [V] [TRT] Tactic: 1 time 0.0216 [07/29/2021-16:42:22] [V] [TRT] Tactic: 2 time 0.021852 [07/29/2021-16:42:22] [V] [TRT] Tactic: 5 time 6.83534 [07/29/2021-16:42:22] [V] [TRT] Tactic: 56 time 0.021844 [07/29/2021-16:42:22] [V] [TRT] Tactic: 57 time 0.021772 [07/29/2021-16:42:22] [V] [TRT] Tactic: 58 time 0.021648 [07/29/2021-16:42:22] [V] [TRT] Tactic: 61 time 6.93606 [07/29/2021-16:42:22] [V] [TRT] Fastest Tactic: 1 Time: 0.0216 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [07/29/2021-16:42:22] [V] [TRT] Tactic: -1 time 0.020716 [07/29/2021-16:42:22] [V] [TRT] Fastest Tactic: -1 Time: 0.020716 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_46 (CublasConvolution) [07/29/2021-16:42:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:22] [V] [TRT] [07/29/2021-16:42:22] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(128,2560,1,51200) *************** [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_46 (FusedConvActConvolution) [07/29/2021-16:42:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_46 (CaskConvolution) [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 861694390046228376 time 2.34857 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 5821621277990374316 time 2.33928 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: -3853827649136781465 time 2.37689 [07/29/2021-16:42:22] [V] [TRT] Fastest Tactic: 5821621277990374316 Time: 2.33928 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaConvolution) [07/29/2021-16:42:22] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_46 (CudaDepthwiseConvolution) [07/29/2021-16:42:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_46 (CublasConvolution) [07/29/2021-16:42:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5821621277990374316 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_46 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,204800) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_56 (FusedConvActConvolution) [07/29/2021-16:42:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_56 (CaskConvolution) [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 1754569683116234317 time 0.054576 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 1825138533642645384 time 0.054652 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 2733356012094739613 time 0.039992 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 3915320020053085238 time 0.054576 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 6808617066150061604 time 0.036244 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 9091006216302412844 time 0.033816 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: -8060443123034038864 time 0.036584 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: -4420849921117327522 time 0.034604 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: -3946921629105938337 time 0.038932 [07/29/2021-16:42:22] [V] [TRT] Fastest Tactic: 9091006216302412844 Time: 0.033816 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_56 (CudaConvolution) [07/29/2021-16:42:22] [V] [TRT] Tactic: 0 time 0.051792 [07/29/2021-16:42:22] [V] [TRT] Tactic: 1 time 0.043876 [07/29/2021-16:42:22] [V] [TRT] Tactic: 2 time 0.130016 [07/29/2021-16:42:22] [V] [TRT] Tactic: 4 skipped. Scratch requested: 311459840, available: 16777216 [07/29/2021-16:42:22] [V] [TRT] Tactic: 5 skipped. Scratch requested: 17825792, available: 16777216 [07/29/2021-16:42:22] [V] [TRT] Tactic: 56 time 0.051732 [07/29/2021-16:42:22] [V] [TRT] Tactic: 57 time 0.043972 [07/29/2021-16:42:22] [V] [TRT] Tactic: 58 time 0.130152 [07/29/2021-16:42:22] [V] [TRT] Tactic: 60 skipped. Scratch requested: 311459840, available: 16777216 [07/29/2021-16:42:22] [V] [TRT] Tactic: 61 skipped. Scratch requested: 17825792, available: 16777216 [07/29/2021-16:42:22] [V] [TRT] Fastest Tactic: 1 Time: 0.043876 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_56 (CudaDepthwiseConvolution) [07/29/2021-16:42:22] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_56 (CublasConvolution) [07/29/2021-16:42:22] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 9091006216302412844 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:22] [V] [TRT] *************** Autotuning format combination: Float(128,5120,1,204800) -> Float(64,2560,1,102400) *************** [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_56 (FusedConvActConvolution) [07/29/2021-16:42:22] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:22] [V] [TRT] --------------- Timing Runner: Conv_56 (CaskConvolution) [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 861694390046228376 time 0.056208 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 5258189349241541167 time 0.039312 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 5821621277990374316 time 0.056408 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: 5863767799113001648 time 0.041348 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:22] [V] [TRT] Tactic: -9147980667639709536 time 0.055244 [07/29/2021-16:42:22] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -8892196987859366827 time 0.055308 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -8850904373104590857 time 0.039636 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -8010679767156598961 time 0.040924 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -7751035352149795660 time 0.055208 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -5115676123557684531 time 0.056288 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -493597327599791285 time 0.036848 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -423878181466897819 time 0.041532 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: -493597327599791285 Time: 0.036848 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_56 (CudaConvolution) [07/29/2021-16:42:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_56 (CudaDepthwiseConvolution) [07/29/2021-16:42:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_56 (CublasConvolution) [07/29/2021-16:42:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -493597327599791285 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.008916 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.011996 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.008916 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.012424 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.0188 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.012424 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.008872 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.012516 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.008872 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.016544 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.023444 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.016544 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.018216 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.012836 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 0 Time: 0.012836 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.016572 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.008324 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 0 Time: 0.008324 [07/29/2021-16:42:23] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,51200) -> Float(1,20,400,51200) *************** [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_47 (PointWise) [07/29/2021-16:42:23] [V] [TRT] Tactic: 128 time 0.011016 [07/29/2021-16:42:23] [V] [TRT] Tactic: 256 time 0.0107 [07/29/2021-16:42:23] [V] [TRT] Tactic: 512 time 0.010932 [07/29/2021-16:42:23] [V] [TRT] Tactic: -32 time 0.025568 [07/29/2021-16:42:23] [V] [TRT] Tactic: -64 time 0.016076 [07/29/2021-16:42:23] [V] [TRT] Tactic: -128 time 0.011928 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 256 Time: 0.0107 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.007756 [07/29/2021-16:42:23] [V] [TRT] Tactic: 1 time 0.006412 [07/29/2021-16:42:23] [V] [TRT] Tactic: 2 time 0.006676 [07/29/2021-16:42:23] [V] [TRT] Tactic: 3 time 0.006532 [07/29/2021-16:42:23] [V] [TRT] Tactic: 4 time 0.006372 [07/29/2021-16:42:23] [V] [TRT] Tactic: 5 time 0.006004 [07/29/2021-16:42:23] [V] [TRT] Tactic: 6 time 0.006684 [07/29/2021-16:42:23] [V] [TRT] Tactic: 7 time 0.00612 [07/29/2021-16:42:23] [V] [TRT] Tactic: 8 time 0.006024 [07/29/2021-16:42:23] [V] [TRT] Tactic: 9 time 0.006752 [07/29/2021-16:42:23] [V] [TRT] Tactic: 28 time 0.007456 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 5 Time: 0.006004 [07/29/2021-16:42:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/29/2021-16:42:23] [V] [TRT] [07/29/2021-16:42:23] [V] [TRT] *************** Autotuning format combination: Float(128,2560,1,51200) -> Float(128,2560,1,51200) *************** [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_47 (PointWise) [07/29/2021-16:42:23] [V] [TRT] Tactic: 128 time 0.010756 [07/29/2021-16:42:23] [V] [TRT] Tactic: 256 time 0.01072 [07/29/2021-16:42:23] [V] [TRT] Tactic: 512 time 0.010972 [07/29/2021-16:42:23] [V] [TRT] Tactic: -32 time 0.025768 [07/29/2021-16:42:23] [V] [TRT] Tactic: -64 time 0.016296 [07/29/2021-16:42:23] [V] [TRT] Tactic: -128 time 0.011788 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 256 Time: 0.01072 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [07/29/2021-16:42:23] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [07/29/2021-16:42:23] [V] [TRT] [07/29/2021-16:42:23] [V] [TRT] *************** Autotuning format combination: Float(1,20,400:32,1600) -> Float(1,20,400:32,1600) *************** [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_47 (PointWise) [07/29/2021-16:42:23] [V] [TRT] Tactic: 128 time 0.010708 [07/29/2021-16:42:23] [V] [TRT] Tactic: 256 time 0.010496 [07/29/2021-16:42:23] [V] [TRT] Tactic: 512 time 0.01096 [07/29/2021-16:42:23] [V] [TRT] Tactic: -32 time 0.025048 [07/29/2021-16:42:23] [V] [TRT] Tactic: -64 time 0.016148 [07/29/2021-16:42:23] [V] [TRT] Tactic: -128 time 0.012088 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 256 Time: 0.010496 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_47 (PointWiseV2) [07/29/2021-16:42:23] [V] [TRT] Tactic: 24 time 0.006804 [07/29/2021-16:42:23] [V] [TRT] Tactic: 25 time 0.006684 [07/29/2021-16:42:23] [V] [TRT] Tactic: 26 time 0.006568 [07/29/2021-16:42:23] [V] [TRT] Tactic: 27 time 0.007656 [07/29/2021-16:42:23] [V] [TRT] Tactic: 31 time 0.00678 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 26 Time: 0.006568 [07/29/2021-16:42:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [07/29/2021-16:42:23] [V] [TRT] [07/29/2021-16:42:23] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,51200) -> Float(1,20,400,102400) *************** [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [07/29/2021-16:42:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 1754569683116234317 time 0.03206 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 1825138533642645384 time 0.032264 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 2733356012094739613 time 0.033872 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 3915320020053085238 time 0.032136 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 6808617066150061604 time 0.03424 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 9091006216302412844 time 0.032696 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -8060443123034038864 time 0.034784 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -4420849921117327522 time 0.032064 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -3946921629105938337 time 0.036176 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.03206 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (CudaConvolution) [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.051424 [07/29/2021-16:42:23] [V] [TRT] Tactic: 1 time 0.040996 [07/29/2021-16:42:23] [V] [TRT] Tactic: 2 time 0.089132 [07/29/2021-16:42:23] [V] [TRT] Tactic: 4 skipped. Scratch requested: 294256640, available: 16777216 [07/29/2021-16:42:23] [V] [TRT] Tactic: 5 time 0.159956 [07/29/2021-16:42:23] [V] [TRT] Tactic: 56 time 0.05114 [07/29/2021-16:42:23] [V] [TRT] Tactic: 57 time 0.041376 [07/29/2021-16:42:23] [V] [TRT] Tactic: 58 time 0.08896 [07/29/2021-16:42:23] [V] [TRT] Tactic: 60 skipped. Scratch requested: 294256640, available: 16777216 [07/29/2021-16:42:23] [V] [TRT] Tactic: 61 time 0.159912 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1 Time: 0.040996 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [07/29/2021-16:42:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (CublasConvolution) [07/29/2021-16:42:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:23] [V] [TRT] *************** Autotuning format combination: Float(128,2560,1,51200) -> Float(256,5120,1,102400) *************** [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [07/29/2021-16:42:23] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 861694390046228376 time 0.031096 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 5258189349241541167 time 0.033172 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 5821621277990374316 time 0.031484 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: 5863767799113001648 time 0.036576 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -9147980667639709536 time 0.031212 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -8892196987859366827 time 0.031296 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -8850904373104590857 time 0.032932 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -8010679767156598961 time 0.036412 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -7751035352149795660 time 0.031452 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -5115676123557684531 time 0.031196 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -493597327599791285 time 0.031712 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Tactic: -423878181466897819 time 0.036628 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 861694390046228376 Time: 0.031096 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (CudaConvolution) [07/29/2021-16:42:23] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [07/29/2021-16:42:23] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: Conv_48 (CublasConvolution) [07/29/2021-16:42:23] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 861694390046228376 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.01202 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.018288 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.01202 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.017644 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.032084 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.017644 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.01212 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.020376 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.01212 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.024448 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.0412 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 1002 Time: 0.024448 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.02954 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.021012 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 0 Time: 0.021012 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:23] [V] [TRT] Tactic: 1002 time 0.024608 [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.013412 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 0 Time: 0.013412 [07/29/2021-16:42:23] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,102400) -> Float(1,20,400,102400) *************** [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_49 (PointWise) [07/29/2021-16:42:23] [V] [TRT] Tactic: 128 time 0.015912 [07/29/2021-16:42:23] [V] [TRT] Tactic: 256 time 0.015972 [07/29/2021-16:42:23] [V] [TRT] Tactic: 512 time 0.016604 [07/29/2021-16:42:23] [V] [TRT] Tactic: -32 time 0.02718 [07/29/2021-16:42:23] [V] [TRT] Tactic: -64 time 0.020584 [07/29/2021-16:42:23] [V] [TRT] Tactic: -128 time 0.018224 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 128 Time: 0.015912 [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_49 (PointWiseV2) [07/29/2021-16:42:23] [V] [TRT] Tactic: 0 time 0.010736 [07/29/2021-16:42:23] [V] [TRT] Tactic: 1 time 0.008672 [07/29/2021-16:42:23] [V] [TRT] Tactic: 2 time 0.008584 [07/29/2021-16:42:23] [V] [TRT] Tactic: 3 time 0.008408 [07/29/2021-16:42:23] [V] [TRT] Tactic: 4 time 0.00746 [07/29/2021-16:42:23] [V] [TRT] Tactic: 5 time 0.0076 [07/29/2021-16:42:23] [V] [TRT] Tactic: 6 time 0.008584 [07/29/2021-16:42:23] [V] [TRT] Tactic: 7 time 0.007856 [07/29/2021-16:42:23] [V] [TRT] Tactic: 8 time 0.006524 [07/29/2021-16:42:23] [V] [TRT] Tactic: 9 time 0.007256 [07/29/2021-16:42:23] [V] [TRT] Tactic: 28 time 0.01018 [07/29/2021-16:42:23] [V] [TRT] Fastest Tactic: 8 Time: 0.006524 [07/29/2021-16:42:23] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/29/2021-16:42:23] [V] [TRT] [07/29/2021-16:42:23] [V] [TRT] *************** Autotuning format combination: Float(256,5120,1,102400) -> Float(256,5120,1,102400) *************** [07/29/2021-16:42:23] [V] [TRT] --------------- Timing Runner: LeakyRelu_49 (PointWise) [07/29/2021-16:42:23] [V] [TRT] Tactic: 128 time 0.015772 [07/29/2021-16:42:24] [V] [TRT] Tactic: 256 time 0.016072 [07/29/2021-16:42:24] [V] [TRT] Tactic: 512 time 0.01698 [07/29/2021-16:42:24] [V] [TRT] Tactic: -32 time 0.026684 [07/29/2021-16:42:24] [V] [TRT] Tactic: -64 time 0.020504 [07/29/2021-16:42:24] [V] [TRT] Tactic: -128 time 0.018204 [07/29/2021-16:42:24] [V] [TRT] Fastest Tactic: 128 Time: 0.015772 [07/29/2021-16:42:24] [V] [TRT] --------------- Timing Runner: LeakyRelu_49 (PointWiseV2) [07/29/2021-16:42:24] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:24] [V] [TRT] [07/29/2021-16:42:24] [V] [TRT] *************** Autotuning format combination: Float(1,20,400:32,3200) -> Float(1,20,400:32,3200) *************** [07/29/2021-16:42:24] [V] [TRT] --------------- Timing Runner: LeakyRelu_49 (PointWise) [07/29/2021-16:42:24] [V] [TRT] Tactic: 128 time 0.015808 [07/29/2021-16:42:24] [V] [TRT] Tactic: 256 time 0.016056 [07/29/2021-16:42:24] [V] [TRT] Tactic: 512 time 0.01678 [07/29/2021-16:42:24] [V] [TRT] Tactic: -32 time 0.02706 [07/29/2021-16:42:24] [V] [TRT] Tactic: -64 time 0.020332 [07/29/2021-16:42:24] [V] [TRT] Tactic: -128 time 0.0179 [07/29/2021-16:42:24] [V] [TRT] Fastest Tactic: 128 Time: 0.015808 [07/29/2021-16:42:24] [V] [TRT] --------------- Timing Runner: LeakyRelu_49 (PointWiseV2) [07/29/2021-16:42:24] [V] [TRT] Tactic: 24 time 0.009572 [07/29/2021-16:42:24] [V] [TRT] Tactic: 25 time 0.009604 [07/29/2021-16:42:24] [V] [TRT] Tactic: 26 time 0.008868 [07/29/2021-16:42:24] [V] [TRT] Tactic: 27 time 0.008776 [07/29/2021-16:42:24] [V] [TRT] Tactic: 31 time 0.00978 [07/29/2021-16:42:24] [V] [TRT] Fastest Tactic: 27 Time: 0.008776 [07/29/2021-16:42:24] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [07/29/2021-16:42:24] [V] [TRT] [07/29/2021-16:42:24] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,102400) -> Float(1,20,400,102400) *************** [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:24] [V] [TRT] --------------- Timing Runner: Conv_50 (FusedConvActConvolution) [07/29/2021-16:42:24] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:24] [V] [TRT] --------------- Timing Runner: Conv_50 (CaskConvolution) [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: 1825138533642645384 time 2.60298 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: 2775507031594384867 time 1.83994 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: 2842488832350522458 time 2.23379 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: 3915320020053085238 time 2.53051 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: 6448355332020552203 time 2.62261 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: 6808617066150061604 time 2.08794 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: -8060443123034038864 time 2.21361 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: -4420849921117327522 time 1.52328 [07/29/2021-16:42:24] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:24] [V] [TRT] Tactic: -3946921629105938337 time 1.95191 [07/29/2021-16:42:24] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 1.52328 [07/29/2021-16:42:24] [V] [TRT] --------------- Timing Runner: Conv_50 (CudaConvolution) [07/29/2021-16:42:24] [V] [TRT] Tactic: 0 time 0.0284 [07/29/2021-16:42:24] [V] [TRT] Tactic: 1 time 0.028404 [07/29/2021-16:42:24] [V] [TRT] Tactic: 2 time 0.028408 [07/29/2021-16:42:24] [V] [TRT] Tactic: 4 time 4.72805 [07/29/2021-16:42:24] [V] [TRT] Tactic: 5 time 7.56114 [07/29/2021-16:42:25] [V] [TRT] Tactic: 6 time 2.41638 [07/29/2021-16:42:25] [V] [TRT] Tactic: 56 time 0.028308 [07/29/2021-16:42:25] [V] [TRT] Tactic: 57 time 0.028148 [07/29/2021-16:42:25] [V] [TRT] Tactic: 58 time 0.028352 [07/29/2021-16:42:25] [V] [TRT] Tactic: 60 time 4.67311 [07/29/2021-16:42:25] [V] [TRT] Tactic: 61 time 7.60498 [07/29/2021-16:42:25] [V] [TRT] Tactic: 62 time 2.4106 [07/29/2021-16:42:25] [V] [TRT] Fastest Tactic: 57 Time: 0.028148 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_50 (CudaDepthwiseConvolution) [07/29/2021-16:42:25] [V] [TRT] Tactic: -1 time 0.019776 [07/29/2021-16:42:25] [V] [TRT] Fastest Tactic: -1 Time: 0.019776 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_50 (CublasConvolution) [07/29/2021-16:42:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [07/29/2021-16:42:25] [V] [TRT] [07/29/2021-16:42:25] [V] [TRT] *************** Autotuning format combination: Float(256,5120,1,102400) -> Float(256,5120,1,102400) *************** [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_50 (FusedConvActConvolution) [07/29/2021-16:42:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_50 (CaskConvolution) [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 861694390046228376 time 4.65954 [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 5821621277990374316 time 4.63711 [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -3853827649136781465 time 4.72491 [07/29/2021-16:42:25] [V] [TRT] Fastest Tactic: 5821621277990374316 Time: 4.63711 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_50 (CudaConvolution) [07/29/2021-16:42:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_50 (CudaDepthwiseConvolution) [07/29/2021-16:42:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_50 (CublasConvolution) [07/29/2021-16:42:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5821621277990374316 [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_50 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,102400) -> Float(1,20,400,102400) *************** [07/29/2021-16:42:25] [V] [TRT] *************** Autotuning format combination: Float(256,5120,1,102400) -> Float(256,5120,1,102400) *************** [07/29/2021-16:42:25] [V] [TRT] *************** Autotuning format combination: Float(1,20,400:32,3200) -> Float(1,20,400:32,3200) *************** [07/29/2021-16:42:25] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,102400) -> Float(1,20,400,102400) *************** [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (FusedConvActConvolution) [07/29/2021-16:42:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (CaskConvolution) [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 1754569683116234317 time 0.052596 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 1825138533642645384 time 0.052932 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 2733356012094739613 time 0.056456 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 3915320020053085238 time 0.05278 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 6808617066150061604 time 0.056812 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 9091006216302412844 time 0.053748 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -8060443123034038864 time 0.057792 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -4420849921117327522 time 0.054552 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -3946921629105938337 time 0.061708 [07/29/2021-16:42:25] [V] [TRT] Fastest Tactic: 1754569683116234317 Time: 0.052596 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (CudaConvolution) [07/29/2021-16:42:25] [V] [TRT] Tactic: 0 time 0.085472 [07/29/2021-16:42:25] [V] [TRT] Tactic: 1 time 0.06324 [07/29/2021-16:42:25] [V] [TRT] Tactic: 2 time 0.21212 [07/29/2021-16:42:25] [V] [TRT] Tactic: 4 skipped. Scratch requested: 588513280, available: 16777216 [07/29/2021-16:42:25] [V] [TRT] Tactic: 5 skipped. Scratch requested: 20054016, available: 16777216 [07/29/2021-16:42:25] [V] [TRT] Tactic: 56 time 0.085196 [07/29/2021-16:42:25] [V] [TRT] Tactic: 57 time 0.063716 [07/29/2021-16:42:25] [V] [TRT] Tactic: 58 time 0.211224 [07/29/2021-16:42:25] [V] [TRT] Tactic: 60 skipped. Scratch requested: 588513280, available: 16777216 [07/29/2021-16:42:25] [V] [TRT] Tactic: 61 skipped. Scratch requested: 20054016, available: 16777216 [07/29/2021-16:42:25] [V] [TRT] Fastest Tactic: 1 Time: 0.06324 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (CudaDepthwiseConvolution) [07/29/2021-16:42:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (CublasConvolution) [07/29/2021-16:42:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1754569683116234317 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:25] [V] [TRT] *************** Autotuning format combination: Float(256,5120,1,102400) -> Float(256,5120,1,102400) *************** [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (FusedConvActConvolution) [07/29/2021-16:42:25] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (CaskConvolution) [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 861694390046228376 time 0.053204 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 5258189349241541167 time 0.05528 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 5821621277990374316 time 0.053124 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: 5863767799113001648 time 0.05454 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -9147980667639709536 time 0.053304 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -8892196987859366827 time 0.052792 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -8850904373104590857 time 0.055032 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -8010679767156598961 time 0.05374 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -7751035352149795660 time 0.053548 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -5115676123557684531 time 0.053064 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -493597327599791285 time 0.05304 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] Tactic: -423878181466897819 time 0.054772 [07/29/2021-16:42:25] [V] [TRT] Fastest Tactic: -8892196987859366827 Time: 0.052792 [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (CudaConvolution) [07/29/2021-16:42:25] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (CudaDepthwiseConvolution) [07/29/2021-16:42:25] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] --------------- Timing Runner: Conv_52 (CublasConvolution) [07/29/2021-16:42:25] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:25] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8892196987859366827 [07/29/2021-16:42:25] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:25] [V] [TRT] [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,102400) -> Float(1,20,400,102400) *************** [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(256,5120,1,102400) -> Float(256,5120,1,102400) *************** [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(1,20,400:32,3200) -> Float(1,20,400:32,3200) *************** [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,102400) -> Float(1,20,400,25600) *************** [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (FusedConvActConvolution) [07/29/2021-16:42:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (CaskConvolution) [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 1754569683116234317 time 0.051764 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 1825138533642645384 time 0.052288 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 2733356012094739613 time 0.039492 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 3915320020053085238 time 0.051936 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 6808617066150061604 time 0.03446 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 9091006216302412844 time 0.03264 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -8060443123034038864 time 0.035288 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -4420849921117327522 time 0.031944 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -3946921629105938337 time 0.039644 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.031944 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (CudaConvolution) [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.030824 [07/29/2021-16:42:26] [V] [TRT] Tactic: 1 time 0.030788 [07/29/2021-16:42:26] [V] [TRT] Tactic: 2 time 0.286832 [07/29/2021-16:42:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 160497664, available: 16777216 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5 time 0.104628 [07/29/2021-16:42:26] [V] [TRT] Tactic: 56 time 0.031016 [07/29/2021-16:42:26] [V] [TRT] Tactic: 57 time 0.03094 [07/29/2021-16:42:26] [V] [TRT] Tactic: 58 time 0.286648 [07/29/2021-16:42:26] [V] [TRT] Tactic: 60 skipped. Scratch requested: 160497664, available: 16777216 [07/29/2021-16:42:26] [V] [TRT] Tactic: 61 time 0.104644 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1 Time: 0.030788 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (CudaDepthwiseConvolution) [07/29/2021-16:42:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (CublasConvolution) [07/29/2021-16:42:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 1 [07/29/2021-16:42:26] [V] [TRT] [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(256,5120,1,102400) -> Float(64,1280,1,25600) *************** [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (FusedConvActConvolution) [07/29/2021-16:42:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (CaskConvolution) [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 861694390046228376 time 0.051448 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5258189349241541167 time 0.031052 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5821621277990374316 time 0.051332 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5863767799113001648 time 0.02114 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -9147980667639709536 time 0.051008 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -8892196987859366827 time 0.050636 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -8850904373104590857 time 0.030928 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -8010679767156598961 time 0.021144 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -7751035352149795660 time 0.0509 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -5115676123557684531 time 0.051024 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -493597327599791285 time 0.030184 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -423878181466897819 time 0.021096 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: -423878181466897819 Time: 0.021096 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (CudaConvolution) [07/29/2021-16:42:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (CudaDepthwiseConvolution) [07/29/2021-16:42:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_58 (CublasConvolution) [07/29/2021-16:42:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -423878181466897819 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_58 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.007104 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.00786 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.007104 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.00836 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.011944 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.00836 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.00712 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.009368 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.00712 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.01098 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.014404 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.01098 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.012728 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.009528 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.009528 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.010864 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.00664 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.00664 [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,25600) -> Float(1,20,400,25600) *************** [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: LeakyRelu_59 (PointWise) [07/29/2021-16:42:26] [V] [TRT] Tactic: 128 time 0.007928 [07/29/2021-16:42:26] [V] [TRT] Tactic: 256 time 0.00784 [07/29/2021-16:42:26] [V] [TRT] Tactic: 512 time 0.007832 [07/29/2021-16:42:26] [V] [TRT] Tactic: -32 time 0.024776 [07/29/2021-16:42:26] [V] [TRT] Tactic: -64 time 0.015668 [07/29/2021-16:42:26] [V] [TRT] Tactic: -128 time 0.010804 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 512 Time: 0.007832 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: LeakyRelu_59 (PointWiseV2) [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.0061 [07/29/2021-16:42:26] [V] [TRT] Tactic: 1 time 0.005908 [07/29/2021-16:42:26] [V] [TRT] Tactic: 2 time 0.005628 [07/29/2021-16:42:26] [V] [TRT] Tactic: 3 time 0.005844 [07/29/2021-16:42:26] [V] [TRT] Tactic: 4 time 0.005532 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5 time 0.005396 [07/29/2021-16:42:26] [V] [TRT] Tactic: 6 time 0.006312 [07/29/2021-16:42:26] [V] [TRT] Tactic: 7 time 0.00576 [07/29/2021-16:42:26] [V] [TRT] Tactic: 8 time 0.005756 [07/29/2021-16:42:26] [V] [TRT] Tactic: 9 time 0.005736 [07/29/2021-16:42:26] [V] [TRT] Tactic: 28 time 0.006076 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 5 Time: 0.005396 [07/29/2021-16:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/29/2021-16:42:26] [V] [TRT] [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(64,1280,1,25600) -> Float(64,1280,1,25600) *************** [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: LeakyRelu_59 (PointWise) [07/29/2021-16:42:26] [V] [TRT] Tactic: 128 time 0.007796 [07/29/2021-16:42:26] [V] [TRT] Tactic: 256 time 0.007892 [07/29/2021-16:42:26] [V] [TRT] Tactic: 512 time 0.007804 [07/29/2021-16:42:26] [V] [TRT] Tactic: -32 time 0.024884 [07/29/2021-16:42:26] [V] [TRT] Tactic: -64 time 0.015676 [07/29/2021-16:42:26] [V] [TRT] Tactic: -128 time 0.01058 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 128 Time: 0.007796 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: LeakyRelu_59 (PointWiseV2) [07/29/2021-16:42:26] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:26] [V] [TRT] [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(1,20,400:32,800) -> Float(1,20,400:32,800) *************** [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: LeakyRelu_59 (PointWise) [07/29/2021-16:42:26] [V] [TRT] Tactic: 128 time 0.007924 [07/29/2021-16:42:26] [V] [TRT] Tactic: 256 time 0.007924 [07/29/2021-16:42:26] [V] [TRT] Tactic: 512 time 0.007944 [07/29/2021-16:42:26] [V] [TRT] Tactic: -32 time 0.024892 [07/29/2021-16:42:26] [V] [TRT] Tactic: -64 time 0.015636 [07/29/2021-16:42:26] [V] [TRT] Tactic: -128 time 0.01116 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 128 Time: 0.007924 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: LeakyRelu_59 (PointWiseV2) [07/29/2021-16:42:26] [V] [TRT] Tactic: 24 time 0.00586 [07/29/2021-16:42:26] [V] [TRT] Tactic: 25 time 0.005592 [07/29/2021-16:42:26] [V] [TRT] Tactic: 26 time 0.005884 [07/29/2021-16:42:26] [V] [TRT] Tactic: 27 time 0.0064 [07/29/2021-16:42:26] [V] [TRT] Tactic: 31 time 0.005756 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 25 Time: 0.005592 [07/29/2021-16:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [07/29/2021-16:42:26] [V] [TRT] [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.006736 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.007872 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.006736 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.009288 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.012072 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.009288 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.007112 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.009148 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.007112 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.010912 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.014848 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 1002 Time: 0.010912 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.012892 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.008936 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.008936 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:26] [V] [TRT] Tactic: 1002 time 0.01088 [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.006444 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 0 Time: 0.006444 [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,25600) -> Float(1,20,400,19200) *************** [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (FusedConvActConvolution) [07/29/2021-16:42:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (CaskConvolution) [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 1825138533642645384 time 0.107228 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 2775507031594384867 time 0.041228 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 2842488832350522458 time 0.071476 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 3915320020053085238 time 0.103392 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 6448355332020552203 time 0.108616 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 6808617066150061604 time 0.064408 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -8060443123034038864 time 0.07604 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -4420849921117327522 time 0.065744 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -3946921629105938337 time 0.07622 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.041228 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (CudaConvolution) [07/29/2021-16:42:26] [V] [TRT] Tactic: 0 time 0.056468 [07/29/2021-16:42:26] [V] [TRT] Tactic: 1 time 0.055944 [07/29/2021-16:42:26] [V] [TRT] Tactic: 2 time 0.108604 [07/29/2021-16:42:26] [V] [TRT] Tactic: 4 skipped. Scratch requested: 31305728, available: 16777216 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5 skipped. Scratch requested: 17268736, available: 16777216 [07/29/2021-16:42:26] [V] [TRT] Tactic: 6 time 0.046992 [07/29/2021-16:42:26] [V] [TRT] Tactic: 56 time 0.05618 [07/29/2021-16:42:26] [V] [TRT] Tactic: 57 time 0.056388 [07/29/2021-16:42:26] [V] [TRT] Tactic: 58 time 0.10934 [07/29/2021-16:42:26] [V] [TRT] Tactic: 60 skipped. Scratch requested: 31305728, available: 16777216 [07/29/2021-16:42:26] [V] [TRT] Tactic: 61 skipped. Scratch requested: 17268736, available: 16777216 [07/29/2021-16:42:26] [V] [TRT] Tactic: 62 time 0.046952 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: 62 Time: 0.046952 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (CudaDepthwiseConvolution) [07/29/2021-16:42:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (CublasConvolution) [07/29/2021-16:42:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:26] [V] [TRT] [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:26] [V] [TRT] *************** Autotuning format combination: Float(64,1280,1,25600) -> Float(48,960,1,19200) *************** [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (FusedConvActConvolution) [07/29/2021-16:42:26] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (CaskConvolution) [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 861694390046228376 time 0.103948 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 1017870653102653567 time 0.10394 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5258189349241541167 time 0.058156 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5821621277990374316 time 0.103056 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: 5863767799113001648 time 0.036348 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -9147980667639709536 time 0.103792 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -8850904373104590857 time 0.058916 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -7751035352149795660 time 0.102668 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -3853827649136781465 time 0.104844 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -3263369460438823196 time 0.058676 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] Tactic: -423878181466897819 time 0.036292 [07/29/2021-16:42:26] [V] [TRT] Fastest Tactic: -423878181466897819 Time: 0.036292 [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (CudaConvolution) [07/29/2021-16:42:26] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (CudaDepthwiseConvolution) [07/29/2021-16:42:26] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] --------------- Timing Runner: Conv_122 || Conv_123 (CublasConvolution) [07/29/2021-16:42:26] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:26] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -423878181466897819 [07/29/2021-16:42:26] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:26] [V] [TRT] [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] Conv_122 || Conv_123 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.00682 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.007552 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.00682 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.008656 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.011864 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.008656 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.007176 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.007272 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.007176 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.009136 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.013448 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.009136 [07/29/2021-16:42:27] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,25600) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: Resize_78 (Resize) [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 is the only option, timing skipped [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 0 Time: 0 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.011728 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.01992 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.011728 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.016072 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.032304 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.016072 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.006056 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.005608 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 0 Time: 0.005608 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.007792 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.008424 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.007792 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.006056 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.00586 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 0 Time: 0.00586 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.00712 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.008416 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 1002 Time: 0.00712 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.008004 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.006504 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 0 Time: 0.006504 [07/29/2021-16:42:27] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:27] [V] [TRT] Tactic: 1002 time 0.00808 [07/29/2021-16:42:27] [V] [TRT] Tactic: 0 time 0.005604 [07/29/2021-16:42:27] [V] [TRT] Fastest Tactic: 0 Time: 0.005604 [07/29/2021-16:42:27] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,19200) -> Float(1,20,400,6400) *************** [07/29/2021-16:42:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_124 (PointWise) [07/29/2021-16:42:29] [V] [TRT] Tactic: 128 time 0.010396 [07/29/2021-16:42:29] [V] [TRT] Tactic: 256 time 0.010656 [07/29/2021-16:42:29] [V] [TRT] Tactic: 512 time 0.011216 [07/29/2021-16:42:29] [V] [TRT] Tactic: -32 time 0.048628 [07/29/2021-16:42:29] [V] [TRT] Tactic: -64 time 0.02962 [07/29/2021-16:42:29] [V] [TRT] Tactic: -128 time 0.019752 [07/29/2021-16:42:29] [V] [TRT] Fastest Tactic: 128 Time: 0.010396 [07/29/2021-16:42:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [07/29/2021-16:42:29] [V] [TRT] Tactic: 0 time 0.008232 [07/29/2021-16:42:29] [V] [TRT] Tactic: 1 time 0.008468 [07/29/2021-16:42:29] [V] [TRT] Tactic: 2 time 0.008176 [07/29/2021-16:42:29] [V] [TRT] Tactic: 3 time 0.009128 [07/29/2021-16:42:29] [V] [TRT] Tactic: 4 time 0.008472 [07/29/2021-16:42:29] [V] [TRT] Tactic: 5 time 0.008216 [07/29/2021-16:42:29] [V] [TRT] Tactic: 6 time 0.011064 [07/29/2021-16:42:29] [V] [TRT] Tactic: 7 time 0.0093 [07/29/2021-16:42:29] [V] [TRT] Tactic: 8 time 0.008868 [07/29/2021-16:42:29] [V] [TRT] Tactic: 9 time 0.008408 [07/29/2021-16:42:29] [V] [TRT] Tactic: 28 time 0.008244 [07/29/2021-16:42:29] [V] [TRT] Fastest Tactic: 2 Time: 0.008176 [07/29/2021-16:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [07/29/2021-16:42:29] [V] [TRT] [07/29/2021-16:42:29] [V] [TRT] *************** Autotuning format combination: Float(48,960,1,19200) -> Float(16,320,1,6400) *************** [07/29/2021-16:42:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_124 (PointWise) [07/29/2021-16:42:29] [V] [TRT] Tactic: 128 time 0.010304 [07/29/2021-16:42:29] [V] [TRT] Tactic: 256 time 0.01054 [07/29/2021-16:42:29] [V] [TRT] Tactic: 512 time 0.011312 [07/29/2021-16:42:29] [V] [TRT] Fastest Tactic: 128 Time: 0.010304 [07/29/2021-16:42:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [07/29/2021-16:42:29] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:29] [V] [TRT] [07/29/2021-16:42:29] [V] [TRT] *************** Autotuning format combination: Float(1,20,400:32,800) -> Float(1,20,400:32,400) *************** [07/29/2021-16:42:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_124 (PointWise) [07/29/2021-16:42:29] [V] [TRT] Tactic: 128 time 0.01324 [07/29/2021-16:42:29] [V] [TRT] Tactic: 256 time 0.013196 [07/29/2021-16:42:29] [V] [TRT] Tactic: 512 time 0.013388 [07/29/2021-16:42:29] [V] [TRT] Tactic: -32 time 0.048128 [07/29/2021-16:42:29] [V] [TRT] Tactic: -64 time 0.030692 [07/29/2021-16:42:29] [V] [TRT] Tactic: -128 time 0.020396 [07/29/2021-16:42:29] [V] [TRT] Fastest Tactic: 256 Time: 0.013196 [07/29/2021-16:42:29] [V] [TRT] --------------- Timing Runner: LeakyRelu_124 (PointWiseV2) [07/29/2021-16:42:29] [V] [TRT] Tactic: 24 time 0.009032 [07/29/2021-16:42:29] [V] [TRT] Tactic: 25 time 0.009784 [07/29/2021-16:42:29] [V] [TRT] Tactic: 26 time 0.010872 [07/29/2021-16:42:29] [V] [TRT] Tactic: 27 time 0.01356 [07/29/2021-16:42:29] [V] [TRT] Tactic: 31 time 0.008956 [07/29/2021-16:42:29] [V] [TRT] Fastest Tactic: 31 Time: 0.008956 [07/29/2021-16:42:29] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/29/2021-16:42:29] [V] [TRT] [07/29/2021-16:42:29] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400), Float(1,40,1600,102400) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:32] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_57, Add_79) (PointWise) [07/29/2021-16:42:32] [V] [TRT] Tactic: 128 time 0.046812 [07/29/2021-16:42:32] [V] [TRT] Tactic: 256 time 0.04754 [07/29/2021-16:42:32] [V] [TRT] Tactic: 512 time 0.052468 [07/29/2021-16:42:32] [V] [TRT] Tactic: -32 time 0.092776 [07/29/2021-16:42:32] [V] [TRT] Tactic: -64 time 0.06552 [07/29/2021-16:42:32] [V] [TRT] Tactic: -128 time 0.058404 [07/29/2021-16:42:32] [V] [TRT] Fastest Tactic: 128 Time: 0.046812 [07/29/2021-16:42:32] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_57, Add_79) (PointWiseV2) [07/29/2021-16:42:32] [V] [TRT] Tactic: 0 time 0.028444 [07/29/2021-16:42:32] [V] [TRT] Tactic: 1 time 0.02744 [07/29/2021-16:42:32] [V] [TRT] Tactic: 2 time 0.025668 [07/29/2021-16:42:32] [V] [TRT] Tactic: 3 time 0.02826 [07/29/2021-16:42:32] [V] [TRT] Tactic: 4 time 0.026176 [07/29/2021-16:42:32] [V] [TRT] Tactic: 5 time 0.02586 [07/29/2021-16:42:32] [V] [TRT] Tactic: 6 time 0.031708 [07/29/2021-16:42:32] [V] [TRT] Tactic: 7 time 0.02772 [07/29/2021-16:42:32] [V] [TRT] Tactic: 8 time 0.0274 [07/29/2021-16:42:32] [V] [TRT] Tactic: 9 time 0.02694 [07/29/2021-16:42:32] [V] [TRT] Tactic: 28 time 0.028316 [07/29/2021-16:42:32] [V] [TRT] Fastest Tactic: 2 Time: 0.025668 [07/29/2021-16:42:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [07/29/2021-16:42:32] [V] [TRT] [07/29/2021-16:42:32] [V] [TRT] *************** Autotuning format combination: Float(64,2560,1,102400), Float(64,2560,1,102400) -> Float(64,2560,1,102400) *************** [07/29/2021-16:42:32] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_57, Add_79) (PointWise) [07/29/2021-16:42:32] [V] [TRT] Tactic: 128 time 0.046212 [07/29/2021-16:42:32] [V] [TRT] Tactic: 256 time 0.04732 [07/29/2021-16:42:32] [V] [TRT] Tactic: 512 time 0.052484 [07/29/2021-16:42:32] [V] [TRT] Tactic: -32 time 0.092896 [07/29/2021-16:42:32] [V] [TRT] Tactic: -64 time 0.065048 [07/29/2021-16:42:32] [V] [TRT] Tactic: -128 time 0.05822 [07/29/2021-16:42:32] [V] [TRT] Fastest Tactic: 128 Time: 0.046212 [07/29/2021-16:42:32] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_57, Add_79) (PointWiseV2) [07/29/2021-16:42:32] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:32] [V] [TRT] [07/29/2021-16:42:32] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,3200), Float(1,40,1600:32,3200) -> Float(1,40,1600:32,3200) *************** [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_57, Add_79) (PointWise) [07/29/2021-16:42:33] [V] [TRT] Tactic: 128 time 0.04698 [07/29/2021-16:42:33] [V] [TRT] Tactic: 256 time 0.047412 [07/29/2021-16:42:33] [V] [TRT] Tactic: 512 time 0.052204 [07/29/2021-16:42:33] [V] [TRT] Tactic: -32 time 0.09258 [07/29/2021-16:42:33] [V] [TRT] Tactic: -64 time 0.065232 [07/29/2021-16:42:33] [V] [TRT] Tactic: -128 time 0.0584 [07/29/2021-16:42:33] [V] [TRT] Fastest Tactic: 128 Time: 0.04698 [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_57, Add_79) (PointWiseV2) [07/29/2021-16:42:33] [V] [TRT] Tactic: 24 time 0.032376 [07/29/2021-16:42:33] [V] [TRT] Tactic: 25 time 0.033784 [07/29/2021-16:42:33] [V] [TRT] Tactic: 26 time 0.029496 [07/29/2021-16:42:33] [V] [TRT] Tactic: 27 time 0.027204 [07/29/2021-16:42:33] [V] [TRT] Tactic: 31 time 0.032028 [07/29/2021-16:42:33] [V] [TRT] Fastest Tactic: 27 Time: 0.027204 [07/29/2021-16:42:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 27 [07/29/2021-16:42:33] [V] [TRT] [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:33] [V] [TRT] Tactic: 1002 time 0.011192 [07/29/2021-16:42:33] [V] [TRT] Tactic: 0 time 0.009216 [07/29/2021-16:42:33] [V] [TRT] Fastest Tactic: 0 Time: 0.009216 [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:33] [V] [TRT] Tactic: 1002 time 0.011084 [07/29/2021-16:42:33] [V] [TRT] Tactic: 0 time 0.010128 [07/29/2021-16:42:33] [V] [TRT] Fastest Tactic: 0 Time: 0.010128 [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:33] [V] [TRT] Tactic: 1002 time 0.01616 [07/29/2021-16:42:33] [V] [TRT] Tactic: 0 time 0.011136 [07/29/2021-16:42:33] [V] [TRT] Fastest Tactic: 0 Time: 0.011136 [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:33] [V] [TRT] Tactic: 1002 time 0.015052 [07/29/2021-16:42:33] [V] [TRT] Tactic: 0 time 0.009092 [07/29/2021-16:42:33] [V] [TRT] Fastest Tactic: 0 Time: 0.009092 [07/29/2021-16:42:33] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,6400) -> Float(1,20,400,12800) *************** [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (FusedConvActConvolution) [07/29/2021-16:42:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (CaskConvolution) [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: 1825138533642645384 time 0.08964 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: 2775507031594384867 time 0.027504 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: 2842488832350522458 time 0.064392 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: 3915320020053085238 time 0.086016 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: 6448355332020552203 time 0.090216 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: 6808617066150061604 time 0.057944 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: -8060443123034038864 time 0.066684 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: -4420849921117327522 time 0.053164 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Tactic: -3946921629105938337 time 0.063412 [07/29/2021-16:42:33] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.027504 [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (CudaConvolution) [07/29/2021-16:42:33] [V] [TRT] Tactic: 0 time 0.046944 [07/29/2021-16:42:33] [V] [TRT] Tactic: 1 time 0.046548 [07/29/2021-16:42:33] [V] [TRT] Tactic: 2 time 0.138228 [07/29/2021-16:42:33] [V] [TRT] Tactic: 4 time 0.120864 [07/29/2021-16:42:33] [V] [TRT] Tactic: 5 time 0.123008 [07/29/2021-16:42:33] [V] [TRT] Tactic: 6 time 0.039064 [07/29/2021-16:42:33] [V] [TRT] Tactic: 56 time 0.046608 [07/29/2021-16:42:33] [V] [TRT] Tactic: 57 time 0.04674 [07/29/2021-16:42:33] [V] [TRT] Tactic: 58 time 0.13772 [07/29/2021-16:42:33] [V] [TRT] Tactic: 60 time 0.120552 [07/29/2021-16:42:33] [V] [TRT] Tactic: 61 time 0.123184 [07/29/2021-16:42:33] [V] [TRT] Tactic: 62 time 0.038956 [07/29/2021-16:42:33] [V] [TRT] Fastest Tactic: 62 Time: 0.038956 [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (CudaDepthwiseConvolution) [07/29/2021-16:42:33] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (CublasConvolution) [07/29/2021-16:42:33] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:33] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:33] [V] [TRT] [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:33] [V] [TRT] *************** Autotuning format combination: Float(16,320,1,6400) -> Float(32,640,1,12800) *************** [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:33] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (FusedConvActConvolution) [07/29/2021-16:42:33] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (CaskConvolution) [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 861694390046228376 time 0.084048 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 1017870653102653567 time 0.084052 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 5258189349241541167 time 0.052116 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 5821621277990374316 time 0.0836 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 5863767799113001648 time 0.05458 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -9147980667639709536 time 0.083812 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -8850904373104590857 time 0.052488 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -7751035352149795660 time 0.083444 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -3853827649136781465 time 0.085168 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -3263369460438823196 time 0.05234 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -423878181466897819 time 0.054552 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 5258189349241541167 Time: 0.052116 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (CudaConvolution) [07/29/2021-16:42:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (CudaDepthwiseConvolution) [07/29/2021-16:42:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_125 || Conv_126 (CublasConvolution) [07/29/2021-16:42:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5258189349241541167 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_125 || Conv_126 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.012144 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.012296 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.012144 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.016408 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.017536 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.016408 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.012144 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.013808 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.012144 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.01676 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.0213 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.01676 [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [07/29/2021-16:42:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (CaskConvolution) [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 1825138533642645384 time 0.542176 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 2775507031594384867 time 0.159968 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 2842488832350522458 time 0.296964 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 3915320020053085238 time 0.536212 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 6448355332020552203 time 0.562968 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 6808617066150061604 time 0.302656 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -8060443123034038864 time 0.31756 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -4420849921117327522 time 0.275976 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -3946921629105938337 time 0.32364 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.159968 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (CudaConvolution) [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.4557 [07/29/2021-16:42:34] [V] [TRT] Tactic: 1 time 0.352544 [07/29/2021-16:42:34] [V] [TRT] Tactic: 2 skipped. Scratch requested: 29491200, available: 16777216 [07/29/2021-16:42:34] [V] [TRT] Tactic: 4 skipped. Scratch requested: 155860992, available: 16777216 [07/29/2021-16:42:34] [V] [TRT] Tactic: 5 skipped. Scratch requested: 26738688, available: 16777216 [07/29/2021-16:42:34] [V] [TRT] Tactic: 6 time 0.182376 [07/29/2021-16:42:34] [V] [TRT] Tactic: 56 time 0.455804 [07/29/2021-16:42:34] [V] [TRT] Tactic: 57 time 0.353264 [07/29/2021-16:42:34] [V] [TRT] Tactic: 58 skipped. Scratch requested: 29491200, available: 16777216 [07/29/2021-16:42:34] [V] [TRT] Tactic: 60 skipped. Scratch requested: 155860992, available: 16777216 [07/29/2021-16:42:34] [V] [TRT] Tactic: 61 skipped. Scratch requested: 26738688, available: 16777216 [07/29/2021-16:42:34] [V] [TRT] Tactic: 62 time 0.182308 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 62 Time: 0.182308 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [07/29/2021-16:42:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (CublasConvolution) [07/29/2021-16:42:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:34] [V] [TRT] [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(64,2560,1,102400) -> Float(64,2560,1,102400) *************** [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (FusedConvActConvolution) [07/29/2021-16:42:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (CaskConvolution) [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 861694390046228376 time 0.537736 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 1017870653102653567 time 0.535308 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 5258189349241541167 time 0.292372 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 5821621277990374316 time 0.537452 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 5863767799113001648 time 0.260376 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -9147980667639709536 time 0.449076 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -8850904373104590857 time 0.2393 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -7751035352149795660 time 0.435276 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -3853827649136781465 time 0.44152 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -3263369460438823196 time 0.237124 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -423878181466897819 time 0.214 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: -423878181466897819 Time: 0.214 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (CudaConvolution) [07/29/2021-16:42:34] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (CudaDepthwiseConvolution) [07/29/2021-16:42:34] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_80 (CublasConvolution) [07/29/2021-16:42:34] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -423878181466897819 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_80 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.010292 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.008964 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.008964 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.013216 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.015176 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.013216 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.010216 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.010208 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.010208 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.013296 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.016632 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.013296 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.014376 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.010212 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.010212 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.012884 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.008464 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.008464 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.013084 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.016512 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.013084 [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,12800) -> Float(1,20,400,6400) *************** [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: LeakyRelu_127 (PointWise) [07/29/2021-16:42:34] [V] [TRT] Tactic: 128 time 0.009336 [07/29/2021-16:42:34] [V] [TRT] Tactic: 256 time 0.009512 [07/29/2021-16:42:34] [V] [TRT] Tactic: 512 time 0.010196 [07/29/2021-16:42:34] [V] [TRT] Tactic: -32 time 0.040948 [07/29/2021-16:42:34] [V] [TRT] Tactic: -64 time 0.025424 [07/29/2021-16:42:34] [V] [TRT] Tactic: -128 time 0.017244 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 128 Time: 0.009336 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: LeakyRelu_127 (PointWiseV2) [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.008088 [07/29/2021-16:42:34] [V] [TRT] Tactic: 1 time 0.008068 [07/29/2021-16:42:34] [V] [TRT] Tactic: 2 time 0.007876 [07/29/2021-16:42:34] [V] [TRT] Tactic: 3 time 0.008384 [07/29/2021-16:42:34] [V] [TRT] Tactic: 4 time 0.00812 [07/29/2021-16:42:34] [V] [TRT] Tactic: 5 time 0.007756 [07/29/2021-16:42:34] [V] [TRT] Tactic: 6 time 0.010048 [07/29/2021-16:42:34] [V] [TRT] Tactic: 7 time 0.008696 [07/29/2021-16:42:34] [V] [TRT] Tactic: 8 time 0.008252 [07/29/2021-16:42:34] [V] [TRT] Tactic: 9 time 0.007812 [07/29/2021-16:42:34] [V] [TRT] Tactic: 28 time 0.00754 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 28 Time: 0.00754 [07/29/2021-16:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 28 [07/29/2021-16:42:34] [V] [TRT] [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(32,640,1,12800) -> Float(16,320,1,6400) *************** [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: LeakyRelu_127 (PointWise) [07/29/2021-16:42:34] [V] [TRT] Tactic: 128 time 0.009228 [07/29/2021-16:42:34] [V] [TRT] Tactic: 256 time 0.009896 [07/29/2021-16:42:34] [V] [TRT] Tactic: 512 time 0.01018 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 128 Time: 0.009228 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: LeakyRelu_127 (PointWiseV2) [07/29/2021-16:42:34] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:34] [V] [TRT] [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(1,20,400:32,400) -> Float(1,20,400:32,400) *************** [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: LeakyRelu_127 (PointWise) [07/29/2021-16:42:34] [V] [TRT] Tactic: 128 time 0.011168 [07/29/2021-16:42:34] [V] [TRT] Tactic: 256 time 0.010972 [07/29/2021-16:42:34] [V] [TRT] Tactic: 512 time 0.010884 [07/29/2021-16:42:34] [V] [TRT] Tactic: -32 time 0.040856 [07/29/2021-16:42:34] [V] [TRT] Tactic: -64 time 0.025204 [07/29/2021-16:42:34] [V] [TRT] Tactic: -128 time 0.017328 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 512 Time: 0.010884 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: LeakyRelu_127 (PointWiseV2) [07/29/2021-16:42:34] [V] [TRT] Tactic: 24 time 0.008452 [07/29/2021-16:42:34] [V] [TRT] Tactic: 25 time 0.008948 [07/29/2021-16:42:34] [V] [TRT] Tactic: 26 time 0.010068 [07/29/2021-16:42:34] [V] [TRT] Tactic: 27 time 0.01228 [07/29/2021-16:42:34] [V] [TRT] Tactic: 31 time 0.008368 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 31 Time: 0.008368 [07/29/2021-16:42:34] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/29/2021-16:42:34] [V] [TRT] [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(64,2560,1,102400) -> Float(64,2560,1,102400) *************** [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,3200) -> Float(1,40,1600:32,3200) *************** [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.021144 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.041036 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.021144 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.048816 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.086796 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 1002 Time: 0.048816 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.054524 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.04132 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.04132 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:34] [V] [TRT] Tactic: 1002 time 0.0488 [07/29/2021-16:42:34] [V] [TRT] Tactic: 0 time 0.025272 [07/29/2021-16:42:34] [V] [TRT] Fastest Tactic: 0 Time: 0.025272 [07/29/2021-16:42:34] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,6400) -> Float(1,20,400,25600) *************** [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_128 (FusedConvActConvolution) [07/29/2021-16:42:34] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:34] [V] [TRT] --------------- Timing Runner: Conv_128 (CaskConvolution) [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 1825138533642645384 time 0.073544 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 2775507031594384867 time 0.02326 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 2842488832350522458 time 0.053148 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 3915320020053085238 time 0.070996 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 6448355332020552203 time 0.074628 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: 6808617066150061604 time 0.048564 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:34] [V] [TRT] Tactic: -8060443123034038864 time 0.055156 [07/29/2021-16:42:34] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -4420849921117327522 time 0.04478 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -3946921629105938337 time 0.052288 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.02326 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_128 (CudaConvolution) [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.038112 [07/29/2021-16:42:35] [V] [TRT] Tactic: 1 time 0.037888 [07/29/2021-16:42:35] [V] [TRT] Tactic: 2 time 0.06494 [07/29/2021-16:42:35] [V] [TRT] Tactic: 4 time 0.133112 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5 time 0.137892 [07/29/2021-16:42:35] [V] [TRT] Tactic: 6 time 0.068784 [07/29/2021-16:42:35] [V] [TRT] Tactic: 56 time 0.037952 [07/29/2021-16:42:35] [V] [TRT] Tactic: 57 time 0.037904 [07/29/2021-16:42:35] [V] [TRT] Tactic: 58 time 0.065152 [07/29/2021-16:42:35] [V] [TRT] Tactic: 60 time 0.133276 [07/29/2021-16:42:35] [V] [TRT] Tactic: 61 time 0.137396 [07/29/2021-16:42:35] [V] [TRT] Tactic: 62 time 0.068668 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 1 Time: 0.037888 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_128 (CudaDepthwiseConvolution) [07/29/2021-16:42:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_128 (CublasConvolution) [07/29/2021-16:42:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:35] [V] [TRT] [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:35] [V] [TRT] *************** Autotuning format combination: Float(16,320,1,6400) -> Float(64,1280,1,25600) *************** [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_128 (FusedConvActConvolution) [07/29/2021-16:42:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_128 (CaskConvolution) [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 861694390046228376 time 0.070032 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 1017870653102653567 time 0.069636 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5258189349241541167 time 0.043268 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5821621277990374316 time 0.068692 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5863767799113001648 time 0.045228 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -9147980667639709536 time 0.069444 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -8850904373104590857 time 0.043672 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -7751035352149795660 time 0.068876 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -3853827649136781465 time 0.070556 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -3263369460438823196 time 0.043736 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -423878181466897819 time 0.045852 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 5258189349241541167 Time: 0.043268 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_128 (CudaConvolution) [07/29/2021-16:42:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_128 (CudaDepthwiseConvolution) [07/29/2021-16:42:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_128 (CublasConvolution) [07/29/2021-16:42:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5258189349241541167 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_128 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.010284 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.009048 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.009048 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.01026 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.008832 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.008832 [07/29/2021-16:42:35] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400) -> Float(1,40,1600,76800) *************** [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (FusedConvActConvolution) [07/29/2021-16:42:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (CaskConvolution) [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 1825138533642645384 time 0.441316 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 2775507031594384867 time 0.131464 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 2842488832350522458 time 0.24186 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 3915320020053085238 time 0.436792 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 6448355332020552203 time 0.458848 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 6808617066150061604 time 0.246764 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -8060443123034038864 time 0.258844 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -4420849921117327522 time 0.221752 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -3946921629105938337 time 0.2651 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.131464 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (CudaConvolution) [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.35956 [07/29/2021-16:42:35] [V] [TRT] Tactic: 1 time 0.288492 [07/29/2021-16:42:35] [V] [TRT] Tactic: 2 skipped. Scratch requested: 29491200, available: 16777216 [07/29/2021-16:42:35] [V] [TRT] Tactic: 4 skipped. Scratch requested: 121221120, available: 16777216 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5 skipped. Scratch requested: 21168128, available: 16777216 [07/29/2021-16:42:35] [V] [TRT] Tactic: 6 time 0.14792 [07/29/2021-16:42:35] [V] [TRT] Tactic: 56 time 0.360056 [07/29/2021-16:42:35] [V] [TRT] Tactic: 57 time 0.28698 [07/29/2021-16:42:35] [V] [TRT] Tactic: 58 skipped. Scratch requested: 29491200, available: 16777216 [07/29/2021-16:42:35] [V] [TRT] Tactic: 60 skipped. Scratch requested: 121221120, available: 16777216 [07/29/2021-16:42:35] [V] [TRT] Tactic: 61 skipped. Scratch requested: 21168128, available: 16777216 [07/29/2021-16:42:35] [V] [TRT] Tactic: 62 time 0.147852 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 62 Time: 0.147852 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (CudaDepthwiseConvolution) [07/29/2021-16:42:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (CublasConvolution) [07/29/2021-16:42:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:35] [V] [TRT] [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:35] [V] [TRT] *************** Autotuning format combination: Float(64,2560,1,102400) -> Float(48,1920,1,76800) *************** [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (FusedConvActConvolution) [07/29/2021-16:42:35] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (CaskConvolution) [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 861694390046228376 time 0.437744 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 1017870653102653567 time 0.436132 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5258189349241541167 time 0.238264 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5821621277990374316 time 0.437608 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5863767799113001648 time 0.212344 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -9147980667639709536 time 0.436708 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -8850904373104590857 time 0.23886 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -7751035352149795660 time 0.435524 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -3853827649136781465 time 0.441828 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -3263369460438823196 time 0.23668 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Tactic: -423878181466897819 time 0.213676 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.212344 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (CudaConvolution) [07/29/2021-16:42:35] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (CudaDepthwiseConvolution) [07/29/2021-16:42:35] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Conv_113 || Conv_114 (CublasConvolution) [07/29/2021-16:42:35] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] Conv_113 || Conv_114 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.021368 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.030692 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.021368 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.031792 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.066524 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.031792 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.021216 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.026404 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.021216 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.037028 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.079836 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.037028 [07/29/2021-16:42:35] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: Resize_100 (Resize) [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 is the only option, timing skipped [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.014132 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.012124 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.012124 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.020388 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.037492 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.020388 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.014212 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.014208 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.014208 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.020548 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.041848 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 1002 Time: 0.020548 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.023224 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.016508 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.016508 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:35] [V] [TRT] Tactic: 1002 time 0.023952 [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.011596 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 0 Time: 0.011596 [07/29/2021-16:42:35] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,76800) -> Float(1,40,1600,25600) *************** [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: LeakyRelu_115 (PointWise) [07/29/2021-16:42:35] [V] [TRT] Tactic: 128 time 0.014884 [07/29/2021-16:42:35] [V] [TRT] Tactic: 256 time 0.014852 [07/29/2021-16:42:35] [V] [TRT] Tactic: 512 time 0.015348 [07/29/2021-16:42:35] [V] [TRT] Tactic: -32 time 0.050468 [07/29/2021-16:42:35] [V] [TRT] Tactic: -64 time 0.030676 [07/29/2021-16:42:35] [V] [TRT] Tactic: -128 time 0.02034 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 256 Time: 0.014852 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: LeakyRelu_115 (PointWiseV2) [07/29/2021-16:42:35] [V] [TRT] Tactic: 0 time 0.010488 [07/29/2021-16:42:35] [V] [TRT] Tactic: 1 time 0.009832 [07/29/2021-16:42:35] [V] [TRT] Tactic: 2 time 0.008864 [07/29/2021-16:42:35] [V] [TRT] Tactic: 3 time 0.009176 [07/29/2021-16:42:35] [V] [TRT] Tactic: 4 time 0.008932 [07/29/2021-16:42:35] [V] [TRT] Tactic: 5 time 0.008356 [07/29/2021-16:42:35] [V] [TRT] Tactic: 6 time 0.010276 [07/29/2021-16:42:35] [V] [TRT] Tactic: 7 time 0.009432 [07/29/2021-16:42:35] [V] [TRT] Tactic: 8 time 0.008864 [07/29/2021-16:42:35] [V] [TRT] Tactic: 9 time 0.009032 [07/29/2021-16:42:35] [V] [TRT] Tactic: 28 time 0.010424 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 5 Time: 0.008356 [07/29/2021-16:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 5 [07/29/2021-16:42:35] [V] [TRT] [07/29/2021-16:42:35] [V] [TRT] *************** Autotuning format combination: Float(48,1920,1,76800) -> Float(16,640,1,25600) *************** [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: LeakyRelu_115 (PointWise) [07/29/2021-16:42:35] [V] [TRT] Tactic: 128 time 0.014792 [07/29/2021-16:42:35] [V] [TRT] Tactic: 256 time 0.014696 [07/29/2021-16:42:35] [V] [TRT] Tactic: 512 time 0.015276 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 256 Time: 0.014696 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: LeakyRelu_115 (PointWiseV2) [07/29/2021-16:42:35] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 256 [07/29/2021-16:42:35] [V] [TRT] [07/29/2021-16:42:35] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,3200) -> Float(1,40,1600:32,1600) *************** [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: LeakyRelu_115 (PointWise) [07/29/2021-16:42:35] [V] [TRT] Tactic: 128 time 0.021736 [07/29/2021-16:42:35] [V] [TRT] Tactic: 256 time 0.02244 [07/29/2021-16:42:35] [V] [TRT] Tactic: 512 time 0.023236 [07/29/2021-16:42:35] [V] [TRT] Tactic: -32 time 0.052348 [07/29/2021-16:42:35] [V] [TRT] Tactic: -64 time 0.031356 [07/29/2021-16:42:35] [V] [TRT] Tactic: -128 time 0.022812 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 128 Time: 0.021736 [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: LeakyRelu_115 (PointWiseV2) [07/29/2021-16:42:35] [V] [TRT] Tactic: 24 time 0.012008 [07/29/2021-16:42:35] [V] [TRT] Tactic: 25 time 0.011952 [07/29/2021-16:42:35] [V] [TRT] Tactic: 26 time 0.012052 [07/29/2021-16:42:35] [V] [TRT] Tactic: 27 time 0.013248 [07/29/2021-16:42:35] [V] [TRT] Tactic: 31 time 0.011968 [07/29/2021-16:42:35] [V] [TRT] Fastest Tactic: 25 Time: 0.011952 [07/29/2021-16:42:35] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 25 [07/29/2021-16:42:35] [V] [TRT] [07/29/2021-16:42:35] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600), Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:35] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_55, Add_101) (PointWise) [07/29/2021-16:42:35] [V] [TRT] Tactic: 128 time 0.133928 [07/29/2021-16:42:36] [V] [TRT] Tactic: 256 time 0.137132 [07/29/2021-16:42:36] [V] [TRT] Tactic: 512 time 0.15468 [07/29/2021-16:42:36] [V] [TRT] Tactic: -32 time 0.22846 [07/29/2021-16:42:36] [V] [TRT] Tactic: -64 time 0.150024 [07/29/2021-16:42:36] [V] [TRT] Tactic: -128 time 0.145644 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 128 Time: 0.133928 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_55, Add_101) (PointWiseV2) [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.083936 [07/29/2021-16:42:36] [V] [TRT] Tactic: 1 time 0.08666 [07/29/2021-16:42:36] [V] [TRT] Tactic: 2 time 0.082524 [07/29/2021-16:42:36] [V] [TRT] Tactic: 3 time 0.092984 [07/29/2021-16:42:36] [V] [TRT] Tactic: 4 time 0.087984 [07/29/2021-16:42:36] [V] [TRT] Tactic: 5 time 0.087384 [07/29/2021-16:42:36] [V] [TRT] Tactic: 6 time 0.102456 [07/29/2021-16:42:36] [V] [TRT] Tactic: 7 time 0.09222 [07/29/2021-16:42:36] [V] [TRT] Tactic: 8 time 0.090464 [07/29/2021-16:42:36] [V] [TRT] Tactic: 9 time 0.090616 [07/29/2021-16:42:36] [V] [TRT] Tactic: 28 time 0.08344 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 2 Time: 0.082524 [07/29/2021-16:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [07/29/2021-16:42:36] [V] [TRT] [07/29/2021-16:42:36] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600), Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_55, Add_101) (PointWise) [07/29/2021-16:42:36] [V] [TRT] Tactic: 128 time 0.133736 [07/29/2021-16:42:36] [V] [TRT] Tactic: 256 time 0.137204 [07/29/2021-16:42:36] [V] [TRT] Tactic: 512 time 0.154332 [07/29/2021-16:42:36] [V] [TRT] Tactic: -32 time 0.228396 [07/29/2021-16:42:36] [V] [TRT] Tactic: -64 time 0.150272 [07/29/2021-16:42:36] [V] [TRT] Tactic: -128 time 0.14562 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 128 Time: 0.133736 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_55, Add_101) (PointWiseV2) [07/29/2021-16:42:36] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:36] [V] [TRT] [07/29/2021-16:42:36] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400:32,12800), Float(1,80,6400:32,12800) -> Float(1,80,6400:32,12800) *************** [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_55, Add_101) (PointWise) [07/29/2021-16:42:36] [V] [TRT] Tactic: 128 time 0.133668 [07/29/2021-16:42:36] [V] [TRT] Tactic: 256 time 0.1374 [07/29/2021-16:42:36] [V] [TRT] Tactic: 512 time 0.1547 [07/29/2021-16:42:36] [V] [TRT] Tactic: -32 time 0.228244 [07/29/2021-16:42:36] [V] [TRT] Tactic: -64 time 0.149896 [07/29/2021-16:42:36] [V] [TRT] Tactic: -128 time 0.145604 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 128 Time: 0.133668 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: PWN(LeakyRelu_55, Add_101) (PointWiseV2) [07/29/2021-16:42:36] [V] [TRT] Tactic: 24 time 0.107368 [07/29/2021-16:42:36] [V] [TRT] Tactic: 25 time 0.11266 [07/29/2021-16:42:36] [V] [TRT] Tactic: 26 time 0.112508 [07/29/2021-16:42:36] [V] [TRT] Tactic: 27 time 0.113564 [07/29/2021-16:42:36] [V] [TRT] Tactic: 31 time 0.107592 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 24 Time: 0.107368 [07/29/2021-16:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 24 [07/29/2021-16:42:36] [V] [TRT] [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 717 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.010304 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.00828 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.00828 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 717 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.011728 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.0121 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.011728 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 717 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.011844 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.012208 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.011844 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 717 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.016976 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.010112 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.010112 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 717 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.017344 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.013624 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.013624 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 717 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.017316 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.010292 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.010292 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 723 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.010088 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.006956 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.006956 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 723 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.010892 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.008928 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.008928 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 723 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.010868 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.010564 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.010564 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 723 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.017284 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.008584 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.008584 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 723 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.01542 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.010688 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.010688 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: 723 copy (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.014284 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.008956 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.008956 [07/29/2021-16:42:36] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,25600) -> Float(1,20,400,25600) *************** [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Relu_130 (Activation) [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.010008 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.010008 [07/29/2021-16:42:36] [V] [TRT] *************** Autotuning format combination: Float(64,1280,1,25600) -> Float(64,1280,1,25600) *************** [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Relu_130 (Activation) [07/29/2021-16:42:36] [V] [TRT] Activation has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.01618 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.013628 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.013628 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.015348 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.0143 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.0143 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.027476 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.018964 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.018964 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.026 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.013312 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 0 Time: 0.013312 [07/29/2021-16:42:36] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,25600) -> Float(1,40,1600,51200) *************** [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (FusedConvActConvolution) [07/29/2021-16:42:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (CaskConvolution) [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 1825138533642645384 time 0.155756 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 2775507031594384867 time 0.04866 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 2842488832350522458 time 0.092296 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 3915320020053085238 time 0.154456 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 6448355332020552203 time 0.170512 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 6808617066150061604 time 0.093236 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -8060443123034038864 time 0.097084 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -4420849921117327522 time 0.060216 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -3946921629105938337 time 0.094364 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.04866 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (CudaConvolution) [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.07686 [07/29/2021-16:42:36] [V] [TRT] Tactic: 1 time 0.077044 [07/29/2021-16:42:36] [V] [TRT] Tactic: 2 time 0.147596 [07/29/2021-16:42:36] [V] [TRT] Tactic: 4 skipped. Scratch requested: 21645312, available: 16777216 [07/29/2021-16:42:36] [V] [TRT] Tactic: 5 time 0.327148 [07/29/2021-16:42:36] [V] [TRT] Tactic: 6 time 0.064096 [07/29/2021-16:42:36] [V] [TRT] Tactic: 56 time 0.077596 [07/29/2021-16:42:36] [V] [TRT] Tactic: 57 time 0.077208 [07/29/2021-16:42:36] [V] [TRT] Tactic: 58 time 0.148156 [07/29/2021-16:42:36] [V] [TRT] Tactic: 60 skipped. Scratch requested: 21645312, available: 16777216 [07/29/2021-16:42:36] [V] [TRT] Tactic: 61 time 0.32688 [07/29/2021-16:42:36] [V] [TRT] Tactic: 62 time 0.06438 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 6 Time: 0.064096 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (CudaDepthwiseConvolution) [07/29/2021-16:42:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (CublasConvolution) [07/29/2021-16:42:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:36] [V] [TRT] [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:36] [V] [TRT] *************** Autotuning format combination: Float(16,640,1,25600) -> Float(32,1280,1,51200) *************** [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (FusedConvActConvolution) [07/29/2021-16:42:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (CaskConvolution) [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 861694390046228376 time 0.151048 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 1017870653102653567 time 0.150672 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 5258189349241541167 time 0.089456 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 5821621277990374316 time 0.151052 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 5863767799113001648 time 0.104248 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -9147980667639709536 time 0.150592 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -8850904373104590857 time 0.090076 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -7751035352149795660 time 0.150296 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -3853827649136781465 time 0.152496 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -3263369460438823196 time 0.089944 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -423878181466897819 time 0.105516 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 5258189349241541167 Time: 0.089456 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (CudaConvolution) [07/29/2021-16:42:36] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (CudaDepthwiseConvolution) [07/29/2021-16:42:36] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_116 || Conv_117 (CublasConvolution) [07/29/2021-16:42:36] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5258189349241541167 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_116 || Conv_117 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.017064 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.02824 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.017064 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.023784 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.045004 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.023784 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.017272 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.028844 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.017272 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:36] [V] [TRT] Tactic: 1002 time 0.034184 [07/29/2021-16:42:36] [V] [TRT] Tactic: 0 time 0.057292 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 1002 Time: 0.034184 [07/29/2021-16:42:36] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_102 (FusedConvActConvolution) [07/29/2021-16:42:36] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_102 (CaskConvolution) [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 1825138533642645384 time 1.32866 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 2775507031594384867 time 0.529492 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 2842488832350522458 time 0.69986 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 3915320020053085238 time 1.32132 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 6448355332020552203 time 1.39355 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: 6808617066150061604 time 0.712776 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -8060443123034038864 time 0.727944 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -4420849921117327522 time 0.91846 [07/29/2021-16:42:36] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:36] [V] [TRT] Tactic: -3946921629105938337 time 0.933136 [07/29/2021-16:42:36] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.529492 [07/29/2021-16:42:36] [V] [TRT] --------------- Timing Runner: Conv_102 (CudaConvolution) [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 1.69632 [07/29/2021-16:42:37] [V] [TRT] Tactic: 1 time 0.473644 [07/29/2021-16:42:37] [V] [TRT] Tactic: 2 skipped. Scratch requested: 117964800, available: 16777216 [07/29/2021-16:42:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 613564416, available: 16777216 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5 skipped. Scratch requested: 26738688, available: 16777216 [07/29/2021-16:42:37] [V] [TRT] Tactic: 6 time 0.365372 [07/29/2021-16:42:37] [V] [TRT] Tactic: 56 time 0.956504 [07/29/2021-16:42:37] [V] [TRT] Tactic: 57 time 0.459648 [07/29/2021-16:42:37] [V] [TRT] Tactic: 58 skipped. Scratch requested: 117964800, available: 16777216 [07/29/2021-16:42:37] [V] [TRT] Tactic: 60 skipped. Scratch requested: 613564416, available: 16777216 [07/29/2021-16:42:37] [V] [TRT] Tactic: 61 skipped. Scratch requested: 26738688, available: 16777216 [07/29/2021-16:42:37] [V] [TRT] Tactic: 62 time 0.36568 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 6 Time: 0.365372 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_102 (CudaDepthwiseConvolution) [07/29/2021-16:42:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_102 (CublasConvolution) [07/29/2021-16:42:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 6 [07/29/2021-16:42:37] [V] [TRT] [07/29/2021-16:42:37] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_102 (FusedConvActConvolution) [07/29/2021-16:42:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_102 (CaskConvolution) [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 861694390046228376 time 0.707968 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 1017870653102653567 time 0.704896 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5258189349241541167 time 0.386764 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5821621277990374316 time 0.708924 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5863767799113001648 time 0.458716 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -9147980667639709536 time 0.703228 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -8850904373104590857 time 0.388056 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -7751035352149795660 time 0.5512 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -3853827649136781465 time 0.528216 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -3263369460438823196 time 0.283672 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -423878181466897819 time 0.340544 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 0.283672 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_102 (CudaConvolution) [07/29/2021-16:42:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_102 (CudaDepthwiseConvolution) [07/29/2021-16:42:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_102 (CublasConvolution) [07/29/2021-16:42:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_102 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,25600) -> Float(1,20,400,12800) *************** [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (FusedConvActConvolution) [07/29/2021-16:42:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (CaskConvolution) [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 1754569683116234317 time 0.02124 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 1825138533642645384 time 0.021952 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 2733356012094739613 time 0.017896 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 3915320020053085238 time 0.02168 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 6808617066150061604 time 0.016676 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 9091006216302412844 time 0.016368 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -8060443123034038864 time 0.017052 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -4420849921117327522 time 0.014328 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -3946921629105938337 time 0.017724 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.014328 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (CudaConvolution) [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.01482 [07/29/2021-16:42:37] [V] [TRT] Tactic: 1 time 0.014788 [07/29/2021-16:42:37] [V] [TRT] Tactic: 2 time 0.05782 [07/29/2021-16:42:37] [V] [TRT] Tactic: 4 skipped. Scratch requested: 22290432, available: 16777216 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5 time 0.034412 [07/29/2021-16:42:37] [V] [TRT] Tactic: 56 time 0.014152 [07/29/2021-16:42:37] [V] [TRT] Tactic: 57 time 0.014128 [07/29/2021-16:42:37] [V] [TRT] Tactic: 58 time 0.058344 [07/29/2021-16:42:37] [V] [TRT] Tactic: 60 skipped. Scratch requested: 22290432, available: 16777216 [07/29/2021-16:42:37] [V] [TRT] Tactic: 61 time 0.03438 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 57 Time: 0.014128 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (CudaDepthwiseConvolution) [07/29/2021-16:42:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (CublasConvolution) [07/29/2021-16:42:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaConvolution Tactic: 57 [07/29/2021-16:42:37] [V] [TRT] [07/29/2021-16:42:37] [V] [TRT] *************** Autotuning format combination: Float(64,1280,1,25600) -> Float(32,640,1,12800) *************** [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (FusedConvActConvolution) [07/29/2021-16:42:37] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (CaskConvolution) [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 861694390046228376 time 0.020376 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5258189349241541167 time 0.014604 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5821621277990374316 time 0.020092 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5863767799113001648 time 0.012096 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -9147980667639709536 time 0.020132 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -8892196987859366827 time 0.020164 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -8850904373104590857 time 0.014852 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -8010679767156598961 time 0.011832 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -7751035352149795660 time 0.020088 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -5115676123557684531 time 0.020352 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -493597327599791285 time 0.014848 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Tactic: -423878181466897819 time 0.012768 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: -8010679767156598961 Time: 0.011832 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (CudaConvolution) [07/29/2021-16:42:37] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (CudaDepthwiseConvolution) [07/29/2021-16:42:37] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Conv_147 || Conv_172 || Conv_197 (CublasConvolution) [07/29/2021-16:42:37] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8010679767156598961 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] Conv_147 || Conv_172 || Conv_197 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.00648 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.005728 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 0 Time: 0.005728 [07/29/2021-16:42:37] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,12800) -> Float(1,4,3200) *************** [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Transpose_148 + Reshape_154 (Shuffle) [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.00536 [07/29/2021-16:42:37] [V] [TRT] Tactic: 1 time 0.008904 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00536 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.006464 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.006344 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 0 Time: 0.006344 [07/29/2021-16:42:37] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,12800) -> Float(1,10,8000) *************** [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: Transpose_198 + Reshape_204 (Shuffle) [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.00582 [07/29/2021-16:42:37] [V] [TRT] Tactic: 1 time 0.009612 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00582 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.007996 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.007624 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 0 Time: 0.007624 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.011748 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.019736 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.011748 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.008116 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.009336 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.008116 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.012388 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.02172 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.012388 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.012936 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.00968 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 0 Time: 0.00968 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.011952 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.007352 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 0 Time: 0.007352 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:37] [V] [TRT] Tactic: 1002 time 0.012028 [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.021 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 1002 Time: 0.012028 [07/29/2021-16:42:37] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,51200) -> Float(1,40,1600,25600) *************** [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: LeakyRelu_118 (PointWise) [07/29/2021-16:42:37] [V] [TRT] Tactic: 128 time 0.008808 [07/29/2021-16:42:37] [V] [TRT] Tactic: 256 time 0.008744 [07/29/2021-16:42:37] [V] [TRT] Tactic: 512 time 0.00864 [07/29/2021-16:42:37] [V] [TRT] Tactic: -32 time 0.026016 [07/29/2021-16:42:37] [V] [TRT] Tactic: -64 time 0.016324 [07/29/2021-16:42:37] [V] [TRT] Tactic: -128 time 0.011172 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 512 Time: 0.00864 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: LeakyRelu_118 (PointWiseV2) [07/29/2021-16:42:37] [V] [TRT] Tactic: 0 time 0.006716 [07/29/2021-16:42:37] [V] [TRT] Tactic: 1 time 0.00626 [07/29/2021-16:42:37] [V] [TRT] Tactic: 2 time 0.00552 [07/29/2021-16:42:37] [V] [TRT] Tactic: 3 time 0.006096 [07/29/2021-16:42:37] [V] [TRT] Tactic: 4 time 0.005544 [07/29/2021-16:42:37] [V] [TRT] Tactic: 5 time 0.00552 [07/29/2021-16:42:37] [V] [TRT] Tactic: 6 time 0.006404 [07/29/2021-16:42:37] [V] [TRT] Tactic: 7 time 0.005868 [07/29/2021-16:42:37] [V] [TRT] Tactic: 8 time 0.005708 [07/29/2021-16:42:37] [V] [TRT] Tactic: 9 time 0.005756 [07/29/2021-16:42:37] [V] [TRT] Tactic: 28 time 0.00632 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 2 Time: 0.00552 [07/29/2021-16:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 2 [07/29/2021-16:42:37] [V] [TRT] [07/29/2021-16:42:37] [V] [TRT] *************** Autotuning format combination: Float(32,1280,1,51200) -> Float(16,640,1,25600) *************** [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: LeakyRelu_118 (PointWise) [07/29/2021-16:42:37] [V] [TRT] Tactic: 128 time 0.008544 [07/29/2021-16:42:37] [V] [TRT] Tactic: 256 time 0.008592 [07/29/2021-16:42:37] [V] [TRT] Tactic: 512 time 0.008632 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 128 Time: 0.008544 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: LeakyRelu_118 (PointWiseV2) [07/29/2021-16:42:37] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:37] [V] [TRT] [07/29/2021-16:42:37] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600:32,1600) -> Float(1,40,1600:32,1600) *************** [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: LeakyRelu_118 (PointWise) [07/29/2021-16:42:37] [V] [TRT] Tactic: 128 time 0.010976 [07/29/2021-16:42:37] [V] [TRT] Tactic: 256 time 0.010652 [07/29/2021-16:42:37] [V] [TRT] Tactic: 512 time 0.01152 [07/29/2021-16:42:37] [V] [TRT] Tactic: -32 time 0.026888 [07/29/2021-16:42:37] [V] [TRT] Tactic: -64 time 0.0169 [07/29/2021-16:42:37] [V] [TRT] Tactic: -128 time 0.012428 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 256 Time: 0.010652 [07/29/2021-16:42:37] [V] [TRT] --------------- Timing Runner: LeakyRelu_118 (PointWiseV2) [07/29/2021-16:42:37] [V] [TRT] Tactic: 24 time 0.007036 [07/29/2021-16:42:37] [V] [TRT] Tactic: 25 time 0.00718 [07/29/2021-16:42:37] [V] [TRT] Tactic: 26 time 0.006704 [07/29/2021-16:42:37] [V] [TRT] Tactic: 27 time 0.007628 [07/29/2021-16:42:37] [V] [TRT] Tactic: 31 time 0.007596 [07/29/2021-16:42:37] [V] [TRT] Fastest Tactic: 26 Time: 0.006704 [07/29/2021-16:42:37] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 26 [07/29/2021-16:42:38] [V] [TRT] [07/29/2021-16:42:38] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:38] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:38] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400:32,12800) -> Float(1,80,6400:32,12800) *************** [07/29/2021-16:42:38] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,25600) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (FusedConvActConvolution) [07/29/2021-16:42:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (CaskConvolution) [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 1825138533642645384 time 0.062176 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 2775507031594384867 time 0.020808 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 2842488832350522458 time 0.037712 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 3915320020053085238 time 0.06116 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 6448355332020552203 time 0.067796 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 6808617066150061604 time 0.038124 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -8060443123034038864 time 0.039176 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -4420849921117327522 time 0.025432 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -3946921629105938337 time 0.03848 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.020808 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (CudaConvolution) [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.030192 [07/29/2021-16:42:38] [V] [TRT] Tactic: 1 time 0.03194 [07/29/2021-16:42:38] [V] [TRT] Tactic: 2 time 0.066552 [07/29/2021-16:42:38] [V] [TRT] Tactic: 4 time 0.296028 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5 time 0.263676 [07/29/2021-16:42:38] [V] [TRT] Tactic: 6 time 0.161824 [07/29/2021-16:42:38] [V] [TRT] Tactic: 56 time 0.029832 [07/29/2021-16:42:38] [V] [TRT] Tactic: 57 time 0.031744 [07/29/2021-16:42:38] [V] [TRT] Tactic: 58 time 0.066488 [07/29/2021-16:42:38] [V] [TRT] Tactic: 60 time 0.296772 [07/29/2021-16:42:38] [V] [TRT] Tactic: 61 time 0.263744 [07/29/2021-16:42:38] [V] [TRT] Tactic: 62 time 0.161444 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 56 Time: 0.029832 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (CudaDepthwiseConvolution) [07/29/2021-16:42:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (CublasConvolution) [07/29/2021-16:42:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] *************** Autotuning format combination: Float(16,640,1,25600) -> Float(64,2560,1,102400) *************** [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (FusedConvActConvolution) [07/29/2021-16:42:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (CaskConvolution) [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 861694390046228376 time 0.059864 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 1017870653102653567 time 0.059744 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5258189349241541167 time 0.036544 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5821621277990374316 time 0.059992 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5863767799113001648 time 0.042396 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -9147980667639709536 time 0.059732 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -8850904373104590857 time 0.036604 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -7751035352149795660 time 0.060052 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -3853827649136781465 time 0.06044 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -3263369460438823196 time 0.036536 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -423878181466897819 time 0.04256 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 0.036536 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (CudaConvolution) [07/29/2021-16:42:38] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (CudaDepthwiseConvolution) [07/29/2021-16:42:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_119 (CublasConvolution) [07/29/2021-16:42:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_119 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.008368 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.007424 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 0 Time: 0.007424 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.00834 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.007712 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 0 Time: 0.007712 [07/29/2021-16:42:38] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,307200) *************** [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (FusedConvActConvolution) [07/29/2021-16:42:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (CaskConvolution) [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 1825138533642645384 time 0.511664 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 2775507031594384867 time 0.21768 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 2842488832350522458 time 0.27256 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 3915320020053085238 time 0.50836 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 6448355332020552203 time 0.536292 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 6808617066150061604 time 0.2796 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -8060443123034038864 time 0.284688 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -4420849921117327522 time 0.362356 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -3946921629105938337 time 0.360916 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.21768 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (CudaConvolution) [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.639028 [07/29/2021-16:42:38] [V] [TRT] Tactic: 1 time 0.42178 [07/29/2021-16:42:38] [V] [TRT] Tactic: 2 skipped. Scratch requested: 117964800, available: 16777216 [07/29/2021-16:42:38] [V] [TRT] Tactic: 4 skipped. Scratch requested: 477212672, available: 16777216 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5 skipped. Scratch requested: 21168128, available: 16777216 [07/29/2021-16:42:38] [V] [TRT] Tactic: 6 time 0.260088 [07/29/2021-16:42:38] [V] [TRT] Tactic: 56 time 0.639388 [07/29/2021-16:42:38] [V] [TRT] Tactic: 57 time 0.405024 [07/29/2021-16:42:38] [V] [TRT] Tactic: 58 skipped. Scratch requested: 117964800, available: 16777216 [07/29/2021-16:42:38] [V] [TRT] Tactic: 60 skipped. Scratch requested: 477212672, available: 16777216 [07/29/2021-16:42:38] [V] [TRT] Tactic: 61 skipped. Scratch requested: 21168128, available: 16777216 [07/29/2021-16:42:38] [V] [TRT] Tactic: 62 time 0.259636 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 62 Time: 0.259636 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (CudaDepthwiseConvolution) [07/29/2021-16:42:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (CublasConvolution) [07/29/2021-16:42:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:38] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(48,3840,1,307200) *************** [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (FusedConvActConvolution) [07/29/2021-16:42:38] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (CaskConvolution) [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 861694390046228376 time 0.51662 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 1017870653102653567 time 0.513816 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5258189349241541167 time 0.282468 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5821621277990374316 time 0.517564 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5863767799113001648 time 0.339308 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -9147980667639709536 time 0.517356 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -8850904373104590857 time 0.286064 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -7751035352149795660 time 0.517992 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -3853827649136781465 time 0.521244 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -3263369460438823196 time 0.280008 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Tactic: -423878181466897819 time 0.33488 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 0.280008 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (CudaConvolution) [07/29/2021-16:42:38] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (CudaDepthwiseConvolution) [07/29/2021-16:42:38] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: Conv_104 || Conv_105 (CublasConvolution) [07/29/2021-16:42:38] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] Conv_104 || Conv_105 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.052124 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.053316 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.052124 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.0685 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.128324 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.0685 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.053532 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.06438 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.053532 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.066988 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.147056 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.066988 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.016316 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.012944 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 0 Time: 0.012944 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.030716 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.061296 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.030716 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.019184 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.024272 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.019184 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.030072 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.071716 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 1002 Time: 0.030072 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.027432 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.026832 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 0 Time: 0.026832 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:38] [V] [TRT] Tactic: 1002 time 0.03138 [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.018296 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 0 Time: 0.018296 [07/29/2021-16:42:38] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,307200) -> Float(1,80,6400,102400) *************** [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: LeakyRelu_106 (PointWise) [07/29/2021-16:42:38] [V] [TRT] Tactic: 128 time 0.018312 [07/29/2021-16:42:38] [V] [TRT] Tactic: 256 time 0.0188 [07/29/2021-16:42:38] [V] [TRT] Tactic: 512 time 0.019848 [07/29/2021-16:42:38] [V] [TRT] Tactic: -32 time 0.02688 [07/29/2021-16:42:38] [V] [TRT] Tactic: -64 time 0.020952 [07/29/2021-16:42:38] [V] [TRT] Tactic: -128 time 0.0188 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 128 Time: 0.018312 [07/29/2021-16:42:38] [V] [TRT] --------------- Timing Runner: LeakyRelu_106 (PointWiseV2) [07/29/2021-16:42:38] [V] [TRT] Tactic: 0 time 0.011864 [07/29/2021-16:42:38] [V] [TRT] Tactic: 1 time 0.009728 [07/29/2021-16:42:38] [V] [TRT] Tactic: 2 time 0.008664 [07/29/2021-16:42:38] [V] [TRT] Tactic: 3 time 0.008436 [07/29/2021-16:42:38] [V] [TRT] Tactic: 4 time 0.007864 [07/29/2021-16:42:38] [V] [TRT] Tactic: 5 time 0.007728 [07/29/2021-16:42:38] [V] [TRT] Tactic: 6 time 0.008624 [07/29/2021-16:42:38] [V] [TRT] Tactic: 7 time 0.007676 [07/29/2021-16:42:38] [V] [TRT] Tactic: 8 time 0.007496 [07/29/2021-16:42:38] [V] [TRT] Tactic: 9 time 0.007492 [07/29/2021-16:42:38] [V] [TRT] Tactic: 28 time 0.011524 [07/29/2021-16:42:38] [V] [TRT] Fastest Tactic: 9 Time: 0.007492 [07/29/2021-16:42:38] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 9 [07/29/2021-16:42:38] [V] [TRT] [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(48,3840,1,307200) -> Float(16,1280,1,102400) *************** [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: LeakyRelu_106 (PointWise) [07/29/2021-16:42:39] [V] [TRT] Tactic: 128 time 0.0211 [07/29/2021-16:42:39] [V] [TRT] Tactic: 256 time 0.021664 [07/29/2021-16:42:39] [V] [TRT] Tactic: 512 time 0.023548 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 128 Time: 0.0211 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: LeakyRelu_106 (PointWiseV2) [07/29/2021-16:42:39] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:39] [V] [TRT] [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400:32,12800) -> Float(1,80,6400:32,6400) *************** [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: LeakyRelu_106 (PointWise) [07/29/2021-16:42:39] [V] [TRT] Tactic: 128 time 0.036456 [07/29/2021-16:42:39] [V] [TRT] Tactic: 256 time 0.036872 [07/29/2021-16:42:39] [V] [TRT] Tactic: 512 time 0.040488 [07/29/2021-16:42:39] [V] [TRT] Tactic: -32 time 0.066556 [07/29/2021-16:42:39] [V] [TRT] Tactic: -64 time 0.045564 [07/29/2021-16:42:39] [V] [TRT] Tactic: -128 time 0.037448 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 128 Time: 0.036456 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: LeakyRelu_106 (PointWiseV2) [07/29/2021-16:42:39] [V] [TRT] Tactic: 24 time 0.033252 [07/29/2021-16:42:39] [V] [TRT] Tactic: 25 time 0.034764 [07/29/2021-16:42:39] [V] [TRT] Tactic: 26 time 0.036472 [07/29/2021-16:42:39] [V] [TRT] Tactic: 27 time 0.034472 [07/29/2021-16:42:39] [V] [TRT] Tactic: 31 time 0.032652 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 31 Time: 0.032652 [07/29/2021-16:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/29/2021-16:42:39] [V] [TRT] [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 702 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.00778 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.006668 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.006668 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 702 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.008716 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.012528 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.008716 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 702 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.008556 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.010928 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.008556 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 702 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.020268 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.00818 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.00818 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 702 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.016508 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.012988 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.012988 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 702 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.016096 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.008988 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.008988 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 708 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.006284 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.005472 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.005472 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 708 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.008036 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.0074 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.0074 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 708 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.008008 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.009024 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.008008 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 708 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.020324 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.00658 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.00658 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 708 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.01254 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.008932 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.008932 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: 708 copy (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.011912 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.007036 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.007036 [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400) -> Float(1,40,1600,102400) *************** [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Relu_121 (Activation) [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.008004 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.008004 [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(64,2560,1,102400) -> Float(64,2560,1,102400) *************** [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Relu_121 (Activation) [07/29/2021-16:42:39] [V] [TRT] Activation has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.01608 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.012808 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.012808 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.016192 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.014256 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.014256 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.027028 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.026748 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.026748 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.028092 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.018172 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.018172 [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,102400) -> Float(1,80,6400,204800) *************** [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (FusedConvActConvolution) [07/29/2021-16:42:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (CaskConvolution) [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 1825138533642645384 time 0.136712 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 2775507031594384867 time 0.04722 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 2842488832350522458 time 0.076504 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 3915320020053085238 time 0.135872 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 6448355332020552203 time 0.155164 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 6808617066150061604 time 0.07736 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -8060443123034038864 time 0.07826 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -4420849921117327522 time 0.062984 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -3946921629105938337 time 0.05712 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.04722 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (CudaConvolution) [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.095488 [07/29/2021-16:42:39] [V] [TRT] Tactic: 1 time 0.095984 [07/29/2021-16:42:39] [V] [TRT] Tactic: 2 time 0.50194 [07/29/2021-16:42:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 85215232, available: 16777216 [07/29/2021-16:42:39] [V] [TRT] Tactic: 5 time 0.334552 [07/29/2021-16:42:39] [V] [TRT] Tactic: 6 time 0.075684 [07/29/2021-16:42:39] [V] [TRT] Tactic: 56 time 0.100356 [07/29/2021-16:42:39] [V] [TRT] Tactic: 57 time 0.100056 [07/29/2021-16:42:39] [V] [TRT] Tactic: 58 time 0.519364 [07/29/2021-16:42:39] [V] [TRT] Tactic: 60 skipped. Scratch requested: 85215232, available: 16777216 [07/29/2021-16:42:39] [V] [TRT] Tactic: 61 time 0.341636 [07/29/2021-16:42:39] [V] [TRT] Tactic: 62 time 0.076732 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 6 Time: 0.075684 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (CudaDepthwiseConvolution) [07/29/2021-16:42:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (CublasConvolution) [07/29/2021-16:42:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:39] [V] [TRT] [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(16,1280,1,102400) -> Float(32,2560,1,204800) *************** [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (FusedConvActConvolution) [07/29/2021-16:42:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (CaskConvolution) [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 861694390046228376 time 0.141288 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 1017870653102653567 time 0.141048 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 5258189349241541167 time 0.081996 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 5821621277990374316 time 0.140096 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 5863767799113001648 time 0.102932 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -9147980667639709536 time 0.13842 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -8850904373104590857 time 0.081396 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -7751035352149795660 time 0.137392 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -3853827649136781465 time 0.139104 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -3263369460438823196 time 0.080772 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -423878181466897819 time 0.101872 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 0.080772 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (CudaConvolution) [07/29/2021-16:42:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (CudaDepthwiseConvolution) [07/29/2021-16:42:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_107 || Conv_108 (CublasConvolution) [07/29/2021-16:42:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_107 || Conv_108 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.033996 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.036384 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.033996 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.0387 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.070028 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.0387 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.0332 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.04872 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.0332 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.047888 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.085232 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 1002 Time: 0.047888 [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,102400) -> Float(1,40,1600,51200) *************** [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (FusedConvActConvolution) [07/29/2021-16:42:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (CaskConvolution) [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 1754569683116234317 time 0.033472 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 1825138533642645384 time 0.03354 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 2733356012094739613 time 0.020704 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 3915320020053085238 time 0.0331 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 6808617066150061604 time 0.022924 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 9091006216302412844 time 0.022172 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -8060443123034038864 time 0.023072 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -4420849921117327522 time 0.016028 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -3946921629105938337 time 0.0225 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: -4420849921117327522 Time: 0.016028 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (CudaConvolution) [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.02192 [07/29/2021-16:42:39] [V] [TRT] Tactic: 1 time 0.02194 [07/29/2021-16:42:39] [V] [TRT] Tactic: 2 time 0.04472 [07/29/2021-16:42:39] [V] [TRT] Tactic: 4 skipped. Scratch requested: 86515712, available: 16777216 [07/29/2021-16:42:39] [V] [TRT] Tactic: 5 time 0.072136 [07/29/2021-16:42:39] [V] [TRT] Tactic: 56 time 0.021908 [07/29/2021-16:42:39] [V] [TRT] Tactic: 57 time 0.021652 [07/29/2021-16:42:39] [V] [TRT] Tactic: 58 time 0.04484 [07/29/2021-16:42:39] [V] [TRT] Tactic: 60 skipped. Scratch requested: 86515712, available: 16777216 [07/29/2021-16:42:39] [V] [TRT] Tactic: 61 time 0.072484 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 57 Time: 0.021652 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (CudaDepthwiseConvolution) [07/29/2021-16:42:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (CublasConvolution) [07/29/2021-16:42:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -4420849921117327522 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(64,2560,1,102400) -> Float(32,1280,1,51200) *************** [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (FusedConvActConvolution) [07/29/2021-16:42:39] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (CaskConvolution) [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 861694390046228376 time 0.03222 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 5258189349241541167 time 0.021236 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 5821621277990374316 time 0.03222 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: 5863767799113001648 time 0.01976 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -9147980667639709536 time 0.032272 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -8892196987859366827 time 0.031932 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -8850904373104590857 time 0.021924 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -8010679767156598961 time 0.020092 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -7751035352149795660 time 0.032144 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -5115676123557684531 time 0.032208 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -493597327599791285 time 0.02106 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Tactic: -423878181466897819 time 0.020156 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 5863767799113001648 Time: 0.01976 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (CudaConvolution) [07/29/2021-16:42:39] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (CudaDepthwiseConvolution) [07/29/2021-16:42:39] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Conv_139 || Conv_164 || Conv_189 (CublasConvolution) [07/29/2021-16:42:39] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:39] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5863767799113001648 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.0079 [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.007408 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.007408 [07/29/2021-16:42:39] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,51200) -> Float(1,4,12800) *************** [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: Transpose_140 + Reshape_146 (Shuffle) [07/29/2021-16:42:39] [V] [TRT] Tactic: 0 time 0.006016 [07/29/2021-16:42:39] [V] [TRT] Tactic: 1 time 0.01036 [07/29/2021-16:42:39] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [07/29/2021-16:42:39] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:39] [V] [TRT] Tactic: 1002 time 0.00794 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.009888 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.00794 [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,51200) -> Float(1,10,32000) *************** [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Transpose_190 + Reshape_196 (Shuffle) [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.007816 [07/29/2021-16:42:40] [V] [TRT] Tactic: 1 time 0.011976 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.007816 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.015936 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.012908 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.012908 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.030512 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.0607 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.030512 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.019724 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.02684 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.019724 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.030528 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.070532 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.030528 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.027244 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.027044 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.027044 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.028248 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.018292 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.018292 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.03068 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.07068 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.03068 [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,204800) -> Float(1,80,6400,102400) *************** [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: LeakyRelu_109 (PointWise) [07/29/2021-16:42:40] [V] [TRT] Tactic: 128 time 0.018252 [07/29/2021-16:42:40] [V] [TRT] Tactic: 256 time 0.018444 [07/29/2021-16:42:40] [V] [TRT] Tactic: 512 time 0.019576 [07/29/2021-16:42:40] [V] [TRT] Tactic: -32 time 0.027112 [07/29/2021-16:42:40] [V] [TRT] Tactic: -64 time 0.020604 [07/29/2021-16:42:40] [V] [TRT] Tactic: -128 time 0.01832 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 128 Time: 0.018252 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.011496 [07/29/2021-16:42:40] [V] [TRT] Tactic: 1 time 0.009396 [07/29/2021-16:42:40] [V] [TRT] Tactic: 2 time 0.009004 [07/29/2021-16:42:40] [V] [TRT] Tactic: 3 time 0.008604 [07/29/2021-16:42:40] [V] [TRT] Tactic: 4 time 0.007788 [07/29/2021-16:42:40] [V] [TRT] Tactic: 5 time 0.0075 [07/29/2021-16:42:40] [V] [TRT] Tactic: 6 time 0.008572 [07/29/2021-16:42:40] [V] [TRT] Tactic: 7 time 0.007792 [07/29/2021-16:42:40] [V] [TRT] Tactic: 8 time 0.006788 [07/29/2021-16:42:40] [V] [TRT] Tactic: 9 time 0.007196 [07/29/2021-16:42:40] [V] [TRT] Tactic: 28 time 0.011768 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 8 Time: 0.006788 [07/29/2021-16:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 8 [07/29/2021-16:42:40] [V] [TRT] [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(32,2560,1,204800) -> Float(16,1280,1,102400) *************** [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: LeakyRelu_109 (PointWise) [07/29/2021-16:42:40] [V] [TRT] Tactic: 128 time 0.02166 [07/29/2021-16:42:40] [V] [TRT] Tactic: 256 time 0.022032 [07/29/2021-16:42:40] [V] [TRT] Tactic: 512 time 0.023548 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 128 Time: 0.02166 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [07/29/2021-16:42:40] [V] [TRT] PointWiseV2 has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWise Tactic: 128 [07/29/2021-16:42:40] [V] [TRT] [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400:32,6400) -> Float(1,80,6400:32,6400) *************** [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: LeakyRelu_109 (PointWise) [07/29/2021-16:42:40] [V] [TRT] Tactic: 128 time 0.03318 [07/29/2021-16:42:40] [V] [TRT] Tactic: 256 time 0.03342 [07/29/2021-16:42:40] [V] [TRT] Tactic: 512 time 0.035852 [07/29/2021-16:42:40] [V] [TRT] Tactic: -32 time 0.066112 [07/29/2021-16:42:40] [V] [TRT] Tactic: -64 time 0.045272 [07/29/2021-16:42:40] [V] [TRT] Tactic: -128 time 0.036736 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 128 Time: 0.03318 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: LeakyRelu_109 (PointWiseV2) [07/29/2021-16:42:40] [V] [TRT] Tactic: 24 time 0.032788 [07/29/2021-16:42:40] [V] [TRT] Tactic: 25 time 0.034752 [07/29/2021-16:42:40] [V] [TRT] Tactic: 26 time 0.03596 [07/29/2021-16:42:40] [V] [TRT] Tactic: 27 time 0.034448 [07/29/2021-16:42:40] [V] [TRT] Tactic: 31 time 0.032656 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 31 Time: 0.032656 [07/29/2021-16:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PointWiseV2 Tactic: 31 [07/29/2021-16:42:40] [V] [TRT] [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,102400) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (FusedConvActConvolution) [07/29/2021-16:42:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (CaskConvolution) [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 1825138533642645384 time 0.13712 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 2775507031594384867 time 0.044732 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 2842488832350522458 time 0.075768 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 3915320020053085238 time 0.136068 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 6448355332020552203 time 0.15552 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 6808617066150061604 time 0.11646 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -8060443123034038864 time 0.118728 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -4420849921117327522 time 0.079628 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -3946921629105938337 time 0.079056 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 2775507031594384867 Time: 0.044732 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (CudaConvolution) [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.124596 [07/29/2021-16:42:40] [V] [TRT] Tactic: 1 time 0.124232 [07/29/2021-16:42:40] [V] [TRT] Tactic: 2 time 0.386396 [07/29/2021-16:42:40] [V] [TRT] Tactic: 4 skipped. Scratch requested: 54404608, available: 16777216 [07/29/2021-16:42:40] [V] [TRT] Tactic: 5 time 0.970332 [07/29/2021-16:42:40] [V] [TRT] Tactic: 6 time 0.630092 [07/29/2021-16:42:40] [V] [TRT] Tactic: 56 time 0.124904 [07/29/2021-16:42:40] [V] [TRT] Tactic: 57 time 0.124872 [07/29/2021-16:42:40] [V] [TRT] Tactic: 58 time 0.383712 [07/29/2021-16:42:40] [V] [TRT] Tactic: 60 skipped. Scratch requested: 54404608, available: 16777216 [07/29/2021-16:42:40] [V] [TRT] Tactic: 61 time 0.95882 [07/29/2021-16:42:40] [V] [TRT] Tactic: 62 time 0.62582 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1 Time: 0.124232 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (CudaDepthwiseConvolution) [07/29/2021-16:42:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (CublasConvolution) [07/29/2021-16:42:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2775507031594384867 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:40] [V] [TRT] [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(16,1280,1,102400) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (FusedConvActConvolution) [07/29/2021-16:42:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (CaskConvolution) [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 861694390046228376 time 0.200152 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 1017870653102653567 time 0.199672 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 5258189349241541167 time 0.116184 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 5821621277990374316 time 0.200348 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 5863767799113001648 time 0.14382 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -9147980667639709536 time 0.199124 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -8850904373104590857 time 0.09832 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -7751035352149795660 time 0.167364 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -3853827649136781465 time 0.16904 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -3263369460438823196 time 0.09804 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -423878181466897819 time 0.121804 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: -3263369460438823196 Time: 0.09804 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (CudaConvolution) [07/29/2021-16:42:40] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (CudaDepthwiseConvolution) [07/29/2021-16:42:40] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_110 (CublasConvolution) [07/29/2021-16:42:40] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3263369460438823196 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_110 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.024676 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.021692 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.021692 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.01946 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.017616 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.017616 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 687 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.037656 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.031236 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.031236 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 687 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.035084 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.041644 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.035084 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 687 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.034904 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.049968 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.034904 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 687 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.091324 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.033712 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.033712 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 687 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.056724 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.054372 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.054372 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 687 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.051084 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.033156 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.033156 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 693 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.011556 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.0094 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.0094 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 693 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.023768 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.02078 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.02078 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 693 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.021488 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.028776 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 1002 Time: 0.021488 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 693 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.090448 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.021076 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.021076 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 693 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.031736 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.02886 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.02886 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: 693 copy (Reformat) [07/29/2021-16:42:40] [V] [TRT] Tactic: 1002 time 0.033908 [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.020964 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.020964 [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,409600) *************** [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Relu_112 (Activation) [07/29/2021-16:42:40] [V] [TRT] Tactic: 0 time 0.059424 [07/29/2021-16:42:40] [V] [TRT] Fastest Tactic: 0 Time: 0.059424 [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(64,5120,1,409600) *************** [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Relu_112 (Activation) [07/29/2021-16:42:40] [V] [TRT] Activation has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,409600) -> Float(1,80,6400,204800) *************** [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (FusedConvActConvolution) [07/29/2021-16:42:40] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:40] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (CaskConvolution) [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 1754569683116234317 time 0.086872 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 1825138533642645384 time 0.087376 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 2733356012094739613 time 0.04818 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 3915320020053085238 time 0.087104 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 6808617066150061604 time 0.060332 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: 9091006216302412844 time 0.06162 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -8060443123034038864 time 0.061168 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:40] [V] [TRT] Tactic: -4420849921117327522 time 0.056452 [07/29/2021-16:42:40] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -3946921629105938337 time 0.048496 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 2733356012094739613 Time: 0.04818 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (CudaConvolution) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.07992 [07/29/2021-16:42:41] [V] [TRT] Tactic: 1 time 0.06668 [07/29/2021-16:42:41] [V] [TRT] Tactic: 2 time 0.153624 [07/29/2021-16:42:41] [V] [TRT] Tactic: 4 skipped. Scratch requested: 340795392, available: 16777216 [07/29/2021-16:42:41] [V] [TRT] Tactic: 5 skipped. Scratch requested: 16990208, available: 16777216 [07/29/2021-16:42:41] [V] [TRT] Tactic: 56 time 0.08074 [07/29/2021-16:42:41] [V] [TRT] Tactic: 57 time 0.066772 [07/29/2021-16:42:41] [V] [TRT] Tactic: 58 time 0.153792 [07/29/2021-16:42:41] [V] [TRT] Tactic: 60 skipped. Scratch requested: 340795392, available: 16777216 [07/29/2021-16:42:41] [V] [TRT] Tactic: 61 skipped. Scratch requested: 16990208, available: 16777216 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 1 Time: 0.06668 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (CudaDepthwiseConvolution) [07/29/2021-16:42:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (CublasConvolution) [07/29/2021-16:42:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 2733356012094739613 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(64,5120,1,409600) -> Float(32,2560,1,204800) *************** [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (FusedConvActConvolution) [07/29/2021-16:42:41] [V] [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (CaskConvolution) [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: 861694390046228376 time 0.092408 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: 5258189349241541167 time 0.06376 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: 5821621277990374316 time 0.093008 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: 5863767799113001648 time 0.062184 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -9147980667639709536 time 0.090736 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -8892196987859366827 time 0.090112 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -8850904373104590857 time 0.063892 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -8010679767156598961 time 0.061464 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -7751035352149795660 time 0.09092 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -5115676123557684531 time 0.092148 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -493597327599791285 time 0.068844 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Tactic: -423878181466897819 time 0.062096 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: -8010679767156598961 Time: 0.061464 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (CudaConvolution) [07/29/2021-16:42:41] [V] [TRT] CudaConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (CudaDepthwiseConvolution) [07/29/2021-16:42:41] [V] [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Conv_131 || Conv_156 || Conv_181 (CublasConvolution) [07/29/2021-16:42:41] [V] [TRT] CublasConvolution has no valid tactics for this config, skipping [07/29/2021-16:42:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -8010679767156598961 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.018508 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.015472 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.015472 [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,204800) -> Float(1,4,51200) *************** [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Transpose_132 + Reshape_138 (Shuffle) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.009356 [07/29/2021-16:42:41] [V] [TRT] Tactic: 1 time 0.022712 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.009356 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.026124 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.039504 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.026124 [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,204800) -> Float(1,10,128000) *************** [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Transpose_182 + Reshape_188 (Shuffle) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.022028 [07/29/2021-16:42:41] [V] [TRT] Tactic: 1 time 0.042968 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.022028 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 490 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.009196 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.009392 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.009196 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 502 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.006688 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.006304 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006304 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 514 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.006364 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.005192 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005192 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 564 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.019452 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.017176 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.017176 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 576 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.008508 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.008316 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.008316 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 588 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.0063 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.005744 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005744 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.006616 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.006016 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006016 [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(1,20,400,12800) -> Float(1,2,1600) *************** [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Transpose_173 + Reshape_179 (Shuffle) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.005308 [07/29/2021-16:42:41] [V] [TRT] Tactic: 1 time 0.010228 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005308 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.008732 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.006908 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006908 [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(1,40,1600,51200) -> Float(1,2,6400) *************** [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Transpose_165 + Reshape_171 (Shuffle) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.005804 [07/29/2021-16:42:41] [V] [TRT] Tactic: 1 time 0.01216 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005804 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.017648 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.01034 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.01034 [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(1,80,6400,204800) -> Float(1,2,25600) *************** [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Transpose_157 + Reshape_163 (Shuffle) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.00746 [07/29/2021-16:42:41] [V] [TRT] Tactic: 1 time 0.021512 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00746 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 527 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.007276 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.007292 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 1002 Time: 0.007276 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 539 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.006408 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.005448 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.005448 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: 551 copy (Reformat) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1002 time 0.006304 [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.00526 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.00526 [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(1,2,33600) -> Float(1,2) *************** [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 223) [Shuffle] (Shuffle) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.006344 [07/29/2021-16:42:41] [V] [TRT] Tactic: 1 time 0.011872 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006344 [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(1,2) -> Float(1,2) *************** [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Softmax_206 (SoftMax) [07/29/2021-16:42:41] [V] [TRT] Tactic: 1001 time 1.3544 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 1001 Time: 1.3544 [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: Softmax_206 (ExtSoftMax) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.151508 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.151508 [07/29/2021-16:42:41] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ExtSoftMax Tactic: 0 [07/29/2021-16:42:41] [V] [TRT] [07/29/2021-16:42:41] [V] [TRT] *************** Autotuning format combination: Float(1,2) -> Float(1,2,33600) *************** [07/29/2021-16:42:41] [V] [TRT] --------------- Timing Runner: (Unnamed Layer* 225) [Shuffle] (Shuffle) [07/29/2021-16:42:41] [V] [TRT] Tactic: 0 time 0.006392 [07/29/2021-16:42:41] [V] [TRT] Tactic: 1 time 0.012284 [07/29/2021-16:42:41] [V] [TRT] Fastest Tactic: 0 Time: 0.006392 [07/29/2021-16:42:41] [V] [TRT] Formats and tactics selection completed in 41.6611 seconds. [07/29/2021-16:42:41] [V] [TRT] After reformat layers: 114 layers [07/29/2021-16:42:41] [V] [TRT] Block size 52428800 [07/29/2021-16:42:41] [V] [TRT] Block size 52428800 [07/29/2021-16:42:41] [V] [TRT] Block size 26214400 [07/29/2021-16:42:41] [V] [TRT] Block size 16777216 [07/29/2021-16:42:41] [V] [TRT] Block size 6553600 [07/29/2021-16:42:41] [V] [TRT] Block size 3276800 [07/29/2021-16:42:41] [V] [TRT] Block size 1638400 [07/29/2021-16:42:41] [V] [TRT] Block size 819200 [07/29/2021-16:42:41] [V] [TRT] Block size 409600 [07/29/2021-16:42:41] [V] [TRT] Block size 256000 [07/29/2021-16:42:41] [V] [TRT] Block size 102400 [07/29/2021-16:42:41] [V] [TRT] Total Activation Memory: 160905216 [07/29/2021-16:42:41] [I] [TRT] Detected 1 inputs and 9 output network tensors. [07/29/2021-16:42:41] [V] [TRT] Conv_4 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_8 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_12 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_16 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_20 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_54 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_24 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_28 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_32 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_36 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_40 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_44 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_56 (scudnn) Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_48 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_52 (scudnn) Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_122 || Conv_123 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_125 || Conv_126 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_80 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_128 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_113 || Conv_114 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_116 || Conv_117 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_119 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_104 || Conv_105 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_107 || Conv_108 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_139 || Conv_164 || Conv_189 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_110 (scudnn_winograd) Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 [07/29/2021-16:42:41] [V] [TRT] Conv_131 || Conv_156 || Conv_181 (scudnn) Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_0 Weights: 864 HostPersistent: 8 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_1 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_2 Weights: 288 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_3 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_4 Weights: 0 HostPersistent: 2176 DevicePersistent: 615424 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_5 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_6 Weights: 576 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_7 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_8 Weights: 0 HostPersistent: 1664 DevicePersistent: 156160 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_9 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_10 Weights: 1152 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_11 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_12 Weights: 0 HostPersistent: 2176 DevicePersistent: 158208 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_13 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_14 Weights: 1152 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_15 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_16 Weights: 0 HostPersistent: 1664 DevicePersistent: 47104 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_17 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_18 Weights: 2304 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_19 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_20 Weights: 0 HostPersistent: 1664 DevicePersistent: 55296 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_21 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_22 Weights: 2304 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_54 Weights: 0 HostPersistent: 1664 DevicePersistent: 55296 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_23 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_24 Weights: 0 HostPersistent: 3200 DevicePersistent: 43008 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_25 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_26 Weights: 4608 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_27 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_28 Weights: 0 HostPersistent: 3200 DevicePersistent: 75776 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_29 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_30 Weights: 4608 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_31 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_32 Weights: 0 HostPersistent: 3200 DevicePersistent: 75776 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_33 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_34 Weights: 4608 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_35 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_36 Weights: 0 HostPersistent: 3200 DevicePersistent: 75776 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_37 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_38 Weights: 4608 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_39 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_40 Weights: 0 HostPersistent: 3200 DevicePersistent: 75776 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_41 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_42 Weights: 4608 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_43 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_44 Weights: 0 HostPersistent: 3200 DevicePersistent: 75776 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_45 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_46 Weights: 4608 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_56 Weights: 0 HostPersistent: 3200 DevicePersistent: 43008 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_47 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_48 Weights: 0 HostPersistent: 3200 DevicePersistent: 134656 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_49 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_50 Weights: 9216 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_51 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_52 Weights: 0 HostPersistent: 3200 DevicePersistent: 265728 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_53 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_58 Weights: 65536 HostPersistent: 8 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_59 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_122 || Conv_123 Weights: 0 HostPersistent: 512 DevicePersistent: 373248 [07/29/2021-16:42:41] [V] [TRT] Layer: Resize_78 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_124 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: PWN(LeakyRelu_57, Add_79) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_125 || Conv_126 Weights: 0 HostPersistent: 512 DevicePersistent: 51712 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_80 Weights: 0 HostPersistent: 512 DevicePersistent: 410112 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_127 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_81 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_128 Weights: 0 HostPersistent: 512 DevicePersistent: 42496 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_113 || Conv_114 Weights: 0 HostPersistent: 512 DevicePersistent: 373248 [07/29/2021-16:42:41] [V] [TRT] Layer: Resize_100 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_115 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: PWN(LeakyRelu_55, Add_101) Weights: 0 HostPersistent: 372 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 717 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 723 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Relu_130 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_116 || Conv_117 Weights: 0 HostPersistent: 512 DevicePersistent: 51712 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_102 Weights: 147456 HostPersistent: 8 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_147 || Conv_172 || Conv_197 Weights: 8192 HostPersistent: 8 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_148 + Reshape_154 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_198 + Reshape_204 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_118 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_103 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_119 Weights: 0 HostPersistent: 512 DevicePersistent: 42496 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_104 || Conv_105 Weights: 0 HostPersistent: 512 DevicePersistent: 373248 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_106 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 702 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 708 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Relu_121 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_107 || Conv_108 Weights: 0 HostPersistent: 512 DevicePersistent: 51712 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_139 || Conv_164 || Conv_189 Weights: 0 HostPersistent: 2176 DevicePersistent: 18432 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_140 + Reshape_146 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_190 + Reshape_196 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: LeakyRelu_109 Weights: 0 HostPersistent: 276 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_110 Weights: 0 HostPersistent: 512 DevicePersistent: 42496 [07/29/2021-16:42:41] [V] [TRT] Layer: 687 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 693 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Relu_112 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Conv_131 || Conv_156 || Conv_181 Weights: 0 HostPersistent: 3200 DevicePersistent: 47104 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_132 + Reshape_138 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_182 + Reshape_188 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 490 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 502 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 514 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 564 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 576 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 588 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_173 + Reshape_179 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_165 + Reshape_171 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Transpose_157 + Reshape_163 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 527 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 539 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: 551 copy Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Layer: Softmax_206 Weights: 0 HostPersistent: 0 DevicePersistent: 0 [07/29/2021-16:42:41] [V] [TRT] Total Host Persistent Memory: 61016 [07/29/2021-16:42:41] [V] [TRT] Total Device Persistent Memory: 3830784 [07/29/2021-16:42:41] [V] [TRT] Total Weight Memory: 266688 [07/29/2021-16:42:41] [07/29/2021-16:42:41] [V] [TRT] Engine generation completed in 42.5987 seconds. [07/29/2021-16:42:41] [V] [TRT] Builder timing cache: created 308 entries, 387 hit(s) [07/29/2021-16:42:41] [V] [TRT] Engine Layer Information: [07/29/2021-16:42:41] [V] [TRT] Layer(Convolution): Conv_0, Tactic: 56, input[Float(3,640,640)] -> 591[Float(8,320,320)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_1, Tactic: 2, 591[Float(8,320,320)] -> 303[Float(8,320,320)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_2, Tactic: -1, 303[Float(8,320,320)] -> 594[Float(8,320,320)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_3, Tactic: 2, 594[Float(8,320,320)] -> 306[Float(8,320,320)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_4, Tactic: -4420849921117327522, 306[Float(8,320,320)] -> 597[Float(16,320,320)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_5, Tactic: 28, 597[Float(16,320,320)] -> 309[Float(16,320,320)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_6, Tactic: -1, 309[Float(16,320,320)] -> 600[Float(16,160,160)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_7, Tactic: 0, 600[Float(16,160,160)] -> 312[Float(16,160,160)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_8, Tactic: -3946921629105938337, 312[Float(16,160,160)] -> 603[Float(32,160,160)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_9, Tactic: 28, 603[Float(32,160,160)] -> 315[Float(32,160,160)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_10, Tactic: -1, 315[Float(32,160,160)] -> 606[Float(32,160,160)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_11, Tactic: 28, 606[Float(32,160,160)] -> 318[Float(32,160,160)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_12, Tactic: -4420849921117327522, 318[Float(32,160,160)] -> 609[Float(32,160,160)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_13, Tactic: 28, 609[Float(32,160,160)] -> 321[Float(32,160,160)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_14, Tactic: -1, 321[Float(32,160,160)] -> 612[Float(32,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_15, Tactic: 28, 612[Float(32,80,80)] -> 324[Float(32,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_16, Tactic: 6808617066150061604, 324[Float(32,80,80)] -> 615[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_17, Tactic: 0, 615[Float(64,80,80)] -> 327[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_18, Tactic: -1, 327[Float(64,80,80)] -> 618[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_19, Tactic: 0, 618[Float(64,80,80)] -> 330[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_20, Tactic: 6808617066150061604, 330[Float(64,80,80)] -> 621[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_21, Tactic: 0, 621[Float(64,80,80)] -> 333[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_22, Tactic: -1, 333[Float(64,80,80)] -> 624[Float(64,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_54, Tactic: 6808617066150061604, 333[Float(64,80,80)] -> 672[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_23, Tactic: 8, 624[Float(64,40,40)] -> 336[Float(64,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_24, Tactic: 9091006216302412844, 336[Float(64,40,40)] -> 627[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_25, Tactic: 0, 627[Float(128,40,40)] -> 339[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_26, Tactic: -1, 339[Float(128,40,40)] -> 630[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_27, Tactic: 0, 630[Float(128,40,40)] -> 342[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_28, Tactic: 9091006216302412844, 342[Float(128,40,40)] -> 633[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_29, Tactic: 0, 633[Float(128,40,40)] -> 345[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_30, Tactic: -1, 345[Float(128,40,40)] -> 636[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_31, Tactic: 0, 636[Float(128,40,40)] -> 348[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_32, Tactic: 9091006216302412844, 348[Float(128,40,40)] -> 639[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_33, Tactic: 0, 639[Float(128,40,40)] -> 351[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_34, Tactic: -1, 351[Float(128,40,40)] -> 642[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_35, Tactic: 0, 642[Float(128,40,40)] -> 354[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_36, Tactic: 9091006216302412844, 354[Float(128,40,40)] -> 645[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_37, Tactic: 0, 645[Float(128,40,40)] -> 357[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_38, Tactic: -1, 357[Float(128,40,40)] -> 648[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_39, Tactic: 0, 648[Float(128,40,40)] -> 360[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_40, Tactic: 9091006216302412844, 360[Float(128,40,40)] -> 651[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_41, Tactic: 0, 651[Float(128,40,40)] -> 363[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_42, Tactic: -1, 363[Float(128,40,40)] -> 654[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_43, Tactic: 0, 654[Float(128,40,40)] -> 366[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_44, Tactic: 9091006216302412844, 366[Float(128,40,40)] -> 657[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_45, Tactic: 0, 657[Float(128,40,40)] -> 369[Float(128,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_46, Tactic: -1, 369[Float(128,40,40)] -> 660[Float(128,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_56, Tactic: 9091006216302412844, 369[Float(128,40,40)] -> 675[Float(64,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_47, Tactic: 5, 660[Float(128,20,20)] -> 372[Float(128,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_48, Tactic: 1754569683116234317, 372[Float(128,20,20)] -> 663[Float(256,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_49, Tactic: 8, 663[Float(256,20,20)] -> 375[Float(256,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(DepthwiseConvolution): Conv_50, Tactic: -1, 375[Float(256,20,20)] -> 666[Float(256,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_51, Tactic: 8, 666[Float(256,20,20)] -> 378[Float(256,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_52, Tactic: 1754569683116234317, 378[Float(256,20,20)] -> 669[Float(256,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_53, Tactic: 8, 669[Float(256,20,20)] -> 381[Float(256,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(Convolution): Conv_58, Tactic: 1, 381[Float(256,20,20)] -> 678[Float(64,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_59, Tactic: 5, 678[Float(64,20,20)] -> 390[Float(64,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_122 || Conv_123, Tactic: 2775507031594384867, 390[Float(64,20,20)] -> Conv_122 || Conv_123[Float(48,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(Resize): Resize_78, Tactic: 0, 390[Float(64,20,20)] -> 409[Float(64,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_124, Tactic: 2, Conv_122 || Conv_123[Float(16,20,20)] -> 469[Float(16,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): PWN(LeakyRelu_57, Add_79), Tactic: 2, 675[Float(64,40,40)], 409[Float(64,40,40)] -> 410[Float(64,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_125 || Conv_126, Tactic: 2775507031594384867, 469[Float(16,20,20)] -> Conv_125 || Conv_126[Float(32,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_80, Tactic: 2775507031594384867, 410[Float(64,40,40)] -> 681[Float(64,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_127, Tactic: 28, Conv_125 || Conv_126[Float(16,20,20)] -> 474[Float(16,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_81, Tactic: 8, 681[Float(64,40,40)] -> 413[Float(64,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_128, Tactic: 2775507031594384867, 474[Float(16,20,20)] -> 477[Float(16,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_113 || Conv_114, Tactic: 2775507031594384867, 413[Float(64,40,40)] -> Conv_113 || Conv_114[Float(48,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(Resize): Resize_100, Tactic: 0, 413[Float(64,40,40)] -> 432[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_115, Tactic: 5, Conv_113 || Conv_114[Float(16,40,40)] -> 455[Float(16,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): PWN(LeakyRelu_55, Add_101), Tactic: 2, 672[Float(64,80,80)], 432[Float(64,80,80)] -> 433[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 717 copy, Tactic: 0, Conv_122 || Conv_123[Float(32,20,20)] -> 477[Float(32,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 723 copy, Tactic: 0, Conv_125 || Conv_126[Float(16,20,20)] -> 477[Float(16,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(Activation): Relu_130, Tactic: 0, 477[Float(64,20,20)] -> 478[Float(64,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_116 || Conv_117, Tactic: 2775507031594384867, 455[Float(16,40,40)] -> Conv_116 || Conv_117[Float(32,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(Convolution): Conv_102, Tactic: 6, 433[Float(64,80,80)] -> 684[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(Convolution): Conv_147 || Conv_172 || Conv_197, Tactic: 57, 478[Float(64,20,20)] -> Conv_147 || Conv_172 || Conv_197[Float(32,20,20)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_148 + Reshape_154, Tactic: 0, Conv_147 || Conv_172 || Conv_197[Float(8,20,20)] -> 514[Float(800,4)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_198 + Reshape_204, Tactic: 0, Conv_147 || Conv_172 || Conv_197[Float(20,20,20)] -> 588[Float(800,10)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_118, Tactic: 2, Conv_116 || Conv_117[Float(16,40,40)] -> 460[Float(16,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_103, Tactic: 0, 684[Float(64,80,80)] -> 436[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_119, Tactic: 2775507031594384867, 460[Float(16,40,40)] -> 463[Float(16,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_104 || Conv_105, Tactic: 2775507031594384867, 436[Float(64,80,80)] -> Conv_104 || Conv_105[Float(48,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_106, Tactic: 9, Conv_104 || Conv_105[Float(16,80,80)] -> 441[Float(16,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 702 copy, Tactic: 0, Conv_113 || Conv_114[Float(32,40,40)] -> 463[Float(32,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 708 copy, Tactic: 0, Conv_116 || Conv_117[Float(16,40,40)] -> 463[Float(16,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(Activation): Relu_121, Tactic: 0, 463[Float(64,40,40)] -> 464[Float(64,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_107 || Conv_108, Tactic: 2775507031594384867, 441[Float(16,80,80)] -> Conv_107 || Conv_108[Float(32,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_139 || Conv_164 || Conv_189, Tactic: -4420849921117327522, 464[Float(64,40,40)] -> Conv_139 || Conv_164 || Conv_189[Float(32,40,40)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_140 + Reshape_146, Tactic: 0, Conv_139 || Conv_164 || Conv_189[Float(8,40,40)] -> 502[Float(3200,4)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_190 + Reshape_196, Tactic: 0, Conv_139 || Conv_164 || Conv_189[Float(20,40,40)] -> 576[Float(3200,10)] [07/29/2021-16:42:41] [V] [TRT] Layer(PointWiseV2): LeakyRelu_109, Tactic: 8, Conv_107 || Conv_108[Float(16,80,80)] -> 446[Float(16,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn_winograd): Conv_110, Tactic: 2775507031594384867, 446[Float(16,80,80)] -> 449[Float(16,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 687 copy, Tactic: 0, Conv_104 || Conv_105[Float(32,80,80)] -> 449[Float(32,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 693 copy, Tactic: 0, Conv_107 || Conv_108[Float(16,80,80)] -> 449[Float(16,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(Activation): Relu_112, Tactic: 0, 449[Float(64,80,80)] -> 450[Float(64,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(scudnn): Conv_131 || Conv_156 || Conv_181, Tactic: 2733356012094739613, 450[Float(64,80,80)] -> Conv_131 || Conv_156 || Conv_181[Float(32,80,80)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_132 + Reshape_138, Tactic: 0, Conv_131 || Conv_156 || Conv_181[Float(8,80,80)] -> 490[Float(12800,4)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_182 + Reshape_188, Tactic: 0, Conv_131 || Conv_156 || Conv_181[Float(20,80,80)] -> 564[Float(12800,10)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 490 copy, Tactic: 1002, 490[Float(12800,4)] -> output[Float(12800,4)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 502 copy, Tactic: 0, 502[Float(3200,4)] -> output[Float(3200,4)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 514 copy, Tactic: 0, 514[Float(800,4)] -> output[Float(800,4)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 564 copy, Tactic: 0, 564[Float(12800,10)] -> 589[Float(12800,10)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 576 copy, Tactic: 0, 576[Float(3200,10)] -> 589[Float(3200,10)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 588 copy, Tactic: 0, 588[Float(800,10)] -> 589[Float(800,10)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_173 + Reshape_179, Tactic: 0, Conv_147 || Conv_172 || Conv_197[Float(4,20,20)] -> 551[Float(800,2)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_165 + Reshape_171, Tactic: 0, Conv_139 || Conv_164 || Conv_189[Float(4,40,40)] -> 539[Float(3200,2)] [07/29/2021-16:42:41] [V] [TRT] Layer(Shuffle): Transpose_157 + Reshape_163, Tactic: 0, Conv_131 || Conv_156 || Conv_181[Float(4,80,80)] -> 527[Float(12800,2)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 527 copy, Tactic: 1002, 527[Float(12800,2)] -> 552[Float(12800,2)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 539 copy, Tactic: 0, 539[Float(3200,2)] -> 552[Float(3200,2)] [07/29/2021-16:42:41] [V] [TRT] Layer(Reformat): 551 copy, Tactic: 0, 551[Float(800,2)] -> 552[Float(800,2)] [07/29/2021-16:42:41] [V] [TRT] Layer(ExtSoftMax): Softmax_206, Tactic: 0, (Unnamed Layer* 223) [Shuffle]_output[Float(2)] -> (Unnamed Layer* 224) [Softmax]_output[Float(2)] [07/29/2021-16:42:41] [I] Engine built in 43.1196 sec. [07/29/2021-16:42:41] [07/29/2021-16:42:41] [V] [TRT] Allocated persistent device memory of size 3830784 [07/29/2021-16:42:41] [V] [TRT] Allocated activation device memory of size 140851200 [07/29/2021-16:42:41] [V] [TRT] Assigning persistent memory blocks for various profiles [07/29/2021-16:42:41] [I] Starting inference [07/29/2021-16:42:44] [I] Warmup completed 0 queries over 200 ms [07/29/2021-16:42:44] [I] Timing trace has 0 queries over 3.02423 s [07/29/2021-16:42:44] [I] Trace averages of 10 runs: [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.23657 ms - Host latency: 10.3542 ms (end to end 14.3089 ms, enqueue 0.625488 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.22816 ms - Host latency: 10.3376 ms (end to end 14.3196 ms, enqueue 0.569229 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.22165 ms - Host latency: 10.3409 ms (end to end 14.3168 ms, enqueue 0.606268 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.2449 ms - Host latency: 10.3623 ms (end to end 14.3824 ms, enqueue 0.588931 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.23405 ms - Host latency: 10.349 ms (end to end 14.3293 ms, enqueue 0.617191 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.2111 ms - Host latency: 10.331 ms (end to end 14.304 ms, enqueue 0.586365 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.19706 ms - Host latency: 10.3036 ms (end to end 14.2159 ms, enqueue 0.597876 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.22953 ms - Host latency: 10.3538 ms (end to end 14.3142 ms, enqueue 0.584552 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.19506 ms - Host latency: 10.3055 ms (end to end 14.2948 ms, enqueue 0.575867 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.55176 ms - Host latency: 10.6607 ms (end to end 14.9077 ms, enqueue 0.605328 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.47974 ms - Host latency: 10.597 ms (end to end 14.8578 ms, enqueue 0.570898 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.3358 ms - Host latency: 10.4616 ms (end to end 14.5829 ms, enqueue 0.580591 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.2254 ms - Host latency: 10.352 ms (end to end 14.3349 ms, enqueue 0.614124 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.20968 ms - Host latency: 10.3321 ms (end to end 14.2746 ms, enqueue 0.621374 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.23291 ms - Host latency: 10.3452 ms (end to end 14.3212 ms, enqueue 0.595886 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.23557 ms - Host latency: 10.3563 ms (end to end 14.3412 ms, enqueue 0.593408 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.22301 ms - Host latency: 10.3481 ms (end to end 14.303 ms, enqueue 0.641687 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.23844 ms - Host latency: 10.3536 ms (end to end 14.3131 ms, enqueue 0.645374 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.24683 ms - Host latency: 10.3599 ms (end to end 14.3457 ms, enqueue 0.636902 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.22384 ms - Host latency: 10.3455 ms (end to end 14.3001 ms, enqueue 0.633252 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.2071 ms - Host latency: 10.3258 ms (end to end 14.2534 ms, enqueue 0.608777 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.2285 ms - Host latency: 10.3544 ms (end to end 14.3291 ms, enqueue 0.665491 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.34712 ms - Host latency: 10.4759 ms (end to end 14.5235 ms, enqueue 0.654883 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.33076 ms - Host latency: 10.4534 ms (end to end 14.5105 ms, enqueue 0.640088 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.31859 ms - Host latency: 10.4363 ms (end to end 14.4588 ms, enqueue 0.651587 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.2908 ms - Host latency: 10.412 ms (end to end 14.4192 ms, enqueue 0.65022 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.26448 ms - Host latency: 10.3828 ms (end to end 14.334 ms, enqueue 0.636279 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.27256 ms - Host latency: 10.3944 ms (end to end 13.8748 ms, enqueue 0.62749 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.25056 ms - Host latency: 10.3773 ms (end to end 14.3273 ms, enqueue 0.644409 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.2344 ms - Host latency: 10.3526 ms (end to end 14.3133 ms, enqueue 0.664014 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.30881 ms - Host latency: 10.4228 ms (end to end 14.4535 ms, enqueue 0.623804 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.28188 ms - Host latency: 10.4026 ms (end to end 14.4198 ms, enqueue 0.575391 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.22954 ms - Host latency: 10.3536 ms (end to end 14.3144 ms, enqueue 0.636475 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.22185 ms - Host latency: 10.3518 ms (end to end 14.2782 ms, enqueue 0.662915 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.23403 ms - Host latency: 10.3506 ms (end to end 14.3035 ms, enqueue 0.669043 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.28582 ms - Host latency: 10.4 ms (end to end 14.4298 ms, enqueue 0.601221 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.29927 ms - Host latency: 10.4164 ms (end to end 14.4491 ms, enqueue 0.659741 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.32153 ms - Host latency: 10.4365 ms (end to end 14.5153 ms, enqueue 0.615869 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.27847 ms - Host latency: 10.3994 ms (end to end 14.4922 ms, enqueue 0.554321 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.28384 ms - Host latency: 10.3993 ms (end to end 14.4928 ms, enqueue 0.564746 ms) [07/29/2021-16:42:44] [I] Average on 10 runs - GPU latency: 7.27717 ms - Host latency: 10.3857 ms (end to end 14.4765 ms, enqueue 0.562476 ms) [07/29/2021-16:42:44] [I] Host Latency [07/29/2021-16:42:44] [I] min: 10.1789 ms (end to end 11.772 ms) [07/29/2021-16:42:44] [I] max: 10.8303 ms (end to end 15.2147 ms) [07/29/2021-16:42:44] [I] mean: 10.3859 ms (end to end 14.3824 ms) [07/29/2021-16:42:44] [I] median: 10.3615 ms (end to end 14.3597 ms) [07/29/2021-16:42:44] [I] percentile: 10.6957 ms at 99% (end to end 15.049 ms at 99%) [07/29/2021-16:42:44] [I] throughput: 0 qps [07/29/2021-16:42:44] [I] walltime: 3.02423 s [07/29/2021-16:42:44] [I] Enqueue Time [07/29/2021-16:42:44] [I] min: 0.504883 ms [07/29/2021-16:42:44] [I] max: 0.934937 ms [07/29/2021-16:42:44] [I] median: 0.602783 ms [07/29/2021-16:42:44] [I] GPU Compute [07/29/2021-16:42:44] [I] min: 7.07336 ms [07/29/2021-16:42:44] [I] max: 7.69513 ms [07/29/2021-16:42:44] [I] mean: 7.26735 ms [07/29/2021-16:42:44] [I] median: 7.24219 ms [07/29/2021-16:42:44] [I] percentile: 7.59192 ms at 99% [07/29/2021-16:42:44] [I] total compute time: 3.01595 s &&&& PASSED TensorRT.trtexec # trtexec --onnx=models/weights/Retinaface_m25_dynamic_batch.onnx --verbose --explicitBatch --minShapes=input:1x3x640x640 --optShapes=input:4x3x640x640 --maxShapes=input:8x3x640x640 --shapes=input:5x3x640x640 --saveEngine=./models/weights/retinaface.trt