[07/07/2022-18:29:48] [TRT] [I] [MemUsageChange] Init CUDA: CPU +315, GPU +0, now: CPU 443, GPU 313 (MiB) [07/07/2022-18:29:49] [TRT] [I] [MemUsageChange] Init builder kernel library: CPU +208, GPU +68, now: CPU 670, GPU 381 (MiB) [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::GridAnchor_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::GridAnchorRect_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::NMS_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::Reorg_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::Region_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::Clip_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::LReLU_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::PriorBox_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::Normalize_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::ScatterND version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::RPROI_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::BatchedNMS_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::FlattenConcat_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::CropAndResize version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::CropAndResizeDynamic version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::DetectionLayer_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::EfficientNMS_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::ProposalDynamic version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::Proposal version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::ProposalLayer_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::ResizeNearest_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::Split version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::SpecialSlice_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::InstanceNormalization_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::InstanceNormalization_TRT version 2 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::CoordConvAC version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::DecodeBbox3DPlugin version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::GenerateDetection_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::NMSDynamic_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::PillarScatterPlugin version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::VoxelGeneratorPlugin version 1 [07/07/2022-18:29:49] [TRT] [V] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1 [07/07/2022-18:29:49] [TRT] [V] Adding network input: images with dtype: float32, dimensions: (1, 3, 608, 608) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: images for ONNX tensor: images [07/07/2022-18:29:49] [TRT] [V] Importing initializer: conv_up_level1.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: conv_up_level1.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: conv_up_level2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: conv_up_level2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: conv_up_level3.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: conv_up_level3.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_cen_offset.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_cen_offset.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_cen_offset.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_cen_offset.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_dim.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_dim.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_dim.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_dim.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_direction.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_direction.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_direction.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_direction.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_hm_cen.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_hm_cen.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_hm_cen.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_hm_cen.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_z_coor.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_z_coor.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_z_coor.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn0_z_coor.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_cen_offset.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_cen_offset.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_cen_offset.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_cen_offset.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_dim.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_dim.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_dim.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_dim.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_direction.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_direction.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_direction.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_direction.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_hm_cen.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_hm_cen.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_hm_cen.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_hm_cen.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_z_coor.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_z_coor.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_z_coor.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn1_z_coor.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_cen_offset.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_cen_offset.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_cen_offset.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_cen_offset.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_dim.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_dim.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_dim.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_dim.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_direction.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_direction.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_direction.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_direction.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_hm_cen.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_hm_cen.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_hm_cen.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_hm_cen.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_z_coor.0.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_z_coor.0.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_z_coor.2.weight [07/07/2022-18:29:49] [TRT] [V] Importing initializer: fpn2_z_coor.2.bias [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 452 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 453 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 455 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 456 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 458 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 459 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 461 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 462 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 464 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 465 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 467 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 468 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 470 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 471 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 473 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 474 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 476 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 477 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 479 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 480 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 482 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 483 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 485 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 486 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 488 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 489 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 491 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 492 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 494 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 495 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 497 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 498 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 500 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 501 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 503 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 504 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 506 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 507 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 509 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 510 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 511 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 290 [07/07/2022-18:29:49] [TRT] [W] onnx2trt_utils.cpp:369: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 300 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 302 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 304 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 309 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 325 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 335 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 337 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 339 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 344 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 360 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 370 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 372 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 374 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 379 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 395 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 405 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 407 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 409 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 414 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 430 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 440 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 442 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 444 [07/07/2022-18:29:49] [TRT] [V] Importing initializer: 449 [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_0 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: images [07/07/2022-18:29:49] [TRT] [V] Searching for input: 452 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 453 [07/07/2022-18:29:49] [TRT] [V] Conv_0 [Conv] inputs: [images -> (1, 3, 608, 608)[FLOAT]], [452 -> (64, 3, 7, 7)[FLOAT]], [453 -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 3, 608, 608) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_0 for ONNX node: Conv_0 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (7, 7), strides: (2, 2), prepadding: (3, 3), postpadding: (3, 3), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 304, 304) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 451 for ONNX tensor: 451 [07/07/2022-18:29:49] [TRT] [V] Conv_0 [Conv] outputs: [451 -> (1, 64, 304, 304)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_1 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 451 [07/07/2022-18:29:49] [TRT] [V] Relu_1 [Relu] inputs: [451 -> (1, 64, 304, 304)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_1 for ONNX node: Relu_1 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 191 for ONNX tensor: 191 [07/07/2022-18:29:49] [TRT] [V] Relu_1 [Relu] outputs: [191 -> (1, 64, 304, 304)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: MaxPool_2 [MaxPool] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 191 [07/07/2022-18:29:49] [TRT] [V] MaxPool_2 [MaxPool] inputs: [191 -> (1, 64, 304, 304)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: MaxPool_2 for ONNX node: MaxPool_2 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 192 for ONNX tensor: 192 [07/07/2022-18:29:49] [TRT] [V] MaxPool_2 [MaxPool] outputs: [192 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_3 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 192 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 455 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 456 [07/07/2022-18:29:49] [TRT] [V] Conv_3 [Conv] inputs: [192 -> (1, 64, 152, 152)[FLOAT]], [455 -> (64, 64, 3, 3)[FLOAT]], [456 -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_3 for ONNX node: Conv_3 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 454 for ONNX tensor: 454 [07/07/2022-18:29:49] [TRT] [V] Conv_3 [Conv] outputs: [454 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_4 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 454 [07/07/2022-18:29:49] [TRT] [V] Relu_4 [Relu] inputs: [454 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_4 for ONNX node: Relu_4 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 195 for ONNX tensor: 195 [07/07/2022-18:29:49] [TRT] [V] Relu_4 [Relu] outputs: [195 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_5 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 195 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 458 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 459 [07/07/2022-18:29:49] [TRT] [V] Conv_5 [Conv] inputs: [195 -> (1, 64, 152, 152)[FLOAT]], [458 -> (64, 64, 3, 3)[FLOAT]], [459 -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_5 for ONNX node: Conv_5 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 457 for ONNX tensor: 457 [07/07/2022-18:29:49] [TRT] [V] Conv_5 [Conv] outputs: [457 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Add_6 [Add] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 457 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 192 [07/07/2022-18:29:49] [TRT] [V] Add_6 [Add] inputs: [457 -> (1, 64, 152, 152)[FLOAT]], [192 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Add_6 for ONNX node: Add_6 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 198 for ONNX tensor: 198 [07/07/2022-18:29:49] [TRT] [V] Add_6 [Add] outputs: [198 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_7 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 198 [07/07/2022-18:29:49] [TRT] [V] Relu_7 [Relu] inputs: [198 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_7 for ONNX node: Relu_7 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 199 for ONNX tensor: 199 [07/07/2022-18:29:49] [TRT] [V] Relu_7 [Relu] outputs: [199 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_8 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 199 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 461 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 462 [07/07/2022-18:29:49] [TRT] [V] Conv_8 [Conv] inputs: [199 -> (1, 64, 152, 152)[FLOAT]], [461 -> (64, 64, 3, 3)[FLOAT]], [462 -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_8 for ONNX node: Conv_8 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 460 for ONNX tensor: 460 [07/07/2022-18:29:49] [TRT] [V] Conv_8 [Conv] outputs: [460 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_9 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 460 [07/07/2022-18:29:49] [TRT] [V] Relu_9 [Relu] inputs: [460 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_9 for ONNX node: Relu_9 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 202 for ONNX tensor: 202 [07/07/2022-18:29:49] [TRT] [V] Relu_9 [Relu] outputs: [202 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_10 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 202 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 464 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 465 [07/07/2022-18:29:49] [TRT] [V] Conv_10 [Conv] inputs: [202 -> (1, 64, 152, 152)[FLOAT]], [464 -> (64, 64, 3, 3)[FLOAT]], [465 -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_10 for ONNX node: Conv_10 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 463 for ONNX tensor: 463 [07/07/2022-18:29:49] [TRT] [V] Conv_10 [Conv] outputs: [463 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Add_11 [Add] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 463 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 199 [07/07/2022-18:29:49] [TRT] [V] Add_11 [Add] inputs: [463 -> (1, 64, 152, 152)[FLOAT]], [199 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Add_11 for ONNX node: Add_11 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 205 for ONNX tensor: 205 [07/07/2022-18:29:49] [TRT] [V] Add_11 [Add] outputs: [205 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_12 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 205 [07/07/2022-18:29:49] [TRT] [V] Relu_12 [Relu] inputs: [205 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_12 for ONNX node: Relu_12 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 206 for ONNX tensor: 206 [07/07/2022-18:29:49] [TRT] [V] Relu_12 [Relu] outputs: [206 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_13 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 206 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 467 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 468 [07/07/2022-18:29:49] [TRT] [V] Conv_13 [Conv] inputs: [206 -> (1, 64, 152, 152)[FLOAT]], [467 -> (128, 64, 3, 3)[FLOAT]], [468 -> (128)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_13 for ONNX node: Conv_13 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 466 for ONNX tensor: 466 [07/07/2022-18:29:49] [TRT] [V] Conv_13 [Conv] outputs: [466 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_14 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 466 [07/07/2022-18:29:49] [TRT] [V] Relu_14 [Relu] inputs: [466 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_14 for ONNX node: Relu_14 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 209 for ONNX tensor: 209 [07/07/2022-18:29:49] [TRT] [V] Relu_14 [Relu] outputs: [209 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_15 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 209 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 470 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 471 [07/07/2022-18:29:49] [TRT] [V] Conv_15 [Conv] inputs: [209 -> (1, 128, 76, 76)[FLOAT]], [470 -> (128, 128, 3, 3)[FLOAT]], [471 -> (128)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_15 for ONNX node: Conv_15 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 469 for ONNX tensor: 469 [07/07/2022-18:29:49] [TRT] [V] Conv_15 [Conv] outputs: [469 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_16 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 206 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 473 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 474 [07/07/2022-18:29:49] [TRT] [V] Conv_16 [Conv] inputs: [206 -> (1, 64, 152, 152)[FLOAT]], [473 -> (128, 64, 1, 1)[FLOAT]], [474 -> (128)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_16 for ONNX node: Conv_16 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 472 for ONNX tensor: 472 [07/07/2022-18:29:49] [TRT] [V] Conv_16 [Conv] outputs: [472 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Add_17 [Add] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 469 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 472 [07/07/2022-18:29:49] [TRT] [V] Add_17 [Add] inputs: [469 -> (1, 128, 76, 76)[FLOAT]], [472 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Add_17 for ONNX node: Add_17 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 214 for ONNX tensor: 214 [07/07/2022-18:29:49] [TRT] [V] Add_17 [Add] outputs: [214 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_18 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 214 [07/07/2022-18:29:49] [TRT] [V] Relu_18 [Relu] inputs: [214 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_18 for ONNX node: Relu_18 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 215 for ONNX tensor: 215 [07/07/2022-18:29:49] [TRT] [V] Relu_18 [Relu] outputs: [215 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_19 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 215 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 476 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 477 [07/07/2022-18:29:49] [TRT] [V] Conv_19 [Conv] inputs: [215 -> (1, 128, 76, 76)[FLOAT]], [476 -> (128, 128, 3, 3)[FLOAT]], [477 -> (128)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_19 for ONNX node: Conv_19 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 475 for ONNX tensor: 475 [07/07/2022-18:29:49] [TRT] [V] Conv_19 [Conv] outputs: [475 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_20 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 475 [07/07/2022-18:29:49] [TRT] [V] Relu_20 [Relu] inputs: [475 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_20 for ONNX node: Relu_20 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 218 for ONNX tensor: 218 [07/07/2022-18:29:49] [TRT] [V] Relu_20 [Relu] outputs: [218 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_21 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 218 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 479 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 480 [07/07/2022-18:29:49] [TRT] [V] Conv_21 [Conv] inputs: [218 -> (1, 128, 76, 76)[FLOAT]], [479 -> (128, 128, 3, 3)[FLOAT]], [480 -> (128)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_21 for ONNX node: Conv_21 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 478 for ONNX tensor: 478 [07/07/2022-18:29:49] [TRT] [V] Conv_21 [Conv] outputs: [478 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Add_22 [Add] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 478 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 215 [07/07/2022-18:29:49] [TRT] [V] Add_22 [Add] inputs: [478 -> (1, 128, 76, 76)[FLOAT]], [215 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Add_22 for ONNX node: Add_22 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 221 for ONNX tensor: 221 [07/07/2022-18:29:49] [TRT] [V] Add_22 [Add] outputs: [221 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_23 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 221 [07/07/2022-18:29:49] [TRT] [V] Relu_23 [Relu] inputs: [221 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_23 for ONNX node: Relu_23 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 222 for ONNX tensor: 222 [07/07/2022-18:29:49] [TRT] [V] Relu_23 [Relu] outputs: [222 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_24 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 222 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 482 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 483 [07/07/2022-18:29:49] [TRT] [V] Conv_24 [Conv] inputs: [222 -> (1, 128, 76, 76)[FLOAT]], [482 -> (256, 128, 3, 3)[FLOAT]], [483 -> (256)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_24 for ONNX node: Conv_24 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 481 for ONNX tensor: 481 [07/07/2022-18:29:49] [TRT] [V] Conv_24 [Conv] outputs: [481 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_25 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 481 [07/07/2022-18:29:49] [TRT] [V] Relu_25 [Relu] inputs: [481 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_25 for ONNX node: Relu_25 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 225 for ONNX tensor: 225 [07/07/2022-18:29:49] [TRT] [V] Relu_25 [Relu] outputs: [225 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_26 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 225 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 485 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 486 [07/07/2022-18:29:49] [TRT] [V] Conv_26 [Conv] inputs: [225 -> (1, 256, 38, 38)[FLOAT]], [485 -> (256, 256, 3, 3)[FLOAT]], [486 -> (256)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_26 for ONNX node: Conv_26 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 484 for ONNX tensor: 484 [07/07/2022-18:29:49] [TRT] [V] Conv_26 [Conv] outputs: [484 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_27 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 222 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 488 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 489 [07/07/2022-18:29:49] [TRT] [V] Conv_27 [Conv] inputs: [222 -> (1, 128, 76, 76)[FLOAT]], [488 -> (256, 128, 1, 1)[FLOAT]], [489 -> (256)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_27 for ONNX node: Conv_27 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 487 for ONNX tensor: 487 [07/07/2022-18:29:49] [TRT] [V] Conv_27 [Conv] outputs: [487 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Add_28 [Add] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 484 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 487 [07/07/2022-18:29:49] [TRT] [V] Add_28 [Add] inputs: [484 -> (1, 256, 38, 38)[FLOAT]], [487 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Add_28 for ONNX node: Add_28 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 230 for ONNX tensor: 230 [07/07/2022-18:29:49] [TRT] [V] Add_28 [Add] outputs: [230 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_29 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 230 [07/07/2022-18:29:49] [TRT] [V] Relu_29 [Relu] inputs: [230 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_29 for ONNX node: Relu_29 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 231 for ONNX tensor: 231 [07/07/2022-18:29:49] [TRT] [V] Relu_29 [Relu] outputs: [231 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_30 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 231 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 491 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 492 [07/07/2022-18:29:49] [TRT] [V] Conv_30 [Conv] inputs: [231 -> (1, 256, 38, 38)[FLOAT]], [491 -> (256, 256, 3, 3)[FLOAT]], [492 -> (256)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_30 for ONNX node: Conv_30 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 490 for ONNX tensor: 490 [07/07/2022-18:29:49] [TRT] [V] Conv_30 [Conv] outputs: [490 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_31 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 490 [07/07/2022-18:29:49] [TRT] [V] Relu_31 [Relu] inputs: [490 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_31 for ONNX node: Relu_31 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 234 for ONNX tensor: 234 [07/07/2022-18:29:49] [TRT] [V] Relu_31 [Relu] outputs: [234 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_32 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 234 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 494 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 495 [07/07/2022-18:29:49] [TRT] [V] Conv_32 [Conv] inputs: [234 -> (1, 256, 38, 38)[FLOAT]], [494 -> (256, 256, 3, 3)[FLOAT]], [495 -> (256)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_32 for ONNX node: Conv_32 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 493 for ONNX tensor: 493 [07/07/2022-18:29:49] [TRT] [V] Conv_32 [Conv] outputs: [493 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Add_33 [Add] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 493 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 231 [07/07/2022-18:29:49] [TRT] [V] Add_33 [Add] inputs: [493 -> (1, 256, 38, 38)[FLOAT]], [231 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Add_33 for ONNX node: Add_33 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 237 for ONNX tensor: 237 [07/07/2022-18:29:49] [TRT] [V] Add_33 [Add] outputs: [237 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_34 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 237 [07/07/2022-18:29:49] [TRT] [V] Relu_34 [Relu] inputs: [237 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_34 for ONNX node: Relu_34 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 238 for ONNX tensor: 238 [07/07/2022-18:29:49] [TRT] [V] Relu_34 [Relu] outputs: [238 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_35 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 238 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 497 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 498 [07/07/2022-18:29:49] [TRT] [V] Conv_35 [Conv] inputs: [238 -> (1, 256, 38, 38)[FLOAT]], [497 -> (512, 256, 3, 3)[FLOAT]], [498 -> (512)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_35 for ONNX node: Conv_35 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (2, 2), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 512, 19, 19) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 496 for ONNX tensor: 496 [07/07/2022-18:29:49] [TRT] [V] Conv_35 [Conv] outputs: [496 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_36 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 496 [07/07/2022-18:29:49] [TRT] [V] Relu_36 [Relu] inputs: [496 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_36 for ONNX node: Relu_36 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 241 for ONNX tensor: 241 [07/07/2022-18:29:49] [TRT] [V] Relu_36 [Relu] outputs: [241 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_37 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 241 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 500 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 501 [07/07/2022-18:29:49] [TRT] [V] Conv_37 [Conv] inputs: [241 -> (1, 512, 19, 19)[FLOAT]], [500 -> (512, 512, 3, 3)[FLOAT]], [501 -> (512)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 512, 19, 19) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_37 for ONNX node: Conv_37 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 512, 19, 19) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 499 for ONNX tensor: 499 [07/07/2022-18:29:49] [TRT] [V] Conv_37 [Conv] outputs: [499 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_38 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 238 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 503 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 504 [07/07/2022-18:29:49] [TRT] [V] Conv_38 [Conv] inputs: [238 -> (1, 256, 38, 38)[FLOAT]], [503 -> (512, 256, 1, 1)[FLOAT]], [504 -> (512)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_38 for ONNX node: Conv_38 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 512, 19, 19) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 502 for ONNX tensor: 502 [07/07/2022-18:29:49] [TRT] [V] Conv_38 [Conv] outputs: [502 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Add_39 [Add] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 499 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 502 [07/07/2022-18:29:49] [TRT] [V] Add_39 [Add] inputs: [499 -> (1, 512, 19, 19)[FLOAT]], [502 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Add_39 for ONNX node: Add_39 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 246 for ONNX tensor: 246 [07/07/2022-18:29:49] [TRT] [V] Add_39 [Add] outputs: [246 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_40 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 246 [07/07/2022-18:29:49] [TRT] [V] Relu_40 [Relu] inputs: [246 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_40 for ONNX node: Relu_40 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 247 for ONNX tensor: 247 [07/07/2022-18:29:49] [TRT] [V] Relu_40 [Relu] outputs: [247 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_41 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 247 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 506 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 507 [07/07/2022-18:29:49] [TRT] [V] Conv_41 [Conv] inputs: [247 -> (1, 512, 19, 19)[FLOAT]], [506 -> (512, 512, 3, 3)[FLOAT]], [507 -> (512)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 512, 19, 19) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_41 for ONNX node: Conv_41 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 512, 19, 19) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 505 for ONNX tensor: 505 [07/07/2022-18:29:49] [TRT] [V] Conv_41 [Conv] outputs: [505 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_42 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 505 [07/07/2022-18:29:49] [TRT] [V] Relu_42 [Relu] inputs: [505 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_42 for ONNX node: Relu_42 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 250 for ONNX tensor: 250 [07/07/2022-18:29:49] [TRT] [V] Relu_42 [Relu] outputs: [250 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_43 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 250 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 509 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 510 [07/07/2022-18:29:49] [TRT] [V] Conv_43 [Conv] inputs: [250 -> (1, 512, 19, 19)[FLOAT]], [509 -> (512, 512, 3, 3)[FLOAT]], [510 -> (512)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 512, 19, 19) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_43 for ONNX node: Conv_43 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 512, 19, 19) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 508 for ONNX tensor: 508 [07/07/2022-18:29:49] [TRT] [V] Conv_43 [Conv] outputs: [508 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Add_44 [Add] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 508 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 247 [07/07/2022-18:29:49] [TRT] [V] Add_44 [Add] inputs: [508 -> (1, 512, 19, 19)[FLOAT]], [247 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Add_44 for ONNX node: Add_44 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 253 for ONNX tensor: 253 [07/07/2022-18:29:49] [TRT] [V] Add_44 [Add] outputs: [253 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_45 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 253 [07/07/2022-18:29:49] [TRT] [V] Relu_45 [Relu] inputs: [253 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_45 for ONNX node: Relu_45 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 254 for ONNX tensor: 254 [07/07/2022-18:29:49] [TRT] [V] Relu_45 [Relu] outputs: [254 -> (1, 512, 19, 19)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Resize_46 [Resize] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 254 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 511 [07/07/2022-18:29:49] [TRT] [V] Resize_46 [Resize] inputs: [254 -> (1, 512, 19, 19)[FLOAT]], [optional input, not set], [511 -> (4)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Resize_46 for ONNX node: Resize_46 [07/07/2022-18:29:49] [TRT] [V] Running resize layer with: Transformation mode: align_corners Resize mode: linear [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 259 for ONNX tensor: 259 [07/07/2022-18:29:49] [TRT] [V] Resize_46 [Resize] outputs: [259 -> (1, 512, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Concat_47 [Concat] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 259 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 238 [07/07/2022-18:29:49] [TRT] [V] Concat_47 [Concat] inputs: [259 -> (1, 512, 38, 38)[FLOAT]], [238 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Concat_47 for ONNX node: Concat_47 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 260 for ONNX tensor: 260 [07/07/2022-18:29:49] [TRT] [V] Concat_47 [Concat] outputs: [260 -> (1, 768, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_48 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 260 [07/07/2022-18:29:49] [TRT] [V] Searching for input: conv_up_level1.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: conv_up_level1.bias [07/07/2022-18:29:49] [TRT] [V] Conv_48 [Conv] inputs: [260 -> (1, 768, 38, 38)[FLOAT]], [conv_up_level1.weight -> (256, 768, 1, 1)[FLOAT]], [conv_up_level1.bias -> (256)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 768, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_48 for ONNX node: Conv_48 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 256, 38, 38) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 261 for ONNX tensor: 261 [07/07/2022-18:29:49] [TRT] [V] Conv_48 [Conv] outputs: [261 -> (1, 256, 38, 38)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Resize_49 [Resize] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 261 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 511 [07/07/2022-18:29:49] [TRT] [V] Resize_49 [Resize] inputs: [261 -> (1, 256, 38, 38)[FLOAT]], [optional input, not set], [511 -> (4)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Resize_49 for ONNX node: Resize_49 [07/07/2022-18:29:49] [TRT] [V] Running resize layer with: Transformation mode: align_corners Resize mode: linear [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 266 for ONNX tensor: 266 [07/07/2022-18:29:49] [TRT] [V] Resize_49 [Resize] outputs: [266 -> (1, 256, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Concat_50 [Concat] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 266 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 222 [07/07/2022-18:29:49] [TRT] [V] Concat_50 [Concat] inputs: [266 -> (1, 256, 76, 76)[FLOAT]], [222 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Concat_50 for ONNX node: Concat_50 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 267 for ONNX tensor: 267 [07/07/2022-18:29:49] [TRT] [V] Concat_50 [Concat] outputs: [267 -> (1, 384, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_51 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 267 [07/07/2022-18:29:49] [TRT] [V] Searching for input: conv_up_level2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: conv_up_level2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_51 [Conv] inputs: [267 -> (1, 384, 76, 76)[FLOAT]], [conv_up_level2.weight -> (128, 384, 1, 1)[FLOAT]], [conv_up_level2.bias -> (128)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 384, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_51 for ONNX node: Conv_51 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 128, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 268 for ONNX tensor: 268 [07/07/2022-18:29:49] [TRT] [V] Conv_51 [Conv] outputs: [268 -> (1, 128, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Resize_52 [Resize] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 268 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 511 [07/07/2022-18:29:49] [TRT] [V] Resize_52 [Resize] inputs: [268 -> (1, 128, 76, 76)[FLOAT]], [optional input, not set], [511 -> (4)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Resize_52 for ONNX node: Resize_52 [07/07/2022-18:29:49] [TRT] [V] Running resize layer with: Transformation mode: align_corners Resize mode: linear [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 273 for ONNX tensor: 273 [07/07/2022-18:29:49] [TRT] [V] Resize_52 [Resize] outputs: [273 -> (1, 128, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Concat_53 [Concat] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 273 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 206 [07/07/2022-18:29:49] [TRT] [V] Concat_53 [Concat] inputs: [273 -> (1, 128, 152, 152)[FLOAT]], [206 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Concat_53 for ONNX node: Concat_53 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 274 for ONNX tensor: 274 [07/07/2022-18:29:49] [TRT] [V] Concat_53 [Concat] outputs: [274 -> (1, 192, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_54 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 274 [07/07/2022-18:29:49] [TRT] [V] Searching for input: conv_up_level3.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: conv_up_level3.bias [07/07/2022-18:29:49] [TRT] [V] Conv_54 [Conv] inputs: [274 -> (1, 192, 152, 152)[FLOAT]], [conv_up_level3.weight -> (64, 192, 1, 1)[FLOAT]], [conv_up_level3.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 192, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_54 for ONNX node: Conv_54 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 275 for ONNX tensor: 275 [07/07/2022-18:29:49] [TRT] [V] Conv_54 [Conv] outputs: [275 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_55 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 266 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_hm_cen.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_hm_cen.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_55 [Conv] inputs: [266 -> (1, 256, 76, 76)[FLOAT]], [fpn0_hm_cen.0.weight -> (64, 256, 3, 3)[FLOAT]], [fpn0_hm_cen.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_55 for ONNX node: Conv_55 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 276 for ONNX tensor: 276 [07/07/2022-18:29:49] [TRT] [V] Conv_55 [Conv] outputs: [276 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_56 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 276 [07/07/2022-18:29:49] [TRT] [V] Relu_56 [Relu] inputs: [276 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_56 for ONNX node: Relu_56 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 277 for ONNX tensor: 277 [07/07/2022-18:29:49] [TRT] [V] Relu_56 [Relu] outputs: [277 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_57 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 277 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_hm_cen.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_hm_cen.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_57 [Conv] inputs: [277 -> (1, 64, 76, 76)[FLOAT]], [fpn0_hm_cen.2.weight -> (3, 64, 1, 1)[FLOAT]], [fpn0_hm_cen.2.bias -> (3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_57 for ONNX node: Conv_57 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 3, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 278 for ONNX tensor: 278 [07/07/2022-18:29:49] [TRT] [V] Conv_57 [Conv] outputs: [278 -> (1, 3, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Resize_64 [Resize] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 278 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 290 [07/07/2022-18:29:49] [TRT] [V] Resize_64 [Resize] inputs: [278 -> (1, 3, 76, 76)[FLOAT]], [optional input, not set], [optional input, not set], [290 -> (4)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Resize_64 for ONNX node: Resize_64 [07/07/2022-18:29:49] [TRT] [V] Registering layer: 290 for ONNX node: 290 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 293 for ONNX tensor: 293 [07/07/2022-18:29:49] [TRT] [V] Resize_64 [Resize] outputs: [293 -> (1, 3, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_65 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 273 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_hm_cen.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_hm_cen.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_65 [Conv] inputs: [273 -> (1, 128, 152, 152)[FLOAT]], [fpn1_hm_cen.0.weight -> (64, 128, 3, 3)[FLOAT]], [fpn1_hm_cen.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_65 for ONNX node: Conv_65 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 294 for ONNX tensor: 294 [07/07/2022-18:29:49] [TRT] [V] Conv_65 [Conv] outputs: [294 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_66 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 294 [07/07/2022-18:29:49] [TRT] [V] Relu_66 [Relu] inputs: [294 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_66 for ONNX node: Relu_66 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 295 for ONNX tensor: 295 [07/07/2022-18:29:49] [TRT] [V] Relu_66 [Relu] outputs: [295 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_67 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 295 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_hm_cen.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_hm_cen.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_67 [Conv] inputs: [295 -> (1, 64, 152, 152)[FLOAT]], [fpn1_hm_cen.2.weight -> (3, 64, 1, 1)[FLOAT]], [fpn1_hm_cen.2.bias -> (3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_67 for ONNX node: Conv_67 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 3, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 296 for ONNX tensor: 296 [07/07/2022-18:29:49] [TRT] [V] Conv_67 [Conv] outputs: [296 -> (1, 3, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_68 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 275 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_hm_cen.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_hm_cen.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_68 [Conv] inputs: [275 -> (1, 64, 152, 152)[FLOAT]], [fpn2_hm_cen.0.weight -> (64, 64, 3, 3)[FLOAT]], [fpn2_hm_cen.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_68 for ONNX node: Conv_68 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 297 for ONNX tensor: 297 [07/07/2022-18:29:49] [TRT] [V] Conv_68 [Conv] outputs: [297 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_69 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 297 [07/07/2022-18:29:49] [TRT] [V] Relu_69 [Relu] inputs: [297 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_69 for ONNX node: Relu_69 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 298 for ONNX tensor: 298 [07/07/2022-18:29:49] [TRT] [V] Relu_69 [Relu] outputs: [298 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_70 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 298 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_hm_cen.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_hm_cen.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_70 [Conv] inputs: [298 -> (1, 64, 152, 152)[FLOAT]], [fpn2_hm_cen.2.weight -> (3, 64, 1, 1)[FLOAT]], [fpn2_hm_cen.2.bias -> (3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_70 for ONNX node: Conv_70 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 3, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 299 for ONNX tensor: 299 [07/07/2022-18:29:49] [TRT] [V] Conv_70 [Conv] outputs: [299 -> (1, 3, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_72 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 293 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 300 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_72 [Unsqueeze] inputs: [293 -> (1, 3, 152, 152)[FLOAT]], [300 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 3, 152, 152), unsqueezing to: (1, 3, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_72 for ONNX node: Unsqueeze_72 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 301 for ONNX tensor: 301 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_72 [Unsqueeze] outputs: [301 -> (1, 3, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_74 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 296 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 302 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_74 [Unsqueeze] inputs: [296 -> (1, 3, 152, 152)[FLOAT]], [302 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 3, 152, 152), unsqueezing to: (1, 3, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_74 for ONNX node: Unsqueeze_74 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 303 for ONNX tensor: 303 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_74 [Unsqueeze] outputs: [303 -> (1, 3, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_76 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 299 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 304 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_76 [Unsqueeze] inputs: [299 -> (1, 3, 152, 152)[FLOAT]], [304 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 3, 152, 152), unsqueezing to: (1, 3, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_76 for ONNX node: Unsqueeze_76 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 305 for ONNX tensor: 305 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_76 [Unsqueeze] outputs: [305 -> (1, 3, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Concat_77 [Concat] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 301 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 303 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 305 [07/07/2022-18:29:49] [TRT] [V] Concat_77 [Concat] inputs: [301 -> (1, 3, 152, 152, 1)[FLOAT]], [303 -> (1, 3, 152, 152, 1)[FLOAT]], [305 -> (1, 3, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Concat_77 for ONNX node: Concat_77 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 306 for ONNX tensor: 306 [07/07/2022-18:29:49] [TRT] [V] Concat_77 [Concat] outputs: [306 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Softmax_78 [Softmax] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 306 [07/07/2022-18:29:49] [TRT] [V] Softmax_78 [Softmax] inputs: [306 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Softmax_78 for ONNX node: Softmax_78 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 307 for ONNX tensor: 307 [07/07/2022-18:29:49] [TRT] [V] Softmax_78 [Softmax] outputs: [307 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Mul_79 [Mul] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 306 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 307 [07/07/2022-18:29:49] [TRT] [V] Mul_79 [Mul] inputs: [306 -> (1, 3, 152, 152, 3)[FLOAT]], [307 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Mul_79 for ONNX node: Mul_79 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 308 for ONNX tensor: 308 [07/07/2022-18:29:49] [TRT] [V] Mul_79 [Mul] outputs: [308 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: ReduceSum_81 [ReduceSum] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 308 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 309 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_81 [ReduceSum] inputs: [308 -> (1, 3, 152, 152, 3)[FLOAT]], [309 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: ReduceSum_81 for ONNX node: ReduceSum_81 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: output_24 for ONNX tensor: output [07/07/2022-18:29:49] [TRT] [V] ReduceSum_81 [ReduceSum] outputs: [output -> (1, 3, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_82 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 266 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_cen_offset.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_cen_offset.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_82 [Conv] inputs: [266 -> (1, 256, 76, 76)[FLOAT]], [fpn0_cen_offset.0.weight -> (64, 256, 3, 3)[FLOAT]], [fpn0_cen_offset.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_82 for ONNX node: Conv_82 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 311 for ONNX tensor: 311 [07/07/2022-18:29:49] [TRT] [V] Conv_82 [Conv] outputs: [311 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_83 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 311 [07/07/2022-18:29:49] [TRT] [V] Relu_83 [Relu] inputs: [311 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_83 for ONNX node: Relu_83 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 312 for ONNX tensor: 312 [07/07/2022-18:29:49] [TRT] [V] Relu_83 [Relu] outputs: [312 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_84 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 312 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_cen_offset.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_cen_offset.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_84 [Conv] inputs: [312 -> (1, 64, 76, 76)[FLOAT]], [fpn0_cen_offset.2.weight -> (2, 64, 1, 1)[FLOAT]], [fpn0_cen_offset.2.bias -> (2)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_84 for ONNX node: Conv_84 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 2, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 313 for ONNX tensor: 313 [07/07/2022-18:29:49] [TRT] [V] Conv_84 [Conv] outputs: [313 -> (1, 2, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Resize_91 [Resize] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 313 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 325 [07/07/2022-18:29:49] [TRT] [V] Resize_91 [Resize] inputs: [313 -> (1, 2, 76, 76)[FLOAT]], [optional input, not set], [optional input, not set], [325 -> (4)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Resize_91 for ONNX node: Resize_91 [07/07/2022-18:29:49] [TRT] [V] Registering layer: 325 for ONNX node: 325 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 328 for ONNX tensor: 328 [07/07/2022-18:29:49] [TRT] [V] Resize_91 [Resize] outputs: [328 -> (1, 2, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_92 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 273 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_cen_offset.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_cen_offset.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_92 [Conv] inputs: [273 -> (1, 128, 152, 152)[FLOAT]], [fpn1_cen_offset.0.weight -> (64, 128, 3, 3)[FLOAT]], [fpn1_cen_offset.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_92 for ONNX node: Conv_92 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 329 for ONNX tensor: 329 [07/07/2022-18:29:49] [TRT] [V] Conv_92 [Conv] outputs: [329 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_93 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 329 [07/07/2022-18:29:49] [TRT] [V] Relu_93 [Relu] inputs: [329 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_93 for ONNX node: Relu_93 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 330 for ONNX tensor: 330 [07/07/2022-18:29:49] [TRT] [V] Relu_93 [Relu] outputs: [330 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_94 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 330 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_cen_offset.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_cen_offset.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_94 [Conv] inputs: [330 -> (1, 64, 152, 152)[FLOAT]], [fpn1_cen_offset.2.weight -> (2, 64, 1, 1)[FLOAT]], [fpn1_cen_offset.2.bias -> (2)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_94 for ONNX node: Conv_94 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 2, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 331 for ONNX tensor: 331 [07/07/2022-18:29:49] [TRT] [V] Conv_94 [Conv] outputs: [331 -> (1, 2, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_95 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 275 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_cen_offset.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_cen_offset.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_95 [Conv] inputs: [275 -> (1, 64, 152, 152)[FLOAT]], [fpn2_cen_offset.0.weight -> (64, 64, 3, 3)[FLOAT]], [fpn2_cen_offset.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_95 for ONNX node: Conv_95 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 332 for ONNX tensor: 332 [07/07/2022-18:29:49] [TRT] [V] Conv_95 [Conv] outputs: [332 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_96 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 332 [07/07/2022-18:29:49] [TRT] [V] Relu_96 [Relu] inputs: [332 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_96 for ONNX node: Relu_96 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 333 for ONNX tensor: 333 [07/07/2022-18:29:49] [TRT] [V] Relu_96 [Relu] outputs: [333 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_97 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 333 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_cen_offset.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_cen_offset.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_97 [Conv] inputs: [333 -> (1, 64, 152, 152)[FLOAT]], [fpn2_cen_offset.2.weight -> (2, 64, 1, 1)[FLOAT]], [fpn2_cen_offset.2.bias -> (2)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_97 for ONNX node: Conv_97 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 2, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 334 for ONNX tensor: 334 [07/07/2022-18:29:49] [TRT] [V] Conv_97 [Conv] outputs: [334 -> (1, 2, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_99 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 328 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 335 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_99 [Unsqueeze] inputs: [328 -> (1, 2, 152, 152)[FLOAT]], [335 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 2, 152, 152), unsqueezing to: (1, 2, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_99 for ONNX node: Unsqueeze_99 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 336 for ONNX tensor: 336 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_99 [Unsqueeze] outputs: [336 -> (1, 2, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_101 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 331 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 337 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_101 [Unsqueeze] inputs: [331 -> (1, 2, 152, 152)[FLOAT]], [337 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 2, 152, 152), unsqueezing to: (1, 2, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_101 for ONNX node: Unsqueeze_101 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 338 for ONNX tensor: 338 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_101 [Unsqueeze] outputs: [338 -> (1, 2, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_103 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 334 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 339 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_103 [Unsqueeze] inputs: [334 -> (1, 2, 152, 152)[FLOAT]], [339 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 2, 152, 152), unsqueezing to: (1, 2, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_103 for ONNX node: Unsqueeze_103 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 340 for ONNX tensor: 340 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_103 [Unsqueeze] outputs: [340 -> (1, 2, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Concat_104 [Concat] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 336 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 338 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 340 [07/07/2022-18:29:49] [TRT] [V] Concat_104 [Concat] inputs: [336 -> (1, 2, 152, 152, 1)[FLOAT]], [338 -> (1, 2, 152, 152, 1)[FLOAT]], [340 -> (1, 2, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Concat_104 for ONNX node: Concat_104 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 341 for ONNX tensor: 341 [07/07/2022-18:29:49] [TRT] [V] Concat_104 [Concat] outputs: [341 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Softmax_105 [Softmax] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 341 [07/07/2022-18:29:49] [TRT] [V] Softmax_105 [Softmax] inputs: [341 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Softmax_105 for ONNX node: Softmax_105 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 342 for ONNX tensor: 342 [07/07/2022-18:29:49] [TRT] [V] Softmax_105 [Softmax] outputs: [342 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Mul_106 [Mul] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 341 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 342 [07/07/2022-18:29:49] [TRT] [V] Mul_106 [Mul] inputs: [341 -> (1, 2, 152, 152, 3)[FLOAT]], [342 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Mul_106 for ONNX node: Mul_106 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 343 for ONNX tensor: 343 [07/07/2022-18:29:49] [TRT] [V] Mul_106 [Mul] outputs: [343 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: ReduceSum_108 [ReduceSum] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 343 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 344 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_108 [ReduceSum] inputs: [343 -> (1, 2, 152, 152, 3)[FLOAT]], [344 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: ReduceSum_108 for ONNX node: ReduceSum_108 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 345_25 for ONNX tensor: 345 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_108 [ReduceSum] outputs: [345 -> (1, 2, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_109 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 266 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_direction.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_direction.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_109 [Conv] inputs: [266 -> (1, 256, 76, 76)[FLOAT]], [fpn0_direction.0.weight -> (64, 256, 3, 3)[FLOAT]], [fpn0_direction.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_109 for ONNX node: Conv_109 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 346 for ONNX tensor: 346 [07/07/2022-18:29:49] [TRT] [V] Conv_109 [Conv] outputs: [346 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_110 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 346 [07/07/2022-18:29:49] [TRT] [V] Relu_110 [Relu] inputs: [346 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_110 for ONNX node: Relu_110 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 347 for ONNX tensor: 347 [07/07/2022-18:29:49] [TRT] [V] Relu_110 [Relu] outputs: [347 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_111 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 347 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_direction.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_direction.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_111 [Conv] inputs: [347 -> (1, 64, 76, 76)[FLOAT]], [fpn0_direction.2.weight -> (2, 64, 1, 1)[FLOAT]], [fpn0_direction.2.bias -> (2)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_111 for ONNX node: Conv_111 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 2, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 348 for ONNX tensor: 348 [07/07/2022-18:29:49] [TRT] [V] Conv_111 [Conv] outputs: [348 -> (1, 2, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Resize_118 [Resize] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 348 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 360 [07/07/2022-18:29:49] [TRT] [V] Resize_118 [Resize] inputs: [348 -> (1, 2, 76, 76)[FLOAT]], [optional input, not set], [optional input, not set], [360 -> (4)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Resize_118 for ONNX node: Resize_118 [07/07/2022-18:29:49] [TRT] [V] Registering layer: 360 for ONNX node: 360 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 363 for ONNX tensor: 363 [07/07/2022-18:29:49] [TRT] [V] Resize_118 [Resize] outputs: [363 -> (1, 2, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_119 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 273 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_direction.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_direction.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_119 [Conv] inputs: [273 -> (1, 128, 152, 152)[FLOAT]], [fpn1_direction.0.weight -> (64, 128, 3, 3)[FLOAT]], [fpn1_direction.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_119 for ONNX node: Conv_119 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 364 for ONNX tensor: 364 [07/07/2022-18:29:49] [TRT] [V] Conv_119 [Conv] outputs: [364 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_120 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 364 [07/07/2022-18:29:49] [TRT] [V] Relu_120 [Relu] inputs: [364 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_120 for ONNX node: Relu_120 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 365 for ONNX tensor: 365 [07/07/2022-18:29:49] [TRT] [V] Relu_120 [Relu] outputs: [365 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_121 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 365 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_direction.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_direction.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_121 [Conv] inputs: [365 -> (1, 64, 152, 152)[FLOAT]], [fpn1_direction.2.weight -> (2, 64, 1, 1)[FLOAT]], [fpn1_direction.2.bias -> (2)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_121 for ONNX node: Conv_121 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 2, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 366 for ONNX tensor: 366 [07/07/2022-18:29:49] [TRT] [V] Conv_121 [Conv] outputs: [366 -> (1, 2, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_122 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 275 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_direction.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_direction.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_122 [Conv] inputs: [275 -> (1, 64, 152, 152)[FLOAT]], [fpn2_direction.0.weight -> (64, 64, 3, 3)[FLOAT]], [fpn2_direction.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_122 for ONNX node: Conv_122 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 367 for ONNX tensor: 367 [07/07/2022-18:29:49] [TRT] [V] Conv_122 [Conv] outputs: [367 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_123 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 367 [07/07/2022-18:29:49] [TRT] [V] Relu_123 [Relu] inputs: [367 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_123 for ONNX node: Relu_123 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 368 for ONNX tensor: 368 [07/07/2022-18:29:49] [TRT] [V] Relu_123 [Relu] outputs: [368 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_124 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 368 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_direction.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_direction.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_124 [Conv] inputs: [368 -> (1, 64, 152, 152)[FLOAT]], [fpn2_direction.2.weight -> (2, 64, 1, 1)[FLOAT]], [fpn2_direction.2.bias -> (2)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_124 for ONNX node: Conv_124 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 2 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 2, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 369 for ONNX tensor: 369 [07/07/2022-18:29:49] [TRT] [V] Conv_124 [Conv] outputs: [369 -> (1, 2, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_126 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 363 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 370 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_126 [Unsqueeze] inputs: [363 -> (1, 2, 152, 152)[FLOAT]], [370 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 2, 152, 152), unsqueezing to: (1, 2, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_126 for ONNX node: Unsqueeze_126 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 371 for ONNX tensor: 371 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_126 [Unsqueeze] outputs: [371 -> (1, 2, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_128 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 366 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 372 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_128 [Unsqueeze] inputs: [366 -> (1, 2, 152, 152)[FLOAT]], [372 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 2, 152, 152), unsqueezing to: (1, 2, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_128 for ONNX node: Unsqueeze_128 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 373 for ONNX tensor: 373 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_128 [Unsqueeze] outputs: [373 -> (1, 2, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_130 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 369 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 374 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_130 [Unsqueeze] inputs: [369 -> (1, 2, 152, 152)[FLOAT]], [374 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 2, 152, 152), unsqueezing to: (1, 2, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_130 for ONNX node: Unsqueeze_130 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 375 for ONNX tensor: 375 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_130 [Unsqueeze] outputs: [375 -> (1, 2, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Concat_131 [Concat] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 371 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 373 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 375 [07/07/2022-18:29:49] [TRT] [V] Concat_131 [Concat] inputs: [371 -> (1, 2, 152, 152, 1)[FLOAT]], [373 -> (1, 2, 152, 152, 1)[FLOAT]], [375 -> (1, 2, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Concat_131 for ONNX node: Concat_131 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 376 for ONNX tensor: 376 [07/07/2022-18:29:49] [TRT] [V] Concat_131 [Concat] outputs: [376 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Softmax_132 [Softmax] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 376 [07/07/2022-18:29:49] [TRT] [V] Softmax_132 [Softmax] inputs: [376 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Softmax_132 for ONNX node: Softmax_132 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 377 for ONNX tensor: 377 [07/07/2022-18:29:49] [TRT] [V] Softmax_132 [Softmax] outputs: [377 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Mul_133 [Mul] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 376 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 377 [07/07/2022-18:29:49] [TRT] [V] Mul_133 [Mul] inputs: [376 -> (1, 2, 152, 152, 3)[FLOAT]], [377 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Mul_133 for ONNX node: Mul_133 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 378 for ONNX tensor: 378 [07/07/2022-18:29:49] [TRT] [V] Mul_133 [Mul] outputs: [378 -> (1, 2, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: ReduceSum_135 [ReduceSum] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 378 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 379 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_135 [ReduceSum] inputs: [378 -> (1, 2, 152, 152, 3)[FLOAT]], [379 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: ReduceSum_135 for ONNX node: ReduceSum_135 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 380_26 for ONNX tensor: 380 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_135 [ReduceSum] outputs: [380 -> (1, 2, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_136 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 266 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_z_coor.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_z_coor.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_136 [Conv] inputs: [266 -> (1, 256, 76, 76)[FLOAT]], [fpn0_z_coor.0.weight -> (64, 256, 3, 3)[FLOAT]], [fpn0_z_coor.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_136 for ONNX node: Conv_136 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 381 for ONNX tensor: 381 [07/07/2022-18:29:49] [TRT] [V] Conv_136 [Conv] outputs: [381 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_137 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 381 [07/07/2022-18:29:49] [TRT] [V] Relu_137 [Relu] inputs: [381 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_137 for ONNX node: Relu_137 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 382 for ONNX tensor: 382 [07/07/2022-18:29:49] [TRT] [V] Relu_137 [Relu] outputs: [382 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_138 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 382 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_z_coor.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_z_coor.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_138 [Conv] inputs: [382 -> (1, 64, 76, 76)[FLOAT]], [fpn0_z_coor.2.weight -> (1, 64, 1, 1)[FLOAT]], [fpn0_z_coor.2.bias -> (1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_138 for ONNX node: Conv_138 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 1, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 383 for ONNX tensor: 383 [07/07/2022-18:29:49] [TRT] [V] Conv_138 [Conv] outputs: [383 -> (1, 1, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Resize_145 [Resize] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 383 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 395 [07/07/2022-18:29:49] [TRT] [V] Resize_145 [Resize] inputs: [383 -> (1, 1, 76, 76)[FLOAT]], [optional input, not set], [optional input, not set], [395 -> (4)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Resize_145 for ONNX node: Resize_145 [07/07/2022-18:29:49] [TRT] [V] Registering layer: 395 for ONNX node: 395 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 398 for ONNX tensor: 398 [07/07/2022-18:29:49] [TRT] [V] Resize_145 [Resize] outputs: [398 -> (1, 1, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_146 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 273 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_z_coor.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_z_coor.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_146 [Conv] inputs: [273 -> (1, 128, 152, 152)[FLOAT]], [fpn1_z_coor.0.weight -> (64, 128, 3, 3)[FLOAT]], [fpn1_z_coor.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_146 for ONNX node: Conv_146 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 399 for ONNX tensor: 399 [07/07/2022-18:29:49] [TRT] [V] Conv_146 [Conv] outputs: [399 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_147 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 399 [07/07/2022-18:29:49] [TRT] [V] Relu_147 [Relu] inputs: [399 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_147 for ONNX node: Relu_147 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 400 for ONNX tensor: 400 [07/07/2022-18:29:49] [TRT] [V] Relu_147 [Relu] outputs: [400 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_148 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 400 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_z_coor.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_z_coor.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_148 [Conv] inputs: [400 -> (1, 64, 152, 152)[FLOAT]], [fpn1_z_coor.2.weight -> (1, 64, 1, 1)[FLOAT]], [fpn1_z_coor.2.bias -> (1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_148 for ONNX node: Conv_148 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 1, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 401 for ONNX tensor: 401 [07/07/2022-18:29:49] [TRT] [V] Conv_148 [Conv] outputs: [401 -> (1, 1, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_149 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 275 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_z_coor.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_z_coor.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_149 [Conv] inputs: [275 -> (1, 64, 152, 152)[FLOAT]], [fpn2_z_coor.0.weight -> (64, 64, 3, 3)[FLOAT]], [fpn2_z_coor.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_149 for ONNX node: Conv_149 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 402 for ONNX tensor: 402 [07/07/2022-18:29:49] [TRT] [V] Conv_149 [Conv] outputs: [402 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_150 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 402 [07/07/2022-18:29:49] [TRT] [V] Relu_150 [Relu] inputs: [402 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_150 for ONNX node: Relu_150 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 403 for ONNX tensor: 403 [07/07/2022-18:29:49] [TRT] [V] Relu_150 [Relu] outputs: [403 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_151 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 403 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_z_coor.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_z_coor.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_151 [Conv] inputs: [403 -> (1, 64, 152, 152)[FLOAT]], [fpn2_z_coor.2.weight -> (1, 64, 1, 1)[FLOAT]], [fpn2_z_coor.2.bias -> (1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_151 for ONNX node: Conv_151 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 1 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 1, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 404 for ONNX tensor: 404 [07/07/2022-18:29:49] [TRT] [V] Conv_151 [Conv] outputs: [404 -> (1, 1, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_153 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 398 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 405 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_153 [Unsqueeze] inputs: [398 -> (1, 1, 152, 152)[FLOAT]], [405 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 1, 152, 152), unsqueezing to: (1, 1, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_153 for ONNX node: Unsqueeze_153 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 406 for ONNX tensor: 406 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_153 [Unsqueeze] outputs: [406 -> (1, 1, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_155 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 401 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 407 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_155 [Unsqueeze] inputs: [401 -> (1, 1, 152, 152)[FLOAT]], [407 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 1, 152, 152), unsqueezing to: (1, 1, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_155 for ONNX node: Unsqueeze_155 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 408 for ONNX tensor: 408 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_155 [Unsqueeze] outputs: [408 -> (1, 1, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_157 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 404 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 409 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_157 [Unsqueeze] inputs: [404 -> (1, 1, 152, 152)[FLOAT]], [409 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 1, 152, 152), unsqueezing to: (1, 1, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_157 for ONNX node: Unsqueeze_157 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 410 for ONNX tensor: 410 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_157 [Unsqueeze] outputs: [410 -> (1, 1, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Concat_158 [Concat] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 406 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 408 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 410 [07/07/2022-18:29:49] [TRT] [V] Concat_158 [Concat] inputs: [406 -> (1, 1, 152, 152, 1)[FLOAT]], [408 -> (1, 1, 152, 152, 1)[FLOAT]], [410 -> (1, 1, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Concat_158 for ONNX node: Concat_158 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 411 for ONNX tensor: 411 [07/07/2022-18:29:49] [TRT] [V] Concat_158 [Concat] outputs: [411 -> (1, 1, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Softmax_159 [Softmax] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 411 [07/07/2022-18:29:49] [TRT] [V] Softmax_159 [Softmax] inputs: [411 -> (1, 1, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Softmax_159 for ONNX node: Softmax_159 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 412 for ONNX tensor: 412 [07/07/2022-18:29:49] [TRT] [V] Softmax_159 [Softmax] outputs: [412 -> (1, 1, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Mul_160 [Mul] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 411 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 412 [07/07/2022-18:29:49] [TRT] [V] Mul_160 [Mul] inputs: [411 -> (1, 1, 152, 152, 3)[FLOAT]], [412 -> (1, 1, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Mul_160 for ONNX node: Mul_160 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 413 for ONNX tensor: 413 [07/07/2022-18:29:49] [TRT] [V] Mul_160 [Mul] outputs: [413 -> (1, 1, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: ReduceSum_162 [ReduceSum] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 413 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 414 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_162 [ReduceSum] inputs: [413 -> (1, 1, 152, 152, 3)[FLOAT]], [414 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: ReduceSum_162 for ONNX node: ReduceSum_162 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 415_27 for ONNX tensor: 415 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_162 [ReduceSum] outputs: [415 -> (1, 1, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_163 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 266 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_dim.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_dim.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_163 [Conv] inputs: [266 -> (1, 256, 76, 76)[FLOAT]], [fpn0_dim.0.weight -> (64, 256, 3, 3)[FLOAT]], [fpn0_dim.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 256, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_163 for ONNX node: Conv_163 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 416 for ONNX tensor: 416 [07/07/2022-18:29:49] [TRT] [V] Conv_163 [Conv] outputs: [416 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_164 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 416 [07/07/2022-18:29:49] [TRT] [V] Relu_164 [Relu] inputs: [416 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_164 for ONNX node: Relu_164 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 417 for ONNX tensor: 417 [07/07/2022-18:29:49] [TRT] [V] Relu_164 [Relu] outputs: [417 -> (1, 64, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_165 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 417 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_dim.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn0_dim.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_165 [Conv] inputs: [417 -> (1, 64, 76, 76)[FLOAT]], [fpn0_dim.2.weight -> (3, 64, 1, 1)[FLOAT]], [fpn0_dim.2.bias -> (3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_165 for ONNX node: Conv_165 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 3, 76, 76) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 418 for ONNX tensor: 418 [07/07/2022-18:29:49] [TRT] [V] Conv_165 [Conv] outputs: [418 -> (1, 3, 76, 76)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Resize_172 [Resize] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 418 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 430 [07/07/2022-18:29:49] [TRT] [V] Resize_172 [Resize] inputs: [418 -> (1, 3, 76, 76)[FLOAT]], [optional input, not set], [optional input, not set], [430 -> (4)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Resize_172 for ONNX node: Resize_172 [07/07/2022-18:29:49] [TRT] [V] Registering layer: 430 for ONNX node: 430 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 433 for ONNX tensor: 433 [07/07/2022-18:29:49] [TRT] [V] Resize_172 [Resize] outputs: [433 -> (1, 3, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_173 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 273 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_dim.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_dim.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_173 [Conv] inputs: [273 -> (1, 128, 152, 152)[FLOAT]], [fpn1_dim.0.weight -> (64, 128, 3, 3)[FLOAT]], [fpn1_dim.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 128, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_173 for ONNX node: Conv_173 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 434 for ONNX tensor: 434 [07/07/2022-18:29:49] [TRT] [V] Conv_173 [Conv] outputs: [434 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_174 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 434 [07/07/2022-18:29:49] [TRT] [V] Relu_174 [Relu] inputs: [434 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_174 for ONNX node: Relu_174 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 435 for ONNX tensor: 435 [07/07/2022-18:29:49] [TRT] [V] Relu_174 [Relu] outputs: [435 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_175 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 435 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_dim.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn1_dim.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_175 [Conv] inputs: [435 -> (1, 64, 152, 152)[FLOAT]], [fpn1_dim.2.weight -> (3, 64, 1, 1)[FLOAT]], [fpn1_dim.2.bias -> (3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_175 for ONNX node: Conv_175 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 3, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 436 for ONNX tensor: 436 [07/07/2022-18:29:49] [TRT] [V] Conv_175 [Conv] outputs: [436 -> (1, 3, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_176 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 275 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_dim.0.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_dim.0.bias [07/07/2022-18:29:49] [TRT] [V] Conv_176 [Conv] inputs: [275 -> (1, 64, 152, 152)[FLOAT]], [fpn2_dim.0.weight -> (64, 64, 3, 3)[FLOAT]], [fpn2_dim.0.bias -> (64)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_176 for ONNX node: Conv_176 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 437 for ONNX tensor: 437 [07/07/2022-18:29:49] [TRT] [V] Conv_176 [Conv] outputs: [437 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Relu_177 [Relu] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 437 [07/07/2022-18:29:49] [TRT] [V] Relu_177 [Relu] inputs: [437 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Relu_177 for ONNX node: Relu_177 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 438 for ONNX tensor: 438 [07/07/2022-18:29:49] [TRT] [V] Relu_177 [Relu] outputs: [438 -> (1, 64, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Conv_178 [Conv] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 438 [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_dim.2.weight [07/07/2022-18:29:49] [TRT] [V] Searching for input: fpn2_dim.2.bias [07/07/2022-18:29:49] [TRT] [V] Conv_178 [Conv] inputs: [438 -> (1, 64, 152, 152)[FLOAT]], [fpn2_dim.2.weight -> (3, 64, 1, 1)[FLOAT]], [fpn2_dim.2.bias -> (3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Convolution input dimensions: (1, 64, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Conv_178 for ONNX node: Conv_178 [07/07/2022-18:29:49] [TRT] [V] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 3 [07/07/2022-18:29:49] [TRT] [V] Convolution output dimensions: (1, 3, 152, 152) [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 439 for ONNX tensor: 439 [07/07/2022-18:29:49] [TRT] [V] Conv_178 [Conv] outputs: [439 -> (1, 3, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_180 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 433 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 440 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_180 [Unsqueeze] inputs: [433 -> (1, 3, 152, 152)[FLOAT]], [440 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 3, 152, 152), unsqueezing to: (1, 3, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_180 for ONNX node: Unsqueeze_180 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 441 for ONNX tensor: 441 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_180 [Unsqueeze] outputs: [441 -> (1, 3, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_182 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 436 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 442 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_182 [Unsqueeze] inputs: [436 -> (1, 3, 152, 152)[FLOAT]], [442 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 3, 152, 152), unsqueezing to: (1, 3, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_182 for ONNX node: Unsqueeze_182 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 443 for ONNX tensor: 443 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_182 [Unsqueeze] outputs: [443 -> (1, 3, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Unsqueeze_184 [Unsqueeze] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 439 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 444 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_184 [Unsqueeze] inputs: [439 -> (1, 3, 152, 152)[FLOAT]], [444 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Original shape: (1, 3, 152, 152), unsqueezing to: (1, 3, 152, 152, 1) [07/07/2022-18:29:49] [TRT] [V] Registering layer: Unsqueeze_184 for ONNX node: Unsqueeze_184 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 445 for ONNX tensor: 445 [07/07/2022-18:29:49] [TRT] [V] Unsqueeze_184 [Unsqueeze] outputs: [445 -> (1, 3, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Concat_185 [Concat] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 441 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 443 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 445 [07/07/2022-18:29:49] [TRT] [V] Concat_185 [Concat] inputs: [441 -> (1, 3, 152, 152, 1)[FLOAT]], [443 -> (1, 3, 152, 152, 1)[FLOAT]], [445 -> (1, 3, 152, 152, 1)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Concat_185 for ONNX node: Concat_185 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 446 for ONNX tensor: 446 [07/07/2022-18:29:49] [TRT] [V] Concat_185 [Concat] outputs: [446 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Softmax_186 [Softmax] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 446 [07/07/2022-18:29:49] [TRT] [V] Softmax_186 [Softmax] inputs: [446 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Softmax_186 for ONNX node: Softmax_186 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 447 for ONNX tensor: 447 [07/07/2022-18:29:49] [TRT] [V] Softmax_186 [Softmax] outputs: [447 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: Mul_187 [Mul] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 446 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 447 [07/07/2022-18:29:49] [TRT] [V] Mul_187 [Mul] inputs: [446 -> (1, 3, 152, 152, 3)[FLOAT]], [447 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: Mul_187 for ONNX node: Mul_187 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 448 for ONNX tensor: 448 [07/07/2022-18:29:49] [TRT] [V] Mul_187 [Mul] outputs: [448 -> (1, 3, 152, 152, 3)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Parsing node: ReduceSum_189 [ReduceSum] [07/07/2022-18:29:49] [TRT] [V] Searching for input: 448 [07/07/2022-18:29:49] [TRT] [V] Searching for input: 449 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_189 [ReduceSum] inputs: [448 -> (1, 3, 152, 152, 3)[FLOAT]], [449 -> (1)[INT32]], [07/07/2022-18:29:49] [TRT] [V] Registering layer: ReduceSum_189 for ONNX node: ReduceSum_189 [07/07/2022-18:29:49] [TRT] [V] Registering tensor: 450_28 for ONNX tensor: 450 [07/07/2022-18:29:49] [TRT] [V] ReduceSum_189 [ReduceSum] outputs: [450 -> (1, 3, 152, 152)[FLOAT]], [07/07/2022-18:29:49] [TRT] [V] Marking output_24 as output: output [07/07/2022-18:29:49] [TRT] [V] Marking 345_25 as output: 345 [07/07/2022-18:29:49] [TRT] [V] Marking 380_26 as output: 380 [07/07/2022-18:29:49] [TRT] [V] Marking 415_27 as output: 415 [07/07/2022-18:29:49] [TRT] [V] Marking 450_28 as output: 450 [07/07/2022-18:29:49] [TRT] [V] Applying generic optimizations to the graph for inference. [07/07/2022-18:29:49] [TRT] [V] Original: 145 layers [07/07/2022-18:29:49] [TRT] [V] After dead-layer removal: 145 layers [07/07/2022-18:29:49] [TRT] [V] Running: ShuffleErasure on (Unnamed Layer* 71) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Removing (Unnamed Layer* 71) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Running: ShuffleErasure on (Unnamed Layer* 90) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Removing (Unnamed Layer* 90) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Running: ShuffleErasure on (Unnamed Layer* 109) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Removing (Unnamed Layer* 109) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Running: ShuffleErasure on (Unnamed Layer* 128) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Removing (Unnamed Layer* 128) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Running: ShuffleErasure on (Unnamed Layer* 147) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] Removing (Unnamed Layer* 147) [Shuffle] [07/07/2022-18:29:49] [TRT] [V] After Myelin optimization: 140 layers [07/07/2022-18:29:49] [TRT] [V] Applying ScaleNodes fusions. [07/07/2022-18:29:49] [TRT] [V] After scale fusion: 140 layers [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_0 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_0 with Relu_1 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_3 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_3 with Relu_4 [07/07/2022-18:29:49] [TRT] [V] Running: ConvEltwiseSumFusion on Conv_5 [07/07/2022-18:29:49] [TRT] [V] ConvEltwiseSumFusion: Fusing Conv_5 with Add_6 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_5 + Add_6 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_5 + Add_6 with Relu_7 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_8 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_8 with Relu_9 [07/07/2022-18:29:49] [TRT] [V] Running: ConvEltwiseSumFusion on Conv_10 [07/07/2022-18:29:49] [TRT] [V] ConvEltwiseSumFusion: Fusing Conv_10 with Add_11 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_10 + Add_11 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_10 + Add_11 with Relu_12 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_13 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_13 with Relu_14 [07/07/2022-18:29:49] [TRT] [V] Running: ConvEltwiseSumFusion on Conv_16 [07/07/2022-18:29:49] [TRT] [V] ConvEltwiseSumFusion: Fusing Conv_16 with Add_17 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_16 + Add_17 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_16 + Add_17 with Relu_18 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_19 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_19 with Relu_20 [07/07/2022-18:29:49] [TRT] [V] Running: ConvEltwiseSumFusion on Conv_21 [07/07/2022-18:29:49] [TRT] [V] ConvEltwiseSumFusion: Fusing Conv_21 with Add_22 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_21 + Add_22 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_21 + Add_22 with Relu_23 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_24 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_24 with Relu_25 [07/07/2022-18:29:49] [TRT] [V] Running: ConvEltwiseSumFusion on Conv_27 [07/07/2022-18:29:49] [TRT] [V] ConvEltwiseSumFusion: Fusing Conv_27 with Add_28 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_27 + Add_28 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_27 + Add_28 with Relu_29 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_30 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_30 with Relu_31 [07/07/2022-18:29:49] [TRT] [V] Running: ConvEltwiseSumFusion on Conv_32 [07/07/2022-18:29:49] [TRT] [V] ConvEltwiseSumFusion: Fusing Conv_32 with Add_33 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_32 + Add_33 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_32 + Add_33 with Relu_34 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_35 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_35 with Relu_36 [07/07/2022-18:29:49] [TRT] [V] Running: ConvEltwiseSumFusion on Conv_38 [07/07/2022-18:29:49] [TRT] [V] ConvEltwiseSumFusion: Fusing Conv_38 with Add_39 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_38 + Add_39 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_38 + Add_39 with Relu_40 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_41 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_41 with Relu_42 [07/07/2022-18:29:49] [TRT] [V] Running: ConvEltwiseSumFusion on Conv_43 [07/07/2022-18:29:49] [TRT] [V] ConvEltwiseSumFusion: Fusing Conv_43 with Add_44 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_43 + Add_44 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_43 + Add_44 with Relu_45 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_55 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_55 with Relu_56 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_82 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_82 with Relu_83 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_109 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_109 with Relu_110 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_136 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_136 with Relu_137 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_163 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_163 with Relu_164 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_65 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_65 with Relu_66 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_92 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_92 with Relu_93 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_119 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_119 with Relu_120 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_146 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_146 with Relu_147 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_68 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_68 with Relu_69 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_95 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_95 with Relu_96 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_122 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_122 with Relu_123 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_149 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_149 with Relu_150 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_173 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_173 with Relu_174 [07/07/2022-18:29:49] [TRT] [V] Running: ConvReluFusion on Conv_176 [07/07/2022-18:29:49] [TRT] [V] ConvReluFusion: Fusing Conv_176 with Relu_177 [07/07/2022-18:29:49] [TRT] [V] After dupe layer removal: 100 layers [07/07/2022-18:29:49] [TRT] [V] After final dead-layer removal: 100 layers [07/07/2022-18:29:49] [TRT] [V] After tensor merging: 100 layers [07/07/2022-18:29:49] [TRT] [V] After vertical fusions: 100 layers [07/07/2022-18:29:49] [TRT] [V] After dupe layer removal: 100 layers [07/07/2022-18:29:49] [TRT] [V] After final dead-layer removal: 100 layers [07/07/2022-18:29:49] [TRT] [V] Merging layers: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 [07/07/2022-18:29:49] [TRT] [V] Merging layers: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 [07/07/2022-18:29:49] [TRT] [V] Merging layers: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 [07/07/2022-18:29:49] [TRT] [V] After tensor merging: 88 layers [07/07/2022-18:29:49] [TRT] [V] After slice removal: 88 layers [07/07/2022-18:29:49] [TRT] [V] Eliminating concatenation Concat_185 [07/07/2022-18:29:49] [TRT] [V] Retargeting 441 to 446 [07/07/2022-18:29:49] [TRT] [V] Retargeting 443 to 446 [07/07/2022-18:29:49] [TRT] [V] Retargeting 445 to 446 [07/07/2022-18:29:49] [TRT] [V] Eliminating concatenation Concat_158 [07/07/2022-18:29:49] [TRT] [V] Retargeting 406 to 411 [07/07/2022-18:29:49] [TRT] [V] Retargeting 408 to 411 [07/07/2022-18:29:49] [TRT] [V] Retargeting 410 to 411 [07/07/2022-18:29:49] [TRT] [V] Eliminating concatenation Concat_131 [07/07/2022-18:29:49] [TRT] [V] Retargeting 371 to 376 [07/07/2022-18:29:49] [TRT] [V] Retargeting 373 to 376 [07/07/2022-18:29:49] [TRT] [V] Retargeting 375 to 376 [07/07/2022-18:29:49] [TRT] [V] Eliminating concatenation Concat_104 [07/07/2022-18:29:49] [TRT] [V] Retargeting 336 to 341 [07/07/2022-18:29:49] [TRT] [V] Retargeting 338 to 341 [07/07/2022-18:29:49] [TRT] [V] Retargeting 340 to 341 [07/07/2022-18:29:49] [TRT] [V] Eliminating concatenation Concat_77 [07/07/2022-18:29:49] [TRT] [V] Retargeting 301 to 306 [07/07/2022-18:29:49] [TRT] [V] Retargeting 303 to 306 [07/07/2022-18:29:49] [TRT] [V] Retargeting 305 to 306 [07/07/2022-18:29:49] [TRT] [V] Eliminating concatenation Concat_53 [07/07/2022-18:29:49] [TRT] [V] Generating copy for 273 to 274 because input does not support striding. [07/07/2022-18:29:49] [TRT] [V] Generating copy for 206 to 274 because input does not support striding. [07/07/2022-18:29:49] [TRT] [V] Eliminating concatenation Concat_50 [07/07/2022-18:29:49] [TRT] [V] Generating copy for 266 to 267 because input does not support striding. [07/07/2022-18:29:49] [TRT] [V] Generating copy for 222 to 267 because input does not support striding. [07/07/2022-18:29:49] [TRT] [V] Eliminating concatenation Concat_47 [07/07/2022-18:29:49] [TRT] [V] Generating copy for 259 to 260 because input does not support striding. [07/07/2022-18:29:49] [TRT] [V] Generating copy for 238 to 260 because input does not support striding. [07/07/2022-18:29:49] [TRT] [V] After concat removal: 86 layers [07/07/2022-18:29:49] [TRT] [V] Trying to split Reshape and strided tensor [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_72 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_99 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_126 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_153 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_74 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_101 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_128 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_155 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_76 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_103 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_130 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_157 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_180 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_182 [07/07/2022-18:29:49] [TRT] [V] Generating copy after Unsqueeze_184 [07/07/2022-18:29:49] [TRT] [V] Graph construction and optimization completed in 0.512685 seconds. [07/07/2022-18:29:50] [TRT] [V] Using cublasLt as a tactic source [07/07/2022-18:29:50] [TRT] [I] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +402, GPU +168, now: CPU 1127, GPU 549 (MiB) [07/07/2022-18:29:50] [TRT] [V] Using cuDNN as a tactic source [07/07/2022-18:29:50] [TRT] [I] [MemUsageChange] Init cuDNN: CPU +159, GPU +172, now: CPU 1286, GPU 721 (MiB) [07/07/2022-18:29:50] [TRT] [W] TensorRT was linked against cuDNN 8.4.1 but loaded cuDNN 8.1.1 [07/07/2022-18:29:50] [TRT] [I] Local timing cache in use. Profiling results in this builder pass will not be stored. [07/07/2022-18:29:50] [TRT] [V] Constructing optimization profile number 0 [1/1]. [07/07/2022-18:29:50] [TRT] [V] Reserving memory for host IO tensors. Host: 0 bytes [07/07/2022-18:29:50] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:50] [TRT] [V] *************** Autotuning Reformat: Float(1108992,369664,608,1) -> Float(1108992,1,1824,3) *************** [07/07/2022-18:29:50] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(images -> ) (Reformat) [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0218107 [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0254248 [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021866 [07/07/2022-18:29:50] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0218107 [07/07/2022-18:29:50] [TRT] [V] *************** Autotuning Reformat: Float(1108992,369664,608,1) -> Half(1108992,369664,608,1) *************** [07/07/2022-18:29:50] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(images -> ) (Reformat) [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0159182 [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0166869 [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0205798 [07/07/2022-18:29:50] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0159182 [07/07/2022-18:29:50] [TRT] [V] *************** Autotuning Reformat: Float(1108992,369664,608,1) -> Half(739328,369664:2,608,1) *************** [07/07/2022-18:29:50] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(images -> ) (Reformat) [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0234219 [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0285298 [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0204191 [07/07/2022-18:29:50] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0204191 [07/07/2022-18:29:50] [TRT] [V] *************** Autotuning Reformat: Float(1108992,369664,608,1) -> Half(369664,1:4,608,1) *************** [07/07/2022-18:29:50] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(images -> ) (Reformat) [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0240709 [07/07/2022-18:29:50] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.018733 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0188142 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.018733 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1108992,369664,608,1) -> Half(369664,1:8,608,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(images -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0565636 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0261456 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021914 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.021914 [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(5914624,92416,304,1) -> Half(5914624,92416,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0700011 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0686699 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0873867 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0686699 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(5914624,92416,304,1) -> Half(2957312,92416:2,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0912747 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0815232 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0737536 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0737536 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(5914624,92416,304,1) -> Half(739328,1:8,2432,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.129429 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0694464 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0693696 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0693696 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(5914624,1,19456,64) -> Float(5914624,92416,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.750933 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.15382 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.751317 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.15382 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(5914624,1,19456,64) -> Half(5914624,92416,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.71152 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0707008 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.711861 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0707008 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(5914624,1,19456,64) -> Half(2957312,92416:2,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.787797 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0738475 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.787115 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0738475 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(5914624,1,19456,64) -> Half(739328,1:8,2432,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0924027 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0686549 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.092304 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0686549 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(5914624,92416,304,1) -> Float(5914624,92416,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0722368 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0711509 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0785067 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0711509 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(5914624,92416,304,1) -> Half(2957312,92416:2,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0826709 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0591982 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0692203 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0591982 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(5914624,92416,304,1) -> Half(739328,1:8,2432,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.133237 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0610471 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0569973 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0569973 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(2957312,92416:2,304,1) -> Float(5914624,92416,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0872213 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0991627 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0685739 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0685739 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(2957312,92416:2,304,1) -> Half(5914624,92416,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0779541 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.204645 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0601707 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0601707 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(2957312,92416:2,304,1) -> Half(739328,1:8,2432,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0992053 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0570827 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0502156 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0502156 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,1:8,2432,8) -> Float(5914624,92416,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.748032 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0857333 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0801237 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0801237 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,1:8,2432,8) -> Half(5914624,92416,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.710837 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.164992 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0471173 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0471173 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,1:8,2432,8) -> Half(2957312,92416:2,304,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(191 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.783733 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0662738 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0472027 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0472027 [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.036096 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0396243 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.036096 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.036096 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0199874 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0209827 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0262121 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0199874 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0258379 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0276398 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.020914 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.020914 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0355755 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0214813 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0214553 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0214553 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0208987 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0201286 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.022715 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0201286 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0388267 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0227676 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0390187 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0227676 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0225188 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0184168 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0182849 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0182849 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0354912 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0196875 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0165684 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0165684 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0256648 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0239284 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0182748 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0182748 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0262064 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0224903 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0261333 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0224903 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0182748 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0453853 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0144249 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0144249 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0226226 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0153493 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0113892 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0113892 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0304029 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0214907 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0200188 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0200188 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0224583 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0207674 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0224249 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0207674 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0291324 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0370048 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00939081 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00939081 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 192) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0300436 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0171285 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00880983 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00880983 [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0308005 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0358229 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0307297 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0307297 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.019117 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0200264 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0218827 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.019117 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0216987 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0236537 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0192373 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0192373 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0290178 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0203049 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0202861 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0202861 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0413796 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0357365 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0413215 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0357365 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0391194 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0204988 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0389736 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0204988 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0395544 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0220973 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.039315 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0220973 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0218693 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0197327 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0217807 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0197327 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0186044 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0201067 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0184028 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0184028 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0332082 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0222293 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0333052 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0222293 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0185044 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0147084 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0153949 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0147084 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0290951 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0159817 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0141822 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0141822 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0215853 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0231019 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0181979 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0181979 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0261949 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0225223 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0261579 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0225223 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0182366 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.045084 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.01408 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.01408 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0225195 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0151927 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0113589 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0113589 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0302782 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0213533 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0199787 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0199787 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0224149 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0207285 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0224462 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0207285 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.028824 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0370229 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00931852 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00931852 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(192 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.029832 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0175056 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00878681 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00878681 [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 199) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0411639 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.035248 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0412219 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.035248 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 199) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0388836 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0205409 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0388373 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0205409 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 199) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0392 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0220267 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0392913 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0220267 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 199) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.021698 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0197239 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021724 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0197239 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0176893 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0143876 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0175865 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0143876 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00677312 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00971093 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0111577 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00677312 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0105037 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0112466 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00710286 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00710286 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0161656 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00977432 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.007012 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.007012 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0168464 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0162494 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0167136 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0162494 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0158012 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00963261 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0157983 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00963261 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0162499 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102775 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0162585 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0102775 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0106693 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00970148 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0104557 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00970148 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00678336 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00980297 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0105947 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00678336 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0157697 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00957409 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0156073 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00957409 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00943733 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0101255 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00695333 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00695333 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.015601 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0104413 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00640684 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00640684 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0103819 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0121387 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00695311 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00695311 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0117194 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00974933 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0117911 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00974933 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00931822 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0231289 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0068456 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0068456 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0117598 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00989113 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00510594 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00510594 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0161895 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0104223 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.005976 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.005976 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0106077 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0100527 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0104233 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0100527 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0158638 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0186963 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0052895 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0052895 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(209 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0162392 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0103357 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00518072 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00518072 [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0176062 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.013904 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0175686 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.013904 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00676971 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00993851 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0111392 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00676971 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0104247 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0113241 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00703289 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00703289 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.016096 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00915604 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00699933 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00699933 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0167733 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0167861 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0167877 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0167733 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.015712 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00946222 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.015727 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00946222 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0162403 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102316 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0161925 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0102316 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.01061 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00926241 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.010485 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00926241 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00677952 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00955977 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.010648 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00677952 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0156713 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00905312 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0157067 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00905312 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00934281 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00972008 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00695267 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00695267 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0155665 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102907 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00645621 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00645621 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0103137 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0121779 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00695955 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00695955 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0116947 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00905687 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0117973 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00905687 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00932948 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0231332 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00688501 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00688501 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0117944 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00969844 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0050539 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0050539 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0162311 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0104513 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00599581 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00599581 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0106427 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00921629 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.010457 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00921629 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0158032 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.018455 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00525433 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00525433 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 215) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0162682 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102814 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00514954 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00514954 [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00930459 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00949096 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00933956 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00930459 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00482621 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912433 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00696333 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00482621 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0067264 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00913182 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00489507 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00489507 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00945985 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00914652 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00529829 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00529829 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00952059 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0107527 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00957135 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00952059 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00946252 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00903092 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00940948 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00903092 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00969661 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00906984 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00968229 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00906984 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00677568 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00929867 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0066378 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0066378 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00481341 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00921542 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00651466 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00481341 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00888112 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00907013 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00890386 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00888112 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00607981 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00927822 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00487281 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00487281 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00873819 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00937985 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00506053 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00506053 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00668075 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00967101 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00483215 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00483215 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00733565 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00908252 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00745244 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00733565 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00606429 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.016547 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00483973 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00483973 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00730667 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00918919 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00440154 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00440154 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00976091 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00926311 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00509818 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00509818 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00677888 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00920504 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00657338 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00657338 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00940978 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0143844 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00479802 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00479802 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(225 -> ) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00972495 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00922321 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00450638 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00450638 [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,1,9728,128) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00931496 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00966705 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00938756 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00931496 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00484236 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0090707 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00692267 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00484236 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00671787 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00915373 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00494635 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00494635 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00949067 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00910616 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0052235 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0052235 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00965455 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.010634 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0096192 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0096192 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00944622 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00906032 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00945007 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00906032 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00969265 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00899004 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00966217 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00899004 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00667168 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00917045 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00658154 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00658154 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00486462 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00907359 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00647672 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00486462 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00896477 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.009088 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00897853 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00896477 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00611297 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00937096 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00484607 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00484607 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00879102 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00930637 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00507491 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00507491 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00667627 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00958507 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00494745 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00494745 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0450449 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00924483 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00740846 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00740846 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00635029 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0162667 [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00478065 [07/07/2022-18:29:51] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00478065 [07/07/2022-18:29:51] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:51] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:51] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00733867 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00940296 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00438566 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00438566 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00966156 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00930993 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00510982 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00510982 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00669419 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00927111 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0066332 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0066332 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00957257 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0143596 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0048032 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0048032 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 231) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0097728 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00930607 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00445838 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00445838 [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00621254 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00913845 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00615215 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00615215 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00417413 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0361365 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00488131 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00417413 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00487838 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00925956 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00441291 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00441291 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00612403 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00760703 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00393035 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00393035 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00652185 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00988487 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00634707 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00634707 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00633842 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00915171 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00634606 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00633842 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00654536 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00909175 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00652328 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00652328 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00489229 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00929126 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00493945 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00489229 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00432942 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0360693 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00461925 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00432942 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00609784 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00911424 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00581021 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00581021 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00475433 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00930578 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00437873 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00437873 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00575338 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00820033 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00377288 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00377288 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00499057 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00908858 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00442821 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00442821 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00514544 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00751739 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.005289 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00514544 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00472278 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0101275 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0044618 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0044618 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00513477 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0093037 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00432492 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00432492 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00642215 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00777947 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00394679 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00394679 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00498484 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00923041 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00495482 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00495482 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00631567 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00961219 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00430646 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00430646 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(241 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00644 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00924137 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00433482 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00433482 [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1,9728,256) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0061056 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0091569 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00617135 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0061056 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00412563 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0361493 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00486168 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00412563 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00488394 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00925924 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00436849 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00436849 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00607748 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00765115 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00389743 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00389743 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00649785 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00997647 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00634003 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00634003 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00640624 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00910472 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00629132 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00629132 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00650503 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0091889 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00653825 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00650503 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00491278 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00934993 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00488193 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00488193 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00416303 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0361184 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00455899 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00416303 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00596172 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00925924 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00589811 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00589811 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00478202 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00940592 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0043934 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0043934 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00590578 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00797048 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00379806 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00379806 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00496439 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00908339 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00439635 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00439635 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00517711 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00758036 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00521433 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00517711 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00470941 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0100207 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00440632 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00440632 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00512919 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00941452 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00426518 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00426518 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00666918 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00754204 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00416105 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00416105 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00492298 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00953356 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0049222 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0049222 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00652451 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00934133 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00405719 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00405719 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 247) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00645067 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00958202 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00434701 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00434701 [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,1,9728,512) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(184832,1,9728,512) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,361,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,361:2,19,1) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,1216,64) -> Half(184832,361,19,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(739328,1444,38,1) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00798654 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.01136 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00841707 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00798654 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(739328,1444,38,1) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0175927 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0126329 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0175333 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0126329 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(739328,1444,38,1) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00493271 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102662 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00491184 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00491184 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(739328,1444,38,1) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0104026 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0116539 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00705711 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00705711 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(739328,1444,38,1) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0156044 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00956068 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00711194 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00711194 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(739328,1444,38,1) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00501477 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0105093 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00494447 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00494447 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(739328,1444,38,1) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0152868 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00971124 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0152495 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00971124 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(739328,1444,38,1) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00449579 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0100395 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00517481 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00449579 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(739328,1444,38,1) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00930459 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0100656 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00692724 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00692724 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(739328,1444,38,1) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.014982 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0103425 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00659179 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00659179 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,2432,64) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0161778 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0128138 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0161717 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0128138 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,2432,64) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.010858 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00986227 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0107053 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00986227 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,2432,64) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0157663 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0224427 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0157915 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0157663 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,2432,64) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0161732 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.01042 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00541953 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00541953 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,2432,64) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 259 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0109519 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00986196 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0107819 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00986196 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00529761 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00982463 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00519631 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00519631 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00935704 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00993914 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00930785 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00930785 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0054591 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00969539 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.005289 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.005289 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00658468 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00997176 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00499025 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00499025 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00934044 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00997678 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00539785 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00539785 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00956221 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0106827 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00958049 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00956221 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00603219 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00992659 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00606565 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00603219 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00950844 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00985631 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00937422 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00937422 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00965669 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00979657 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00962408 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00962408 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0426639 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00996894 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00661417 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00661417 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00525367 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00982023 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00518597 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00518597 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00888589 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0096701 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00887467 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00887467 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00521833 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00987294 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00519155 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00519155 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00609455 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0131356 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00516053 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00516053 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00880421 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0101117 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0051758 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0051758 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00673088 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00984471 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0065122 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0065122 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0074304 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00977067 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00744178 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0074304 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00606953 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0162626 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00607573 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00606953 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00463941 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00985726 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00520058 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00463941 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00743538 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00806324 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00410979 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00410979 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00975817 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00983027 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00977981 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00975817 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00681926 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00997333 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00660769 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00660769 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00955977 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0143609 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00945748 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00945748 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00977859 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00976091 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00458257 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00458257 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 238 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00695533 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00991749 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00675904 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00675904 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1108992,1444,38,1) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0301742 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0310381 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0300978 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0300978 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1108992,1444,38,1) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0147594 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0157086 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0169621 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0147594 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1108992,1444,38,1) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0171232 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0200753 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0150414 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0150414 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1108992,1444,38,1) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0284729 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0161178 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0161285 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0161178 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1108992,1,29184,768) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0343115 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0300471 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0342325 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0300471 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1108992,1,29184,768) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0321464 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0201613 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0321532 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0201613 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1108992,1,29184,768) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.032639 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0184674 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0325634 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0184674 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1108992,1,29184,768) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.017184 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0155685 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0171648 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0155685 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(1108992,1444,38,1) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0144516 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0143689 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0145285 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0143689 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(1108992,1444,38,1) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0255048 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0156189 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0254011 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0156189 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(1108992,1444,38,1) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0126542 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.012077 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0088539 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0088539 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(1108992,1444,38,1) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.02112 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0132898 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00890414 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00890414 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(554496,1444:2,38,1) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0173947 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0210167 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.01456 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.01456 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(554496,1444:2,38,1) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0219447 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0162479 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021968 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0162479 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(554496,1444:2,38,1) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0125958 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0358816 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00867993 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00867993 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(554496,1444:2,38,1) -> Half(138624,1:8,3648,96) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0151704 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0101385 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00661375 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00661375 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(138624,1:8,3648,96) -> Float(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0273781 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0197208 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0146013 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0146013 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(138624,1:8,3648,96) -> Float(1108992,1,29184,768) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0173525 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0139698 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0173717 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0139698 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(138624,1:8,3648,96) -> Half(1108992,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0219593 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0304679 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00742589 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00742589 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(138624,1:8,3648,96) -> Half(554496,1444:2,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(260 -> ) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0227541 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0134007 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00664826 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00664826 [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(369664,1,9728,256) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(369664,1444,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1444:2,38,1) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(46208,1:8,1216,32) -> Half(369664,1444,38,1) *************** [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Float(1478656,1,19456,256) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0374495 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.037773 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0373547 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0373547 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(1478656,5776,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0190578 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0201387 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0217913 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0190578 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(739328,5776:2,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0215027 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0250164 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0193268 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0193268 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(184832,1:8,2432,32) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0353739 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0207209 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0201129 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0201129 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Float(1478656,5776,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0185375 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0198287 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0183759 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0183759 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Float(1478656,1,19456,256) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0328398 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.022142 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0329261 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.022142 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Half(739328,5776:2,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0185134 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0155966 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0155345 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0155345 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Half(184832,1:8,2432,32) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0285467 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0167397 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0138947 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0138947 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Float(1478656,5776,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0341525 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0214487 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.019392 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.019392 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Float(1478656,1,19456,256) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0224384 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.020922 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0224178 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.020922 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Half(1478656,5776,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0287751 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0324238 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0096387 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0096387 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Half(739328,5776:2,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 266) (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0295547 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0175556 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00908598 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00908598 [07/07/2022-18:29:52] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0246126 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0261268 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0251276 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0246126 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0371532 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0369003 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0372421 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0369003 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0185246 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0206758 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0185229 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0185229 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0215473 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.024672 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0192604 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0192604 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0353259 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0206676 [07/07/2022-18:29:52] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0202842 [07/07/2022-18:29:52] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0202842 [07/07/2022-18:29:52] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:52] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:52] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0421427 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0358261 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0421653 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0358261 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0254651 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0265099 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0254217 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0254217 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0406033 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.022028 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0407265 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.022028 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0414009 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0224469 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0413227 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0224469 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.021812 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0200376 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0217127 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0200376 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0192119 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.019734 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0191947 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0191947 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0328524 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0241562 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0327457 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0241562 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00791888 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0146574 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00856205 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00791888 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0185269 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0156465 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0155607 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0155607 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0282267 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0171125 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0130018 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0130018 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0223396 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0226155 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0222891 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0222891 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0274503 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0265698 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0274388 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0265698 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0186353 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0407419 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0185351 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0185351 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0111499 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0204731 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00839813 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00839813 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0228743 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.015168 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0114311 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0114311 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0341035 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0214867 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.03424 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0214867 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0219993 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0225586 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021972 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.021972 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0287698 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0323627 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0287618 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0287618 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0297502 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0171051 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00922061 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00922061 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 266 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0203978 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0133517 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0204693 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0133517 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0102743 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0136768 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00807187 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00807187 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0172501 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0138539 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0171659 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0138539 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00789954 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0101893 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00797105 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00789954 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0103783 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0113305 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00704889 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00704889 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.016194 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00971276 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00714712 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00714712 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0166593 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0165034 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0166747 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0165034 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0116763 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0135322 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0116796 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0116763 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0156858 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00974171 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.015632 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00974171 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0161773 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102672 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0161377 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0102672 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0107107 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00955764 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.010739 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00955764 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00790623 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.010316 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00795454 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00790623 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.015535 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.009568 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0155728 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.009568 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00734771 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00969966 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00638873 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00638873 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00935556 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0134438 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00676587 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00676587 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0157309 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0126131 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00640121 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00640121 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0103014 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0121299 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.010145 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.010145 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0123375 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00940326 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.012304 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00940326 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00934845 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0231381 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00922263 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00922263 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00594863 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0120415 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00524667 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00524667 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0116877 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00963962 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00524117 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00524117 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0161564 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0104527 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.016126 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0104527 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0109196 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00981302 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0109086 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00981302 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0157256 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0184387 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.015729 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0157256 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0161971 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0103017 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.005281 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.005281 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 222 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0109468 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0138569 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.01074 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.01074 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Float(1478656,1,19456,256) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0374424 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0359808 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0372978 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0359808 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(1478656,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0190868 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0202171 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0218253 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0190868 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(739328,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.021558 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0249547 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0193108 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0193108 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,5776,76,1) -> Half(184832,1:8,2432,32) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0353749 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0207856 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0201362 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0201362 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Float(1478656,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0421253 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0352917 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0422547 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0352917 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Half(1478656,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0407004 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.022046 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0405997 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.022046 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Half(739328,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0413452 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0224868 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0413784 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0224868 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,19456,256) -> Half(184832,1:8,2432,32) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0217313 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.019904 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021768 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.019904 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Float(1478656,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0185369 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0197089 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0183944 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0183944 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Float(1478656,1,19456,256) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0329697 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0219833 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0329998 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0219833 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Half(739328,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0185339 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0154308 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0156979 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0154308 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1478656,5776,76,1) -> Half(184832,1:8,2432,32) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0284738 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0169904 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0140098 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0140098 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Float(1478656,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0222684 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0227015 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.018595 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.018595 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Float(1478656,1,19456,256) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0279556 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0234012 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0278542 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0234012 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Half(1478656,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0186157 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0407004 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0149018 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0149018 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776:2,76,1) -> Half(184832,1:8,2432,32) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0235086 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0152092 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0115277 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0115277 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Float(1478656,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0341323 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0213487 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0194702 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0194702 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Float(1478656,1,19456,256) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0223104 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.020924 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0223374 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.020924 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Half(1478656,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0287742 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0324994 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00959451 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00959451 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,2432,32) -> Half(739328,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(266 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0295884 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0175798 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00898835 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00898835 [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0458693 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0478933 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0459293 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0458693 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0231346 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0246499 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0259701 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0231346 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0262121 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0295902 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0233031 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0233031 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0431387 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0249981 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0247276 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0247276 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0580978 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.045032 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0580053 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.045032 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.055616 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0264542 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.055744 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0264542 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0567876 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0271294 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0569351 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0271294 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.026281 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.024307 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0263196 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.024307 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0229198 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0254651 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.022646 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.022646 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0408024 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0287973 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0407976 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0287973 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0236089 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0213813 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0205434 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0205434 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.037632 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.021982 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0187876 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0187876 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0265485 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0277145 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0224057 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0224057 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0339093 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0302533 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0339669 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0302533 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0238743 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.049885 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0197791 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0197791 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0303164 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.020214 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0174624 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0174624 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0427267 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0274987 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0247688 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0247688 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0265469 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0269776 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0266043 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0265469 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0419667 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.04128 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0167136 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0167136 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0431133 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.021784 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0165836 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0165836 [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2217984,5776,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0555858 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0520579 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0555573 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0520579 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2217984,5776,76,1) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0271475 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.028256 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0298604 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0271475 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2217984,5776,76,1) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0305193 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0332965 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.027442 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.027442 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2217984,5776,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0520168 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0287769 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0292587 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0287769 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2217984,1,29184,384) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0733141 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0501074 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0732331 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0501074 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2217984,1,29184,384) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0700864 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0309886 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0702123 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0309886 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2217984,1,29184,384) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0713067 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.030847 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0711403 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.030847 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2217984,1,29184,384) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0309362 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0280969 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0309168 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0280969 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(2217984,5776,76,1) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.027273 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0293182 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0272468 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0272468 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(2217984,5776,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0489813 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0335765 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0489524 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0335765 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(2217984,5776,76,1) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0280284 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0256927 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0244922 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0244922 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(2217984,5776,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0453467 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0253394 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021438 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.021438 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1108992,5776:2,76,1) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0313144 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0328679 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.026656 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.026656 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1108992,5776:2,76,1) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0401719 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.036704 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0401908 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.036704 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1108992,5776:2,76,1) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.028408 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.058528 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0235819 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0235819 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1108992,5776:2,76,1) -> Half(277248,1:8,3648,48) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0359883 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0229881 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0202359 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0202359 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(277248,1:8,3648,48) -> Float(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0503726 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.033792 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0305629 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0305629 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(277248,1:8,3648,48) -> Float(2217984,1,29184,384) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0312495 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0323995 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0312592 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0312495 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(277248,1:8,3648,48) -> Half(2217984,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0500815 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0469867 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0194714 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0194714 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(277248,1:8,3648,48) -> Half(1108992,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(267 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0512411 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0252724 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0197409 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0197409 [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(739328,1,9728,128) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(739328,5776,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,5776:2,76,1) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(92416,1:8,1216,16) -> Half(739328,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Float(2957312,1,19456,128) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0706581 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0690048 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0712981 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0690048 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(2957312,23104,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0354272 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0365803 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0379887 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0354272 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(1478656,23104:2,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0398447 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0404539 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0357216 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0357216 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(369664,1:8,2432,16) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0681429 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0372753 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0373239 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0372753 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Float(2957312,23104,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0359456 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0379034 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0359541 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0359456 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Float(2957312,1,19456,128) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0672917 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0448507 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0672661 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0448507 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Half(1478656,23104:2,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0359179 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0305678 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0307588 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0305678 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Half(369664,1:8,2432,16) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0641209 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0292347 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0275167 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0275167 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Float(2957312,23104,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.068352 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0436733 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0402785 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0402785 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Float(2957312,1,19456,128) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0407123 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0399538 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0406969 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0399538 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Half(2957312,23104,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0656 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0610258 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0249318 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0249318 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Half(1478656,23104:2,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 273) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0670315 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0303496 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0250255 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0250255 [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.007728 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0128295 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00773939 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.007728 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0058411 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0133346 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00541247 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00541247 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00675115 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00828436 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00644185 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00644185 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00799797 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00925059 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00800737 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00799797 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00969844 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0106243 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00957745 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00957745 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00951763 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00933867 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00947022 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00933867 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00992628 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00941215 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00988957 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00941215 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00677504 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00940504 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00665872 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00665872 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00583559 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0132734 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00601314 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00583559 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00740907 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00767224 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00768873 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00740907 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00629354 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00814751 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00599295 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00599295 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00758618 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00929304 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00755176 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00755176 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00676715 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00898218 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00466741 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00466741 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00693529 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00895607 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00693355 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00693355 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00612713 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0146532 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00463111 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00463111 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00701867 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124757 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0056416 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0056416 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00981773 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.010562 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00464518 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00464518 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00679403 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0115182 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0066848 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0066848 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00946044 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0128451 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00537177 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00537177 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(277 -> ) (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00995325 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0131541 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00553215 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00553215 [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(1848320,1,24320,320) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(1848320,5776,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(924160,5776:2,76,1) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Half(231040,1:8,3040,40) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:29:53] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.046812 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0482011 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0471453 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.046812 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0709675 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0657778 [07/07/2022-18:29:53] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0709077 [07/07/2022-18:29:53] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0657778 [07/07/2022-18:29:53] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:53] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:53] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0352341 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0368256 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0352533 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0352341 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0397724 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.040608 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0355755 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0355755 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0679019 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0372385 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0385671 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0372385 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0815253 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0667627 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0818731 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0667627 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0478842 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0610453 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0479269 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0478842 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0756075 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.037261 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0758443 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.037261 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0765376 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.038771 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0764459 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.038771 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.039987 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0366773 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0399798 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0366773 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0364224 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0378323 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0366443 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0364224 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.066672 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0507368 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0666275 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0507368 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0246309 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0267487 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.025088 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0246309 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0358293 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0305716 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0307995 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0305716 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0641636 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0302409 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.02956 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.02956 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0389369 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.046168 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0389487 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0389369 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.05104 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0524587 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.051203 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.05104 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0350037 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0790507 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0349792 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0349792 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0252922 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0374827 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0251101 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0251101 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0466053 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0281796 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.028872 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0281796 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0681429 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0440667 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0682389 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0440667 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0403816 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0442293 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0403437 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0403437 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0653707 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0610133 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.06544 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0610133 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0667456 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0302676 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0250796 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0250796 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 273 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0391052 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0255322 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0390507 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0255322 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0251672 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.026007 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0251322 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0251322 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0303438 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0352715 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0303661 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0303438 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0195739 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0203332 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0196342 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0195739 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0215113 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0233223 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0191698 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0191698 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0286453 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0204869 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0205572 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0204869 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0411176 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0349803 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0412978 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0349803 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0250568 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0329338 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0250766 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0250568 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0382459 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0205503 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0382874 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0205503 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0389641 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0218167 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0390092 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0218167 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0218287 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0198375 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0218313 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0198375 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0196863 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0196091 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0196292 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0196091 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.032961 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0275389 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0328524 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0275389 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0155612 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0138645 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00801422 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00801422 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.018573 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0146973 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0155641 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0146973 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0288231 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0164993 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.01328 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.01328 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.021102 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0237397 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0211033 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.021102 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0253463 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0279582 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.025293 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.025293 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0181709 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.044964 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0181406 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0181406 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0108415 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0204436 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00823233 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00823233 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0224704 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0153013 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0115424 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0115424 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.030008 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0219133 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0299182 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0219133 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0219033 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0240945 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0218327 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0218327 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0286604 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0364885 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0286631 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0286604 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0297502 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.01667 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0084016 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0084016 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: 206 copy (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0208157 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0117484 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.020834 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0117484 [07/07/2022-18:29:54] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003ea [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Float(2957312,1,19456,128) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.071104 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0654844 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0714325 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0654844 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(2957312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0352939 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0367851 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0378738 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0352939 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(1478656,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0396753 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0405215 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0355925 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0355925 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,23104,152,1) -> Half(369664,1:8,2432,16) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0679637 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0368395 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0373559 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0368395 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Float(2957312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0818837 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0664302 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.081632 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0664302 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Half(2957312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0757845 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0372042 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.075648 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0372042 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Half(1478656,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0765483 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0387793 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.07648 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0387793 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(2957312,1,19456,128) -> Half(369664,1:8,2432,16) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0400759 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0364704 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0400818 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0364704 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Float(2957312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0359093 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0378228 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0361067 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0359093 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Float(2957312,1,19456,128) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0670165 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0447427 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0672661 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0447427 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Half(1478656,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.035824 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0305794 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0309062 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0305794 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2957312,23104,152,1) -> Half(369664,1:8,2432,16) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0637778 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0291351 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0276382 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0276382 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Float(2957312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0390329 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.046396 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0353269 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0353269 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Float(2957312,1,19456,128) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0516495 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.045428 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0517516 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.045428 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Half(2957312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0350773 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0792875 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0280009 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0280009 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104:2,152,1) -> Half(369664,1:8,2432,16) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0466733 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0278089 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0258782 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0258782 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Float(2957312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0681557 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0440787 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0407597 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0407597 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Float(2957312,1,19456,128) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0406044 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0397926 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0405582 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0397926 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Half(2957312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0655093 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0608178 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0250537 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0250537 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(369664,1:8,2432,16) -> Half(1478656,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(273 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.066816 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0302071 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0251017 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0251017 [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.177963 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.162041 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.177829 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.162041 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0835707 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0850053 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0868133 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0835707 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0942053 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0919893 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.08408 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.08408 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.168352 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.085376 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0932667 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.085376 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.255963 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.153305 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.256411 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.153305 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.239349 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.101752 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.239317 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.101752 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.241984 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.089344 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.242203 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.089344 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0945627 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0846453 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0945627 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0846453 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0869093 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.090208 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.087944 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0869093 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.167403 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.112587 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.166981 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.112587 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0844347 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0700715 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.072544 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0700715 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.155044 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0660604 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0736469 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0660604 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.092296 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.114009 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0860267 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0860267 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.13045 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.115154 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.130496 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.115154 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0821291 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.186811 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0658667 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0658667 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.114887 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0643964 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0736277 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0643964 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.180165 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.119808 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.105016 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.105016 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0957627 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.102229 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0958 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0957627 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.171403 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.145298 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0583662 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0583662 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.173648 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.06736 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.058688 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.058688 [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,5776,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00521167 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0120533 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00558027 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00521167 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00612596 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0131926 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00380521 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00380521 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,1,228,3) -> Float(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00366423 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00959756 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00447275 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00366423 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,1,228,3) -> Half(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0043502 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912923 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00577858 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0043502 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,1,228,3) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00577747 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124725 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.006036 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00577747 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(17328,5776,76,1) -> Float(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00374616 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00766618 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00346964 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00346964 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(17328,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00445369 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00910299 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00406477 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00406477 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776:2,76,1) -> Float(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00585937 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0127147 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00528717 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00528717 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776:2,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00585057 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00790946 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00353516 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00353516 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776:2,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0045773 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0133555 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00550855 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0045773 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Float(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00599257 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0129817 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00402815 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00402815 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(278 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00368797 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00750696 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00412339 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00368797 [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,5776,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00413458 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0090436 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00547043 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00413458 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00580506 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124685 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00528583 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00528583 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,1,152,2) -> Float(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00559342 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102639 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00382 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00382 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,1,152,2) -> Half(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00362528 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00829451 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00445525 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00362528 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,1,152,2) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00565189 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0133726 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00633821 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00565189 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776,76,1) -> Float(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00545669 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00890498 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00348133 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00348133 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00376665 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00834053 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00407011 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00376665 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Float(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00436641 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00817301 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00354021 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00354021 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0036834 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00752995 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00352292 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00352292 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00384638 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00758473 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00348178 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00348178 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Float(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00372421 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00746667 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00356732 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00356732 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(313 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00375227 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00748918 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.003476 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.003476 [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,5776,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,1,152,2) -> Float(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,1,152,2) -> Half(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(11552,1,152,2) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776,76,1) -> Float(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Float(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Float(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(5776,5776,76,1) -> Half(5776,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00341518 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0078524 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00410198 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00341518 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(5776,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00451684 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102746 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00533283 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00451684 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(5776,1,76,1) -> Float(5776,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00565514 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0123749 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00394742 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00394742 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(5776,1,76,1) -> Half(5776,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00376353 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00746193 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00475658 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00376353 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(5776,1,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0060672 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0130416 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00624928 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0060672 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776,76,1) -> Float(5776,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00508897 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00752403 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00348234 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00348234 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0037567 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00935407 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00408065 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0037567 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Float(5776,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00459923 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0126325 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00534586 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00459923 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Half(5776,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00578262 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00994447 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00414367 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00414367 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,5776:2,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00464089 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0127964 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00517465 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00464089 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Float(5776,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0056537 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.010826 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00397448 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00397448 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Half(5776,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(383 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00564409 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0111484 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00412102 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00412102 [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,5776,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,1,228,3) -> Float(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,1,228,3) -> Half(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(17328,1,228,3) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(17328,5776,76,1) -> Float(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(17328,5776,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776:2,76,1) -> Float(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776:2,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(11552,5776:2,76,1) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Float(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(5776,1:8,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(4435968,23104,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.105787 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0998373 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.105931 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0998373 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(4435968,23104,152,1) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0513387 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0527314 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0542842 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0513387 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(4435968,23104,152,1) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0578738 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0578293 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0515093 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0515093 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(4435968,23104,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0999707 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0530987 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0559289 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0530987 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(4435968,1,29184,192) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.135097 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.100813 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.134827 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.100813 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(4435968,1,29184,192) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.123893 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0545463 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.124139 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0545463 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(4435968,1,29184,192) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.124935 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0556036 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.124277 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0556036 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(4435968,1,29184,192) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0584373 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.052509 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0583609 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.052509 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(4435968,23104,152,1) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0528549 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0551695 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0533379 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0528549 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(4435968,23104,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.100211 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0679701 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.100099 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0679701 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(4435968,23104,152,1) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0520366 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0446413 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0446773 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0446413 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(4435968,23104,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0949333 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0420227 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.042884 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0420227 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2217984,23104:2,152,1) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0568676 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0694208 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.052096 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.052096 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2217984,23104:2,152,1) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0776576 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0701461 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0777451 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0701461 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2217984,23104:2,152,1) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0508114 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.117244 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0404196 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0404196 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(2217984,23104:2,152,1) -> Half(554496,1:8,3648,24) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.069664 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0400344 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0425347 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0400344 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(554496,1:8,3648,24) -> Float(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.102147 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0705557 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.062256 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.062256 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(554496,1:8,3648,24) -> Float(4435968,1,29184,192) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.059088 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.061696 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0590133 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0590133 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(554496,1:8,3648,24) -> Half(4435968,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.098672 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0930373 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0361397 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0361397 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Half(554496,1:8,3648,24) -> Half(2217984,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(274 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.100368 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.04262 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0360779 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0360779 [07/07/2022-18:29:54] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00568895 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0131126 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00621906 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00568895 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.099224 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0183731 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.099048 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0183731 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00484962 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00932415 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00409561 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00409561 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00516365 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0125606 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00533215 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00516365 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00567521 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0122488 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00453377 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00453377 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0056537 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0181676 [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00586218 [07/07/2022-18:29:54] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0056537 [07/07/2022-18:29:54] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:54] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:54] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0991227 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0170603 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.099096 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0170603 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00560551 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124804 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00534349 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00534349 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00439888 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00536652 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00439888 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00584625 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.012384 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0060736 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00584625 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00494651 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0185671 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00458973 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00458973 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00430769 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0172539 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00458292 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00430769 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00590054 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.013335 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00609086 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00590054 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00604019 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00861019 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0045928 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0045928 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00444672 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00826224 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00465007 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00444672 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00400597 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0104347 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00529287 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00400597 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00563662 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124962 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00551449 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00551449 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.09876 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00735026 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0989253 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00735026 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00415276 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00904562 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00413234 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00413234 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00549316 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0123653 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00529608 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00529608 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0057497 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00920937 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00352371 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00352371 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00367836 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00885361 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00446663 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00367836 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0987253 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00898302 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.098608 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00898302 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00434604 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0183472 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.005259 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00434604 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00616727 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0133764 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00566147 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00566147 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00461457 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00756124 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00353033 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00353033 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00429265 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912115 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00464148 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00429265 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.099064 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00983216 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0989493 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00983216 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00379709 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0174672 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00486554 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00379709 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(293 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00446692 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0091987 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00493725 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00446692 [07/07/2022-18:29:55] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00550103 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0528427 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00538374 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00538374 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00545531 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00933511 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00534823 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00534823 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00422994 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00885923 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00542314 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00422994 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00575044 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0130855 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00597695 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00575044 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00440112 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00740243 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0038525 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0038525 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00419987 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00890105 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00448654 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00419987 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00567846 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124184 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00581683 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00567846 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00543432 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00784769 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00445369 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00445369 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0062084 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0537509 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00602857 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00602857 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00538305 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00967741 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00539768 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00538305 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00422143 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00905888 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00451726 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00422143 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00580671 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0171029 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00596305 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00580671 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00547637 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0172261 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00371638 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00371638 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00565804 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00976366 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00547288 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00547288 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00533215 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0127332 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00594545 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00533215 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00637364 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0546301 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00655289 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00637364 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00573632 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00868185 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00549456 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00549456 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00431699 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00886933 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00431644 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00431644 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00448384 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0170747 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00447659 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00447659 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00431576 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0172453 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00444786 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00431576 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0055423 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00969508 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00550837 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00550837 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00421307 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0157629 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00562169 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00421307 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00588931 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0133389 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00608815 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00588931 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00435075 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00748966 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00384184 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00384184 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00424628 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0158686 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0048708 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00424628 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00581591 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0131664 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00599143 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00581591 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00567177 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00738412 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00430947 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00430947 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00405063 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00872807 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00441404 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00405063 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00531149 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0167669 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00567901 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00531149 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00568859 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0170688 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00563858 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00563858 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00604057 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00949778 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00573668 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00573668 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.004256 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.010459 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00442681 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.004256 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00434715 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0171237 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00382727 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00382727 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00387016 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0172117 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00401683 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00387016 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00577398 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00963657 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00570377 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00570377 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00426032 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0169115 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00449792 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00426032 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00617251 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0172448 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00596248 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00596248 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00548109 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0096387 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00545961 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00545961 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0042921 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00919784 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00447403 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0042921 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00431043 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0171824 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00544344 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00431043 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00597257 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0173387 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00636478 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00597257 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_72_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00571498 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00805257 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00573704 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00571498 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00416197 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00918198 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00458813 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00416197 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.100843 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0183158 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.100925 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0183158 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00525217 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0122446 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0052355 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0052355 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0042932 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912086 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00477506 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0042932 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0058575 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0125365 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00528267 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00528267 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0053994 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0180272 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00384086 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00384086 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.100651 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0172075 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.101016 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0172075 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0043133 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912115 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00446748 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0043133 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0044 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00946933 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00593273 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0044 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00575062 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0127518 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00597943 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00575062 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00425789 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0184056 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00418027 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00418027 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00584276 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.016984 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00620583 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00584276 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00600286 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00804876 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00402981 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00402981 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00424128 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00844267 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00455827 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00424128 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00444672 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912288 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00461341 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00444672 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00407219 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912288 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00415552 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00407219 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00437361 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0090191 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00443705 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00437361 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.100789 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102497 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.100795 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0102497 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00596552 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0135027 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00448412 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00448412 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00446137 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00920245 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00512727 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00446137 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00552568 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00901361 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0042132 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0042132 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00520747 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124879 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00585507 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00520747 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.100917 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0101818 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.10092 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0101818 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00435796 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0180755 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00356221 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00356221 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0044233 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00795708 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00347767 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00347767 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00371046 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00751265 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0035136 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0035136 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00371022 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00791764 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00378824 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00371022 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.101424 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0079713 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.10132 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0079713 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00371496 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0174 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00349767 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00349767 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(328 -> ) (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00368563 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00764485 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.003475 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.003475 [07/07/2022-18:29:55] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00365403 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0365408 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0037754 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00365403 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00482453 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0092643 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00487204 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00482453 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00385361 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00739988 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0038263 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0038263 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00372041 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00896197 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00434383 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00372041 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00428581 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0119128 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00575117 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00428581 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00552621 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0119722 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0052265 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0052265 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00383743 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00732661 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00391988 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00383743 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00419453 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00886288 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00502575 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00419453 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00552551 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0387722 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00560018 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00552551 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00515643 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00972709 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00476343 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00476343 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00416066 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0102248 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0043653 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00416066 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00427692 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124685 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00432205 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00427692 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00430126 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0125547 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0058034 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00430126 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00585525 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0142151 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00598267 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00585525 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00411239 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00728997 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00418107 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00411239 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00515315 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.038957 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00510982 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00510982 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00466267 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00966705 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00577563 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00466267 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00578961 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0125543 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00441937 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00441937 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00438912 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124705 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00591832 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00438912 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00589923 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0130954 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00550278 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00550278 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00512533 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00798502 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00501954 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00501954 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00426869 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0112626 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00564747 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00426869 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00585581 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0140796 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00607767 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00585581 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00433205 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00745553 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00381758 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00381758 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00422103 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.011413 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00448327 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00422103 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00430441 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00898358 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00447004 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00430441 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00429867 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00907762 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00451402 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00429867 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00581904 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0129136 [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00609532 [07/07/2022-18:29:55] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00581904 [07/07/2022-18:29:55] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:55] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:55] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:55] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00574518 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0126641 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00376341 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00376341 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00505681 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0128882 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00477608 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00477608 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0049669 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00967101 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00492 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00492 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00420067 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00889937 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00437804 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00420067 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00436682 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.012482 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00589062 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00436682 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00507604 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0125788 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00450595 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00450595 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00490275 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00969265 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00485148 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00485148 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00448782 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0129428 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00612926 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00448782 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00583687 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0129727 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00529168 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00529168 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00497098 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00905657 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00466059 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00466059 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00427405 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00880449 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00436862 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00427405 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0042537 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0125543 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00444914 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0042537 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00437139 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0126483 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0063038 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00437139 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_99_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00591776 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0139351 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00624217 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00591776 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00357935 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00749037 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00381491 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00357935 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.103133 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.01864 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.103195 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.01864 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00363293 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00906696 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00416224 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00363293 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00445795 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00924685 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00418573 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00418573 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00442709 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00923878 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00412023 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00412023 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00444615 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00787746 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00440772 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00440772 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.10312 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0173067 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.103069 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0173067 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00438691 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00895383 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00549054 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00438691 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00598114 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0132287 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00576349 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00576349 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00429648 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00785985 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00439214 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00429648 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00438608 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0181968 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00490342 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00438608 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00549071 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0184028 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00595791 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00549071 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00538804 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00763685 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0037772 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0037772 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00413011 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0091742 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00456811 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00413011 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00511984 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0125242 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00599905 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00511984 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0052695 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00891396 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00351033 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00351033 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00368094 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00751241 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00505164 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00368094 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.103048 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124768 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.102989 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0124768 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00471797 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00922897 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00409392 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00409392 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00551921 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0128652 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00535331 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00535331 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00508832 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00912779 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00416579 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00416579 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00542692 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0123032 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0057336 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00542692 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.103125 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00834667 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.103168 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00834667 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00391243 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0178796 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00457381 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00391243 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00450638 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00906696 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00374927 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00374927 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00367144 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00748018 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00345908 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00345908 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00454486 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00892997 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00447004 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00447004 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.103453 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00923589 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.103656 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00923589 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00431439 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.017655 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00410901 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00410901 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(398 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00442723 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00924425 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00358434 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00358434 [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00358687 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0229895 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00425654 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00358687 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00425519 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00975909 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00540989 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00425519 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00542486 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0123261 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00592131 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00542486 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00584852 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0083824 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00374862 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00374862 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00359994 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00798425 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00439958 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00359994 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00423075 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0117951 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00587209 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00423075 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00548756 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.012149 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00472323 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00472323 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00363073 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0111074 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00574355 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00363073 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00551572 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0236338 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0044341 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0044341 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00408767 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0115803 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00616902 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00408767 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00574228 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0104497 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00361841 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00361841 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00362609 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00858393 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00433829 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00362609 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00426329 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00881909 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00400381 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00400381 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00412326 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00800762 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00435325 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00412326 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00422764 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00894007 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0041912 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0041912 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00442989 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0231132 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00437652 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00437652 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00430851 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0098742 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00451099 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00430851 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00419667 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00891396 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00380242 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00380242 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00487668 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0129776 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00567647 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00487668 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00366099 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00795784 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00400495 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00366099 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00427166 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00992314 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00447943 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00427166 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00389123 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00729043 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00376497 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00376497 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00549054 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124365 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00400914 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00400914 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00364023 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0073978 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00425168 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00364023 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00425073 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00900688 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00552079 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00425073 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00550925 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0124128 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00574749 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00550925 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00432027 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00739548 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00380509 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00380509 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00379612 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00880056 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00440758 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00379612 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0047043 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00821854 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00367941 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00367941 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00406246 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00790822 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00446208 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00406246 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00430838 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00968411 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00455914 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00430838 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00424223 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00889011 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00435339 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00424223 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0051297 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0130031 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00622025 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0051297 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00595163 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.012612 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00591607 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00591607 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00572222 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0101062 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00453391 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00453391 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00436516 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0123105 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00587266 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00436516 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00550295 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0120069 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00464059 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00464059 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00412629 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00871986 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00461297 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00412629 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00427706 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00827733 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00376725 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00376725 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00379103 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00793352 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00378283 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00378283 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x0000000000000000 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00366429 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00794337 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00385888 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00366429 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Unsqueeze_153_copy_output (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00408859 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0085272 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00412207 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00408859 [07/07/2022-18:29:56] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0x00000000000003e8 [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1478656,1,9728,64) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(1478656,23104,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(739328,23104:2,152,1) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(184832,1:8,1216,8) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0306599 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0356853 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0307743 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0306599 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0195396 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0204392 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0196417 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0195396 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0215927 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0237646 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021532 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.021532 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0287138 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0201437 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0287476 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0201437 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0532282 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0374898 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0532602 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0374898 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0482956 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0243276 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0480488 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0243276 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.048861 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0228935 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0488625 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0228935 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0218093 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0202165 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021802 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0202165 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0196248 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0195396 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.019626 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0195396 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0329891 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0228075 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0328941 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0228075 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0187159 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0146268 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0187627 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0146268 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0288862 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.015695 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0288098 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.015695 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.021142 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0238179 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0179121 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0179121 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0258658 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0230492 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0257543 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0230492 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0182316 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0450173 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0145127 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0145127 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0226119 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0151258 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0111751 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0111751 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0310148 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0252648 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0218153 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0218153 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0220687 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0234972 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0220967 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0220687 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0294364 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0374874 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0102568 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0102568 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(295 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0299876 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0177628 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00954667 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00954667 [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,1,304,2) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(46208,1,304,2) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(46208,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(1520,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(5776,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,1,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,1,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(760,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(11552,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(2888,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00389271 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0399621 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00515167 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00389271 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00491169 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00927615 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0041996 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0041996 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00686911 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0111829 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00707533 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00686911 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00696978 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00932474 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00690873 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00690873 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00703378 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0091693 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00765067 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00703378 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00581536 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0489722 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00617758 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00581536 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0052725 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0163591 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00499455 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00499455 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00558596 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0191242 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00549543 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00549543 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00408559 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0397239 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00469964 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00408559 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00466652 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.009328 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00414591 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00414591 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00501843 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00738667 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00387261 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00387261 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00471407 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0122842 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00435352 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00435352 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00645374 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0130018 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00565532 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00565532 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00632674 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.010746 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00363351 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00363351 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00661124 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00837627 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00409067 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00409067 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0057177 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0163825 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00571896 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0057177 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00567955 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0450733 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00376965 [07/07/2022-18:29:56] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00376965 [07/07/2022-18:29:56] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:56] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0172813 [07/07/2022-18:29:56] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0517013 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00535907 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00535907 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00412458 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0275938 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00426464 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00412458 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00456029 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.010508 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00594283 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00456029 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00605486 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.013449 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00615137 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00605486 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00573144 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00761236 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00583136 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00573144 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00583779 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00906119 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00560373 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00560373 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00489863 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0489935 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00613275 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00489863 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00593366 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.015968 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00598229 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00593366 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0049669 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0186062 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00489785 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00489785 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0040577 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0276365 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00464518 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0040577 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00613411 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0135249 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0057374 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0057374 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00577766 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.007488 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00357583 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00357583 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00432 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00930904 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00418653 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00418653 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00523283 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0129186 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00567955 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00523283 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00608776 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0133376 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00496 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00496 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00577398 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00892575 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00346601 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00346601 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00449692 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0165024 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0041696 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0041696 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00438821 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0449907 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00409119 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00409119 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00453838 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0509227 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00455712 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00453838 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00410211 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0156305 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00423196 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00410211 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00445668 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00972343 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00554334 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00445668 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00570269 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0127605 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00582768 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00570269 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00463081 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00759564 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00451877 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00451877 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00448028 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00918746 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0045613 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00448028 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00540766 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0490149 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00584368 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00540766 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00561405 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0160284 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00451719 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00451719 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00444421 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0187526 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00601181 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00444421 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00557316 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0154822 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00566617 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00557316 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00368996 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00775888 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00361416 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00361416 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00442709 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00916238 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00439719 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00439719 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00561902 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0127842 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00432984 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00432984 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00439186 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00971611 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00549071 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00439186 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00577674 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.012785 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00530269 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00530269 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00471392 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00756101 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00346106 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00346106 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00566002 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0163144 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00563965 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00563965 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00549631 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.044876 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00375227 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00375227 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00393575 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0504107 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00456504 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00393575 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0125724 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00964419 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0126767 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00964419 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00749464 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0108115 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00721248 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00721248 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00640382 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0130654 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00452267 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00452267 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00758255 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00928889 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00567069 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00567069 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0107173 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0140747 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0106573 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0106573 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00510998 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00927585 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00513887 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00510998 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0146848 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0099131 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0146003 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0099131 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0129625 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0585316 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0129662 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0129625 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00689937 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.019075 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00669205 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00669205 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00773915 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0178403 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00777699 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00773915 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0127218 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00943733 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0128083 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00943733 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0075091 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0172709 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00750507 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00750507 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00589717 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00938933 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00470535 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00470535 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00733264 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00996957 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00464207 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00464207 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.012719 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00974781 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0128829 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00974781 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00844987 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.019914 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0084152 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0084152 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00543002 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00986447 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00453593 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00453593 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0124859 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0151573 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0126795 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0124859 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0149482 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00981804 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0149408 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00981804 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.01071 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0197314 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.010567 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.010567 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0146741 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0115796 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0146361 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0115796 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0129264 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0191295 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0130835 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0129264 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00771782 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0185979 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00767539 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00767539 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(306 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00669781 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0522865 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00663759 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00663759 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00967985 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00984784 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00960762 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00960762 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00535297 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0098971 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00534129 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00534129 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00541437 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00980643 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00415276 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00415276 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00732499 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00878441 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00463704 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00463704 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0121501 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0104917 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0121364 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0104917 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00492125 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00978316 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00500028 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00492125 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0147265 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00987671 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0147631 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.00987671 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00991028 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0585333 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00986572 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00986572 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00571914 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0188385 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00565442 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00565442 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00741452 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0177583 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00737902 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00737902 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00970209 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00978865 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00965516 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00965516 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00539097 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0169952 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00539011 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00539011 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00518646 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0101744 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0044773 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0044773 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00721021 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00824169 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00463274 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00463274 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00965303 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00988424 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00965394 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00965303 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0103929 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0198224 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0103483 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0103483 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00491812 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00992345 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00441516 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00441516 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0131143 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0138146 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0131487 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.0131143 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0113415 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0099087 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0112405 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0099087 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0122023 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0198055 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0121592 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0121592 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0147525 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0113941 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.014771 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0113941 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00996267 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0191336 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00993506 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00993506 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00551904 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0186317 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00550155 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00550155 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(341 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00554492 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0520808 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00570847 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00554492 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00716119 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00969143 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00724962 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00716119 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00536957 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00930874 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0052505 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0052505 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00495608 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00836267 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00401994 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00401994 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00716913 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00998933 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00462378 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00462378 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0132644 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0106097 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0133905 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0106097 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00486663 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00991843 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00501652 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00486663 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0149946 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0105593 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0150029 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0105593 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00685562 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0585209 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00685344 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00685344 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00490792 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0189067 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0050049 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00490792 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00729438 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0178392 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00723381 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00723381 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00712216 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00994667 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00702511 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00702511 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00524083 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0170379 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00529896 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00524083 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00482453 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00999655 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00454674 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00454674 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00711376 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00858311 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00471136 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00471136 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00716891 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00994855 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00692397 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00692397 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.012557 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0198061 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.012668 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.012557 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00488997 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00999906 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.004251 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.004251 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0141582 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0127099 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0142338 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0127099 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00770448 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00986855 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00778394 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00770448 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0136201 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0199002 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0135898 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0135898 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.015231 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0115336 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0151096 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003ea Time: 0.0115336 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.0069157 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0190104 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00688522 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00688522 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00543948 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0186744 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00539596 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00539596 [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat(411 -> ) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00495169 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0518552 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00498722 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00495169 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> output) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00435463 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00981678 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00445156 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00435463 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 345) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00398514 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.0084272 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00414828 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x00000000000003e8 Time: 0.00398514 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(4560,2280,456:32,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,34656,456:2,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(17328,8664,1:8,57,19) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,69312,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,2280,456:32,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,69312,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,34656,456:2,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,8664,1:8,57,19) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,23104,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Optimizer Reformat( -> 415) (Reformat) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003e8 Time: 0.00430906 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.00926489 [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00381382 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00381382 [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(7393280,1,48640,320) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(7393280,23104,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(3696640,23104:2,152,1) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(924160,1:8,6080,40) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1,456,3) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(23104,23104:32,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(46208,23104:2,152,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(69312,1,456,3) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Float(23104,23104:32,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(23104,1:8,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,23104,1,152,152) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(2280,760,152:32,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(34656,11552,152:2,1,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(8664,2888,1:8,19,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(6840,2280,456:32,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Float(69312,1:4,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(103968,34656,456:2,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(25992,8664,1:8,57,19) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,1:8,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing reformatting costs [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning Reformat: Half(69312,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:29:57] [TRT] [V] =============== Computing costs for [07/07/2022-18:29:57] [TRT] [V] *************** Autotuning format combination: Float(1108992,369664,608,1) -> Float(5914624,92416,304,1) *************** [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CudaDepthwiseConvolution) [07/07/2022-18:29:57] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:29:57] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (FusedConvActConvolution) [07/07/2022-18:29:57] [TRT] [V] Tactic: 0x000000000001ffff Time: 0.289056 [07/07/2022-18:29:57] [TRT] [V] Fastest Tactic: 0x000000000001ffff Time: 0.289056 [07/07/2022-18:29:58] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CudnnConvolution) [07/07/2022-18:29:58] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.493504 [07/07/2022-18:29:58] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.323979 [07/07/2022-18:29:58] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.733205 [07/07/2022-18:29:58] [TRT] [V] Tactic: 0x0000000000000005 Time: 59.8808 [07/07/2022-18:29:58] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.493568 [07/07/2022-18:29:58] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.323776 [07/07/2022-18:29:58] [TRT] [V] Tactic: 0x000000000000003a Time: 0.733963 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000000003d Time: 59.7898 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0x0000000000000039 Time: 0.323776 [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CaskConvolution) [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.258736 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.139918 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.298763 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.237813 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.141497 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.178976 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0x27728c886a448c5a Time: 0.139918 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x27728c886a448c5a [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Float(1108992,1,1824,3) -> Float(5914624,1,19456,64) *************** [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CaskConvolution) [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.626784 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.622773 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xca84742beb9f9767 Time: 0.622773 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xca84742beb9f9767 [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Half(1108992,369664,608,1) -> Half(5914624,92416,304,1) *************** [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CudnnConvolution) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.474443 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.248357 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.562592 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000000005 Time: 59.6568 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.474507 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000000003a Time: 0.563904 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000000003d Time: 59.6194 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.248357 [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CaskConvolution) [07/07/2022-18:29:59] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Half(739328,369664:2,608,1) -> Half(2957312,92416:2,304,1) *************** [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (FusedConvActConvolution) [07/07/2022-18:29:59] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CaskConvolution) [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.0990187 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.09884 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0990853 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.099376 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.116053 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.115893 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.118283 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.211024 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.206645 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.116508 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.208117 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.210144 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0x16eafdbc5869b184 Time: 0.09884 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x16eafdbc5869b184 [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Half(369664,1:4,608,1) -> Half(739328,1:8,2432,8) *************** [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CaskConvolution) [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_first_layer_filter7x7_fwd Tactic: 0x8c03a77858cdae89 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x8c03a77858cdae89 Time: 0.145209 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: trt_turing_cutlass_image_network_first_layer_hmma_fprop_f16f16f32_nhwc_nhwc_k64r7s7c4_stride2x2 Tactic: 0xe2222883a6602489 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xe2222883a6602489 Time: 0.0973707 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xe2222883a6602489 Time: 0.0973707 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xe2222883a6602489 [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Half(369664,1:8,608,1) -> Float(5914624,92416,304,1) *************** [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CaskConvolution) [07/07/2022-18:29:59] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Half(369664,1:8,608,1) -> Half(739328,1:8,2432,8) *************** [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CudaDepthwiseConvolution) [07/07/2022-18:29:59] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:29:59] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:29:59] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:29:59] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_0 + Relu_1 (CaskConvolution) [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.566677 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 1.37439 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.239531 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.376149 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 2.45692 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 1.56131 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 1.26187 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.732149 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.469323 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.727051 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.630581 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.697195 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.360405 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.752501 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.404181 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.393216 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.286235 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.512 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.748 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.845995 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.653579 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.259211 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.262352 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: trt_turing_cutlass_image_network_first_layer_hmma_fprop_f16f16f32_nhwc_nhwc_k64r7s7c8_stride2x2 Tactic: 0x89d2643fb1fde16d [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x89d2643fb1fde16d Time: 0.176533 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.419499 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.692256 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.424075 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.358432 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 1.14096 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.465408 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.859243 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.961195 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.755275 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.460779 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.763808 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.732085 [07/07/2022-18:29:59] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.718144 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0x89d2643fb1fde16d Time: 0.176533 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x89d2643fb1fde16d [07/07/2022-18:29:59] [TRT] [V] =============== Computing costs for [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Float(5914624,92416,304,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (TiledPooling) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000000101 Time: 0.136661 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000010101 Time: 0.121483 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000020101 Time: 0.129067 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000030101 Time: 0.134891 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000040101 Time: 0.109352 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000050101 Time: 0.184048 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000060101 Time: 0.127641 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000070101 Time: 0.1113 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000080101 Time: 0.098992 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000090101 Time: 0.102301 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000a0101 Time: 0.081312 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000b0101 Time: 0.073312 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000c0101 Time: 0.112199 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000d0101 Time: 0.0935333 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000e0101 Time: 0.120242 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000f0101 Time: 0.113362 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000100101 Time: 0.096344 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000110101 Time: 0.0728576 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000120101 Time: 0.0699221 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000130101 Time: 0.098136 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000140101 Time: 0.0881493 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000150101 Time: 0.136779 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000160101 Time: 0.12672 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000170101 Time: 0.0945253 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000180101 Time: 0.0697045 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000190101 Time: 0.0687403 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001a0101 Time: 0.091472 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001b0101 Time: 0.0849467 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001c0101 Time: 0.139922 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001d0101 Time: 0.13141 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001e0101 Time: 0.0945893 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001f0101 Time: 0.0689835 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000200101 Time: 0.0685184 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000210101 Time: 0.0886427 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000220101 Time: 0.0838853 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000230101 Time: 0.140171 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000240101 Time: 0.133006 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000250101 Time: 0.0952107 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000260101 Time: 0.06832 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000270101 Time: 0.0683755 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000280101 Time: 0.0865627 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000290101 Time: 0.0829461 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000006a0101 Time: 0.0576267 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0x00000000006a0101 Time: 0.0576267 [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (CudnnPooling) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xffffffffffffffff Time: 0.0619804 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xffffffffffffffff Time: 0.0619804 [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (CaskPooling) [07/07/2022-18:29:59] [TRT] [V] MaxPool_2 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP32FP32NCHW_Max Tactic: 0xb59f9cfb90407c92 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xb59f9cfb90407c92 Time: 0.0617707 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xb59f9cfb90407c92 Time: 0.0617707 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 0x00000000006a0101 [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Half(5914624,92416,304,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (TiledPooling) [07/07/2022-18:29:59] [TRT] [V] TiledPooling has no valid tactics for this config, skipping [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (CudnnPooling) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xffffffffffffffff Time: 0.0467893 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xffffffffffffffff Time: 0.0467893 [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (CaskPooling) [07/07/2022-18:29:59] [TRT] [V] MaxPool_2 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NCHW_Max Tactic: 0xfd3a631f5c3e741e [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xfd3a631f5c3e741e Time: 0.0522484 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xfd3a631f5c3e741e Time: 0.0522484 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnPooling Tactic: 0xffffffffffffffff [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Half(2957312,92416:2,304,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (TiledPooling) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000000101 Time: 0.0596071 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000010101 Time: 0.054403 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000020101 Time: 0.064688 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000030101 Time: 0.0714048 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000040101 Time: 0.0591378 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000050101 Time: 0.09208 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000060101 Time: 0.0658987 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000070101 Time: 0.0492983 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000080101 Time: 0.0465693 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000090101 Time: 0.0450387 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000a0101 Time: 0.045656 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000b0101 Time: 0.0396895 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000c0101 Time: 0.0574791 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000d0101 Time: 0.045 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000e0101 Time: 0.0494796 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000f0101 Time: 0.0470267 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000100101 Time: 0.039565 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000110101 Time: 0.0399336 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000120101 Time: 0.0364267 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000130101 Time: 0.0478918 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000140101 Time: 0.0398803 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000150101 Time: 0.0510461 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000160101 Time: 0.049981 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000170101 Time: 0.0370048 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000180101 Time: 0.0374827 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000190101 Time: 0.0357664 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001a0101 Time: 0.043144 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001b0101 Time: 0.0370394 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001c0101 Time: 0.05168 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001d0101 Time: 0.0524419 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001e0101 Time: 0.0373108 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001f0101 Time: 0.0368213 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000200101 Time: 0.0355552 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000210101 Time: 0.0410038 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000220101 Time: 0.037043 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000230101 Time: 0.0530042 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000240101 Time: 0.0535482 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000250101 Time: 0.0376794 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000260101 Time: 0.0357557 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000270101 Time: 0.0349611 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000280101 Time: 0.039539 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x0000000000290101 Time: 0.0361739 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000006a0101 Time: 0.0317605 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0x00000000006a0101 Time: 0.0317605 [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (CudaPooling) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xfffffffffffffffd Time: 0.031969 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xfffffffffffffffd Time: 0.031969 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: TiledPooling Tactic: 0x00000000006a0101 [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Half(739328,1:8,2432,8) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (TiledPooling) [07/07/2022-18:29:59] [TRT] [V] TiledPooling has no valid tactics for this config, skipping [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (CudaPooling) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xfffffffffffffffe Time: 0.0308209 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xfffffffffffffffe Time: 0.0308209 [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (CudnnPooling) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xffffffffffffffff Time: 0.0309537 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0xffffffffffffffff Time: 0.0309537 [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: MaxPool_2 (CaskPooling) [07/07/2022-18:29:59] [TRT] [V] MaxPool_2 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign8 Tactic: 0x6613a704fbea2e33 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x6613a704fbea2e33 Time: 0.15638 [07/07/2022-18:29:59] [TRT] [V] MaxPool_2 Set Tactic Name: sm50_xmma_pooling_fw_4d_FP16FP32NHWC_Max_CAlign4 Tactic: 0xea62e389fb7bcc66 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0xea62e389fb7bcc66 Time: 0.316341 [07/07/2022-18:29:59] [TRT] [V] Fastest Tactic: 0x6613a704fbea2e33 Time: 0.15638 [07/07/2022-18:29:59] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudaPooling Tactic: 0xfffffffffffffffe [07/07/2022-18:29:59] [TRT] [V] =============== Computing costs for [07/07/2022-18:29:59] [TRT] [V] *************** Autotuning format combination: Float(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CudaDepthwiseConvolution) [07/07/2022-18:29:59] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:29:59] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (FusedConvActConvolution) [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.163648 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000affff Time: 0.151676 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000effff Time: 0.141056 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.150674 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.144622 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000001affff Time: 0.178267 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.183307 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.15296 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.147751 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.147634 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.145365 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.158944 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x00000000006effff Time: 0.162393 [07/07/2022-18:29:59] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.152149 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.157301 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.148857 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.187483 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.155726 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.144935 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.157739 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.146588 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x00000000000effff Time: 0.141056 [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CudnnConvolution) [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.441877 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.186299 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.593269 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198224896, available: 268435456 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000005 Time: 4.02773 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.147876 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.430048 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.18336 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003a Time: 0.583371 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198224896, available: 268435456 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003d Time: 4.06801 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003e Time: 0.14677 [07/07/2022-18:30:00] [TRT] [I] Some tactics do not have sufficient workspace memory to run. Increasing workspace size will enable more tactics, please check verbose output for requested sizes. [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.14677 [07/07/2022-18:30:00] [TRT] [V] Setting workspace to 2198224896enables more tactics for profiling [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.251029 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.102491 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.136501 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.249883 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.260779 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.141376 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.187819 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.219819 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.144196 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.223451 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.225563 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.427349 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.317669 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.177109 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.194907 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.317099 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.593163 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.188309 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.102491 [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Float(1478656,1,9728,64) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.390645 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.260827 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.256496 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.207456 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.203787 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.162752 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.139687 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.262027 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.163452 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.295077 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.259413 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.139804 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.251221 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.162464 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.206405 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.257739 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.137991 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.293717 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.16331 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0xd2b62ec40baf8ee4 Time: 0.137991 [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Half(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_3 + Relu_4.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CudnnConvolution) [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.410283 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.208459 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.488373 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198224896, available: 268435456 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000005 Time: 3.93899 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.169035 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.402848 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003a Time: 0.480597 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198224896, available: 268435456 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003d Time: 3.95745 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003e Time: 0.169536 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.169035 [07/07/2022-18:30:00] [TRT] [V] Setting workspace to 2198224896enables more tactics for profiling [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_3 + Relu_4.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000006 [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Half(739328,23104:2,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_3 + Relu_4.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (FusedConvActConvolution) [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.082592 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000000affff Time: 0.0747328 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000000effff Time: 0.0726571 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.076 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.0731989 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000001affff Time: 0.106523 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.112206 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.0808256 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.0733973 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.0725589 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.0750421 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.0828224 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000006effff Time: 0.0896827 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.0900827 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.0876187 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.0772608 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.116676 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.0797056 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.0750763 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.0847547 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.0774187 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x000000000036ffff Time: 0.0725589 [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_3 + Relu_4.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.0773227 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0771968 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0775189 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0759125 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.0781291 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0827669 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0819285 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0757909 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.13787 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.0815787 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0765077 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.137636 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.141344 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.138446 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.05848 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.08144 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0772971 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.137348 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.139982 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.05848 [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_3 + Relu_4.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_3 + Relu_4.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CudaDepthwiseConvolution) [07/07/2022-18:30:00] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_3 + Relu_4.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_3 + Relu_4 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.139954 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0536488 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0712725 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0504686 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.085968 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0614436 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.144217 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0389653 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.073024 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0483596 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.144736 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0470293 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0537097 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.0958827 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0480274 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0586702 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.097488 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0359819 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0378797 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0564693 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0362624 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0467573 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.138268 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0816683 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0840773 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.04032 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0721195 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.047392 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.0863173 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.046376 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0673259 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0715968 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.092208 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0491078 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.13878 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0495269 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.047404 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.040339 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0524419 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0574916 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.05024 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0558044 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0394465 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0615964 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0737536 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0400948 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0572302 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0607004 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0817984 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0524008 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0416813 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0364619 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0503787 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.0366389 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0540602 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0621653 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0615271 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.0946613 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0605849 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.056688 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0507474 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0638471 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.098216 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.096088 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0399751 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0473173 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.071168 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0391052 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0576213 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0552945 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0592853 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0370123 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.0572409 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0488853 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0920427 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0484648 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0609387 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.145404 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0527512 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.037901 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0597938 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0548632 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0449787 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0674283 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0821525 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0578524 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0568871 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0872347 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0827435 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.096568 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0871413 [07/07/2022-18:30:00] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0460413 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x1dcf9babce3d9b3b Time: 0.0359819 [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:00] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Float(1478656,23104,152,1), Float(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CudaDepthwiseConvolution) [07/07/2022-18:30:00] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (FusedConvActConvolution) [07/07/2022-18:30:00] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CudnnConvolution) [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.465483 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.219947 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.613301 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198224896, available: 268435456 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000005 Time: 4.26448 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.185685 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.465579 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.219611 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003a Time: 0.626005 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198224896, available: 268435456 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003d Time: 4.20157 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003e Time: 0.185547 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.185547 [07/07/2022-18:30:00] [TRT] [V] Setting workspace to 2198224896enables more tactics for profiling [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.251867 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.113109 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.138581 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.251077 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.268539 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.143588 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.190363 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.222672 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.146475 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.233909 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.242757 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.436629 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.34144 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.182251 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.197013 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.340299 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.627659 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.190171 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.113109 [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Float(1478656,1,9728,64), Float(1478656,1,9728,64) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.409365 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.259472 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.261963 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.209483 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.217611 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.165355 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.143548 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.259744 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.181141 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.301515 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.257893 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.144309 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.258864 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.165913 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.208848 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.264469 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.142862 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.296277 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.181424 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0xd2b62ec40baf8ee4 Time: 0.142862 [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Half(1478656,23104,152,1), Half(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_5 + Add_6 + Relu_7.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CudnnConvolution) [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.421237 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.222539 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.505248 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198224896, available: 268435456 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000005 Time: 4.0958 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.183541 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.417792 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003a Time: 0.502357 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198224896, available: 268435456 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003d Time: 4.1767 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x000000000000003e Time: 0.183813 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.183541 [07/07/2022-18:30:00] [TRT] [V] Setting workspace to 2198224896enables more tactics for profiling [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_5 + Add_6 + Relu_7.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000006 [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Half(739328,23104:2,152,1), Half(739328,23104:2,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_5 + Add_6 + Relu_7.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (FusedConvActConvolution) [07/07/2022-18:30:00] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_5 + Add_6 + Relu_7.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.0737429 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0734763 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0740096 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0726955 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.0742144 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0797035 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0786859 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0724267 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.136178 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.0807189 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0762197 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.136036 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.139598 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.136693 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.0591413 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.0808939 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0778645 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.138542 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.141223 [07/07/2022-18:30:00] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.0591413 [07/07/2022-18:30:00] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8), Float(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_5 + Add_6 + Relu_7.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8), Half(184832,1:8,1216,8) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_5 + Add_6 + Relu_7.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CudaDepthwiseConvolution) [07/07/2022-18:30:00] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:00] [TRT] [W] Weights [name=Conv_5 + Add_6 + Relu_7.weight] had the following issues when converted to FP16: [07/07/2022-18:30:00] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:00] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:00] [TRT] [V] --------------- Timing Runner: Conv_5 + Add_6 + Relu_7 (CaskConvolution) [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.147534 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0571182 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0733888 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0542354 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.092056 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0735637 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.152608 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0432933 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.0926453 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0512411 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.152651 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0502202 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0565102 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.107139 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0514347 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0619307 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.103757 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0422867 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0417267 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0647289 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0410133 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0499535 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.146507 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.087752 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0864373 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0486659 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0786347 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.056688 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.0939707 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0517303 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0698795 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0757547 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.10016 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0521569 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.146364 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0529204 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0508602 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.044268 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0556533 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0665422 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0530895 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0637724 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.043072 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0633689 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.100149 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.044096 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0661333 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0631947 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.08772 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0547474 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0452507 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0425133 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0545173 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.0427267 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0573227 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0740864 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0724715 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.105019 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.063136 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0593173 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0547535 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0663076 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.104277 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.101896 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0485425 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0566009 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.0787093 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.047904 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0661316 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0581511 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0613476 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0424307 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.0657493 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0516404 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0996027 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0512061 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0647964 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.15312 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0555982 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.041932 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:00] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0615804 [07/07/2022-18:30:00] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0629867 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0506057 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0700587 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0844507 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0608249 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0655662 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.094432 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0848533 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.106861 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0942827 [07/07/2022-18:30:01] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0514377 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x30150d05024bc911 Time: 0.0410133 [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x30150d05024bc911 [07/07/2022-18:30:01] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Float(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Float(1478656,1,9728,64) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_8 + Relu_9.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(739328,23104:2,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_8 + Relu_9.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_8 + Relu_9.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_8 + Relu_9 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_8 + Relu_9.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Float(1478656,23104,152,1), Float(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Float(1478656,1,9728,64), Float(1478656,1,9728,64) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(1478656,23104,152,1), Half(1478656,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_10 + Add_11 + Relu_12.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(739328,23104:2,152,1), Half(739328,23104:2,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_10 + Add_11 + Relu_12.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8), Float(1478656,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_10 + Add_11 + Relu_12.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_10 + Add_11 + Relu_12 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8), Half(184832,1:8,1216,8) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_10 + Add_11 + Relu_12.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Float(1478656,23104,152,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CudaDepthwiseConvolution) [07/07/2022-18:30:01] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (FusedConvActConvolution) [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000006ffff Time: 0.13515 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x000000000006ffff Time: 0.13515 [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CudnnConvolution) [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.150969 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.101787 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.189275 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000005 Time: 5.25247 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.150539 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.101701 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003a Time: 0.189605 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003d Time: 5.28938 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x0000000000000039 Time: 0.101701 [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0895973 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.0931013 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.088768 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.0897893 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0967413 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.102013 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.116174 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.099368 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.108603 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.108349 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.13878 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.103083 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0997013 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.109632 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.104408 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.19992 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.102597 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x365602d0613d4c36 Time: 0.088768 [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Float(1478656,1,9728,64) -> Float(739328,1,9728,128) *************** [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.190955 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.0923973 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.09068 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.106835 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.1312 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.100363 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.0921493 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.092264 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.0833787 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.101787 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.090568 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.092312 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.0907013 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.100472 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.107104 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.0935147 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.0916373 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.101021 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.083512 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x516049bee7812ab0 Time: 0.0833787 [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(1478656,23104,152,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_13 + Relu_14.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CudnnConvolution) [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.143214 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.113508 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.181579 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000005 Time: 5.2183 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.143268 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003a Time: 0.181632 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003d Time: 5.16317 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.113508 [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_13 + Relu_14.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(739328,23104:2,152,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_13 + Relu_14.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (FusedConvActConvolution) [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000006ffff Time: 0.0620142 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x000000000006ffff Time: 0.0620142 [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_13 + Relu_14.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.0496564 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0493059 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0493653 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0484465 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.0497432 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0530194 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0531886 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0482789 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0462813 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.0543177 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.05168 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0464307 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.0475453 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.046688 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.0535634 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0516754 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0467507 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.0475293 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x87e5c2a636a0d1f8 Time: 0.0462813 [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_13 + Relu_14.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_13 + Relu_14.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CudaDepthwiseConvolution) [07/07/2022-18:30:01] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_13 + Relu_14.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_13 + Relu_14 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.0483002 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0289351 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0373606 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0277908 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0302596 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0281564 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.0506987 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0251733 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.0288311 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0221413 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0505539 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.021738 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0293662 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.0470467 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0277465 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0342293 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0353536 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0220953 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0219933 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0282347 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.023638 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0211547 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.0483231 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0289707 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0297093 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0215653 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0273805 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0228914 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.0299511 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0198846 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0354645 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0272263 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0457533 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0298293 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.0484526 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0302818 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0272501 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.022976 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0307181 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0294311 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0303379 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0282498 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0229184 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0225408 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.029064 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.022629 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0295698 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0347339 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0293689 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.030433 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0234091 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0228764 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0281271 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.0228693 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0296764 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0283191 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0279182 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.0466427 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0349621 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0308771 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0302347 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0362443 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0355637 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0349099 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0215207 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0228772 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.0271147 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0209973 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0230208 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0299973 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0221207 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0237184 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.028728 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0298809 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0456573 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0292071 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0357643 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0511634 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0286791 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0223168 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0224889 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.028 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0192717 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0359968 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0295076 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0338613 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0285929 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0303147 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.029656 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.0471533 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0306754 [07/07/2022-18:30:01] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0197245 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0xd47a5fce3824e4a4 Time: 0.0192717 [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:01] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Float(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (CudaDepthwiseConvolution) [07/07/2022-18:30:01] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (FusedConvActConvolution) [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.174971 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000000affff Time: 0.182496 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000000effff Time: 0.145003 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.159812 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.149184 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000001affff Time: 0.167211 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.159744 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.152537 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.14827 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.14842 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.15274 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.15632 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000006effff Time: 0.14955 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.146094 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.149749 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.145732 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.158933 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.158997 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.141881 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.151129 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.144267 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x00000000009fffff Time: 0.141881 [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (CudnnConvolution) [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.272363 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.198592 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.329051 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000005 Time: 1.89026 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.103141 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.270581 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.198379 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003a Time: 0.329456 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003d Time: 1.91065 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003e Time: 0.102949 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.102949 [07/07/2022-18:30:01] [TRT] [V] Setting workspace to 2198667264enables more tactics for profiling [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.168619 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.0893973 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.176037 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.165856 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.16896 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.180859 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.184363 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.215552 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.188768 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.203781 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.202987 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.254901 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.194197 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.176784 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.201333 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.193749 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.373344 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.184837 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.0893973 [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Float(739328,1,9728,128) -> Float(739328,1,9728,128) *************** [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.349312 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.169467 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.168816 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.203189 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.238293 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.185861 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.174496 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.169349 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.149333 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.185707 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.168725 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.175136 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.168571 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.185712 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.203093 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.172229 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.173328 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.185467 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.149668 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x516049bee7812ab0 Time: 0.149333 [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_15.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (CudnnConvolution) [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.270048 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.203739 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.289168 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000005 Time: 1.91472 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.13008 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.270235 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003a Time: 0.2896 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003d Time: 1.88211 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000000003e Time: 0.129931 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.129931 [07/07/2022-18:30:01] [TRT] [V] Setting workspace to 2198667264enables more tactics for profiling [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_15.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:01] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e [07/07/2022-18:30:01] [TRT] [V] *************** Autotuning format combination: Half(369664,5776:2,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_15.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (FusedConvActConvolution) [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.089776 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000000affff Time: 0.090072 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000000effff Time: 0.0734571 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.0789099 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.0758635 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000001affff Time: 0.0906987 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.090496 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.0787925 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.0738304 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.0737963 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.0779349 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.0811883 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000006effff Time: 0.0786923 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.0769643 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.0770539 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.0741675 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.0926693 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.0815467 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.0734869 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.0805419 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.0755819 [07/07/2022-18:30:01] [TRT] [V] Fastest Tactic: 0x00000000000effff Time: 0.0734571 [07/07/2022-18:30:01] [TRT] [W] Weights [name=Conv_15.weight] had the following issues when converted to FP16: [07/07/2022-18:30:01] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:01] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:01] [TRT] [V] --------------- Timing Runner: Conv_15 (CaskConvolution) [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.0951467 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0929707 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0938053 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0907787 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.09416 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0983227 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.097416 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0905733 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0867173 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:01] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.100117 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:01] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.093688 [07/07/2022-18:30:01] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0868987 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.0893093 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0876347 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.047052 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.0988827 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0938213 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.087968 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.0889413 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.047052 [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_15.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_15 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_15.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_15 (CudaDepthwiseConvolution) [07/07/2022-18:30:02] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_15.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_15 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.0882693 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0518004 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0695936 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0495253 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0515703 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0504747 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.090096 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.040717 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.0487893 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0348885 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.090304 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0335147 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0515185 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.0865653 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.047968 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0612 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0584249 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0367477 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.037357 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.048893 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0371473 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0329862 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.0885093 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0513615 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.052931 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0331627 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0491992 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0344693 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.0529752 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0313241 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0650222 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.048096 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0854267 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0485486 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.0881707 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0487436 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0474347 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0383668 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0520838 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0512609 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0547794 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0503756 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.039507 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0384687 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0485303 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0382696 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0510659 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0612196 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0523215 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0511573 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0398163 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0381499 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0496183 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.0381227 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0520579 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0501699 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0495269 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.0855413 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0615431 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0542842 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0524693 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0647431 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0582951 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0575609 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0331219 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0347083 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.0485714 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0319709 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0349856 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0532114 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0373724 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.037235 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.0496747 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0534202 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0846267 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0522194 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.064592 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.090096 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0504564 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0379508 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0376794 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0495253 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0303787 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0654791 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.052256 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0601902 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0494217 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0537326 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0528137 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.0858987 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0546606 [07/07/2022-18:30:02] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0311835 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0xd47a5fce3824e4a4 Time: 0.0303787 [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:02] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Float(1478656,23104,152,1), Float(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CudaDepthwiseConvolution) [07/07/2022-18:30:02] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (FusedConvActConvolution) [07/07/2022-18:30:02] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CudnnConvolution) [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0486476 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0435533 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0787115 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0486476 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0436747 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0785963 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0435533 [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0228096 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0230471 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0248762 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.0230827 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0230855 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0224306 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.026519 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0232875 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.0366165 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0251109 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.057952 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0232491 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0252518 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.0353483 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.063952 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.0251025 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0x7e29bdfccd92c42c Time: 0.0224306 [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Float(1478656,1,9728,64), Float(739328,1,9728,128) -> Float(739328,1,9728,128) *************** [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.0625209 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.0243962 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.0231886 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.0233998 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.0243573 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.0352363 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0228331 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.0240549 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x849891f3d1d80c55 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x849891f3d1d80c55 Time: 0.0236444 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.0235072 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x90d45931b538d74f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x90d45931b538d74f Time: 0.0343648 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.0241211 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.0332771 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0316984 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0xb90177ab6d659acd [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb90177ab6d659acd Time: 0.0240632 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.0323055 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xf92663d88255134b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xf92663d88255134b Time: 0.022597 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.0352427 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0xf92663d88255134b Time: 0.022597 [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf92663d88255134b [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Half(1478656,23104,152,1), Half(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_16 + Add_17 + Relu_18.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CudnnConvolution) [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0396824 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0613031 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0635307 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0389049 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0634258 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0x0000000000000038 Time: 0.0389049 [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_16 + Add_17 + Relu_18.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000038 [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Half(739328,23104:2,152,1), Half(369664,5776:2,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_16 + Add_17 + Relu_18.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (FusedConvActConvolution) [07/07/2022-18:30:02] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_16 + Add_17 + Relu_18.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0116583 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0116587 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0116292 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0124207 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0124622 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0116326 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0113707 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.0121314 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.0117948 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.012589 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0114087 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.0129481 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.0128993 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0117727 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.011243 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0113095 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0124749 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0114404 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0xdb5acaea7b0746d5 Time: 0.011243 [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8), Float(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_16 + Add_17 + Relu_18.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8), Half(92416,1:8,1216,16) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_16 + Add_17 + Relu_18.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CudaDepthwiseConvolution) [07/07/2022-18:30:02] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_16 + Add_17 + Relu_18.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_16 + Add_17 + Relu_18 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0104175 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0117628 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0102675 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.00989459 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.0100577 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0179318 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0106587 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.00970514 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0100264 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.01103 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0162408 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.0101673 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.00956465 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0109347 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0157416 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0113301 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0102371 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.0132968 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0104133 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.00978438 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0113568 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.00883116 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.0099382 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.00942578 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.0101699 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.0100929 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0111836 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.0109326 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0123204 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.0100242 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.0138189 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0111506 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.00946992 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0112185 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0110799 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.00995545 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0108724 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.00875132 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.00868677 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0117738 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0107933 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0107187 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.011007 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.00914047 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.010091 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0112846 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0114798 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.0181406 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0112949 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0117609 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.0102849 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0134613 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0105677 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0121425 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0118639 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0135983 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0118323 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.013798 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.00895186 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0115115 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.00939763 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.00979749 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0115031 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0167509 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0105447 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0114507 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0102177 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0112526 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0100634 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0113038 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0108439 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0110569 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.01042 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0122396 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.0115755 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0108872 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0115446 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0186773 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.00899593 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.00909377 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0103913 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.00991247 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0107297 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.010976 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.0103732 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0110957 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.00985851 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.010666 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.00929837 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0114194 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.00999874 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.0107463 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.0141516 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0117646 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.011366 [07/07/2022-18:30:02] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.010335 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0x6b44e6396887bed9 Time: 0.00868677 [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:02] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Float(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CudaDepthwiseConvolution) [07/07/2022-18:30:02] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (FusedConvActConvolution) [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.174944 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00000000000affff Time: 0.181477 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00000000000effff Time: 0.144818 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.159388 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.149319 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00000000001affff Time: 0.1665 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.159566 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.152772 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.14843 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.14843 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.153099 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.157536 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00000000006effff Time: 0.149461 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.146468 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.150116 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.145646 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.158923 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.159236 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.141842 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.151321 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.14443 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0x00000000009fffff Time: 0.141842 [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CudnnConvolution) [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.273776 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.203152 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.33232 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000005 Time: 1.964 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.107365 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.273525 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.2032 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000000003a Time: 0.3312 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000000003d Time: 1.93549 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x000000000000003e Time: 0.107429 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.107365 [07/07/2022-18:30:02] [TRT] [V] Setting workspace to 2198667264enables more tactics for profiling [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.168955 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.089272 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.176091 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.165988 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.168965 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.180907 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.184395 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.215888 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.188768 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.203435 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.202469 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.254624 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.193957 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.17672 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.200283 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.194165 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.373216 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.185189 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.089272 [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Float(739328,1,9728,128) -> Float(739328,1,9728,128) *************** [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CaskConvolution) [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.349525 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.169392 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.168352 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.202821 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.238437 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.185824 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.17408 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.169296 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.149074 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.186075 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.169019 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.175253 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.168672 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.186085 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.203013 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.172379 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.173232 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.185664 [07/07/2022-18:30:02] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:02] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.149973 [07/07/2022-18:30:02] [TRT] [V] Fastest Tactic: 0x516049bee7812ab0 Time: 0.149074 [07/07/2022-18:30:02] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:02] [TRT] [V] *************** Autotuning format combination: Half(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:30:02] [TRT] [W] Weights [name=Conv_19 + Relu_20.weight] had the following issues when converted to FP16: [07/07/2022-18:30:02] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:02] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:02] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CudnnConvolution) [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.271056 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.207627 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.293296 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000005 Time: 1.89685 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.134912 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.27344 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003a Time: 0.293829 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003d Time: 1.92765 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003e Time: 0.134553 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.134553 [07/07/2022-18:30:03] [TRT] [V] Setting workspace to 2198667264enables more tactics for profiling [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_19 + Relu_20.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Half(369664,5776:2,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_19 + Relu_20.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (FusedConvActConvolution) [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.089848 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00000000000affff Time: 0.089664 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00000000000effff Time: 0.0735061 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.0789568 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.0757888 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00000000001affff Time: 0.0907413 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.090168 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.0787947 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.0738944 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.0739691 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.0777856 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.0809259 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00000000006effff Time: 0.0783424 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.0771008 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.0768192 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.0741653 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.09128 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.0802475 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.0723115 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.0789205 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.0743232 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0x00000000009fffff Time: 0.0723115 [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_19 + Relu_20.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.0932933 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0924453 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.092896 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0902693 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.0934827 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.097104 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0962907 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.089888 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0861733 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.099824 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0929333 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.086088 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.088336 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.086968 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.0468307 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.0987307 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.093 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0871813 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.088568 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.0468307 [07/07/2022-18:30:03] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_19 + Relu_20.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_19 + Relu_20.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CudaDepthwiseConvolution) [07/07/2022-18:30:03] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_19 + Relu_20.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_19 + Relu_20 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.087504 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0513829 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0689173 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0490834 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0510278 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0499551 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.0897333 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0404053 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.0484693 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0344715 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0899013 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0332499 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0510979 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.0858933 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0476739 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0606844 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0581333 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0366475 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0372847 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0487208 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0372207 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0328116 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.0881893 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0514834 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0530118 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0331384 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.048899 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0342891 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.0529036 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0313367 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0649049 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0479436 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0850107 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0482743 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.0878267 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0486629 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.047052 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0384581 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0519223 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0510187 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.054787 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0502232 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.039507 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0384273 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.048608 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.038221 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0508556 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.061072 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0522042 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0512274 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0397084 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0380148 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0494842 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.0380859 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0519086 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0499169 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0493638 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.0855467 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0613653 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0543482 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0524709 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0646489 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0582702 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0577244 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.033089 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0347861 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.0487512 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.031937 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0348939 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0531276 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0372184 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0371615 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.0495802 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0533973 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0846187 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0521813 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.064656 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0901467 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0504838 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0378987 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0377683 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0496823 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0303156 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0652729 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.052349 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0601138 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0495299 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0537158 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0528533 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.0859867 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0546758 [07/07/2022-18:30:03] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0312184 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0xd47a5fce3824e4a4 Time: 0.0303156 [07/07/2022-18:30:03] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:03] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Float(739328,5776,76,1), Float(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CudaDepthwiseConvolution) [07/07/2022-18:30:03] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (FusedConvActConvolution) [07/07/2022-18:30:03] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CudnnConvolution) [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.286464 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.214651 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.344981 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000005 Time: 2.0066 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.119623 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.288976 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.214629 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003a Time: 0.343253 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003d Time: 1.98772 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003e Time: 0.119584 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.119584 [07/07/2022-18:30:03] [TRT] [V] Setting workspace to 2198667264enables more tactics for profiling [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.171776 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.093312 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.177936 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.169328 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.172704 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.183013 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.185749 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.216805 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.190715 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.206144 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.205707 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.259984 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.196795 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.178677 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.206805 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.196539 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.373589 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.186469 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.093312 [07/07/2022-18:30:03] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Float(739328,1,9728,128), Float(739328,1,9728,128) -> Float(739328,1,9728,128) *************** [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.356352 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.174581 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.173968 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.204832 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.244021 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.188048 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.178869 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.174731 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.159996 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.188021 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.173835 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.180203 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.173563 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.188357 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.204923 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.177493 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.177979 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.187429 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.160274 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0x516049bee7812ab0 Time: 0.159996 [07/07/2022-18:30:03] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Half(739328,5776,76,1), Half(739328,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_21 + Add_22 + Relu_23.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CudnnConvolution) [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.277467 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.21248 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.305787 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000005 Time: 1.97758 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.141813 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.278603 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003a Time: 0.306459 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2198667264, available: 268435456 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003d Time: 1.98566 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003e Time: 0.141941 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.141813 [07/07/2022-18:30:03] [TRT] [V] Setting workspace to 2198667264enables more tactics for profiling [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_21 + Add_22 + Relu_23.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000006 [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Half(369664,5776:2,76,1), Half(369664,5776:2,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_21 + Add_22 + Relu_23.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (FusedConvActConvolution) [07/07/2022-18:30:03] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_21 + Add_22 + Relu_23.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.093608 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0928293 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0935973 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0906027 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.0939653 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0974347 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.096656 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.09028 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0865067 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.0991973 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0934987 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.086576 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.0890347 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0874 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.0471333 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.0996427 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.09404 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0876373 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.088848 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.0471333 [07/07/2022-18:30:03] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16), Float(739328,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_21 + Add_22 + Relu_23.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16), Half(92416,1:8,1216,16) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_21 + Add_22 + Relu_23.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CudaDepthwiseConvolution) [07/07/2022-18:30:03] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [W] Weights [name=Conv_21 + Add_22 + Relu_23.weight] had the following issues when converted to FP16: [07/07/2022-18:30:03] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:03] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_21 + Add_22 + Relu_23 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.0879413 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0517044 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0695189 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0496229 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0515459 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0509242 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.0918853 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0410939 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.0489067 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0350208 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0922347 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0338293 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.051773 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.0872667 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0482789 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0613102 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0598524 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0377339 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0379141 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0500922 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.037581 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.033424 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.0889573 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0525486 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0533912 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0341877 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0497326 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0348832 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.053603 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0322977 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0657191 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0484632 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0862587 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0488381 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.0885573 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0492084 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0477074 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0388196 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0523977 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0521509 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0551314 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0512457 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0400047 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0389594 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0489859 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0384996 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0518187 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.061664 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0532236 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0517135 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0399917 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.039168 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0501013 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.0392012 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0524693 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0516175 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0505158 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.087016 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0621369 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0548495 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0531261 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0652 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0599876 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.059472 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.033952 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0353056 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.049155 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0327845 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0356139 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0536853 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.037683 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0380836 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.0508754 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0539642 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0860027 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0526842 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0651182 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0923253 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.051197 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0384616 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0384273 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0505722 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0311913 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0659307 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0527086 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0607822 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0506408 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0540968 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0533135 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.0875573 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0553112 [07/07/2022-18:30:03] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0322667 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0xd47a5fce3824e4a4 Time: 0.0311913 [07/07/2022-18:30:03] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:03] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:03] [TRT] [V] *************** Autotuning format combination: Float(739328,5776,76,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CudaDepthwiseConvolution) [07/07/2022-18:30:03] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (FusedConvActConvolution) [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000006ffff Time: 0.115851 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0x000000000006ffff Time: 0.115851 [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CudnnConvolution) [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.171611 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.11096 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.206725 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000005 Time: 3.24735 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.171861 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.110947 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003a Time: 0.207013 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x000000000000003d Time: 3.26042 [07/07/2022-18:30:03] [TRT] [V] Fastest Tactic: 0x0000000000000039 Time: 0.110947 [07/07/2022-18:30:03] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CaskConvolution) [07/07/2022-18:30:03] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.166585 [07/07/2022-18:30:03] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:03] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.108293 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.163861 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.168619 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.102347 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.117447 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.153145 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.111783 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.119154 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.122695 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.263909 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.118357 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.121952 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.1908 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.118741 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.359157 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.118137 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x5e7d1125e7896624 Time: 0.102347 [07/07/2022-18:30:04] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:04] [TRT] [V] *************** Autotuning format combination: Float(739328,1,9728,128) -> Float(369664,1,9728,256) *************** [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CaskConvolution) [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.348523 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.164548 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.164373 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.113316 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.238213 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.110123 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.089904 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.163776 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.099024 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.112743 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.164981 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.0907493 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.164082 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.111815 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.112629 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.166489 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.0902907 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.113109 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.0993573 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x48f8d75aa348d22f Time: 0.089904 [07/07/2022-18:30:04] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:04] [TRT] [V] *************** Autotuning format combination: Half(739328,5776,76,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:30:04] [TRT] [W] Weights [name=Conv_24 + Relu_25.weight] had the following issues when converted to FP16: [07/07/2022-18:30:04] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:04] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:04] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CudnnConvolution) [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.185728 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.198683 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.195056 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000005 Time: 3.21275 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.186171 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000000003a Time: 0.194843 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000000003d Time: 3.26114 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.185728 [07/07/2022-18:30:04] [TRT] [W] Weights [name=Conv_24 + Relu_25.weight] had the following issues when converted to FP16: [07/07/2022-18:30:04] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:04] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:04] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CaskConvolution) [07/07/2022-18:30:04] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:04] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000000 [07/07/2022-18:30:04] [TRT] [V] *************** Autotuning format combination: Half(369664,5776:2,76,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:30:04] [TRT] [W] Weights [name=Conv_24 + Relu_25.weight] had the following issues when converted to FP16: [07/07/2022-18:30:04] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:04] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:04] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (FusedConvActConvolution) [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000006ffff Time: 0.0617884 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x000000000006ffff Time: 0.0617884 [07/07/2022-18:30:04] [TRT] [W] Weights [name=Conv_24 + Relu_25.weight] had the following issues when converted to FP16: [07/07/2022-18:30:04] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:04] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:04] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CaskConvolution) [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.05968 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0584693 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.058528 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.054275 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.0599964 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0682496 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0911173 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.053571 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0854533 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.0729451 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0896507 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.085384 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.0879413 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0861867 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.09268 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0621298 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0861467 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.0878587 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x7498280d2c59e4aa Time: 0.053571 [07/07/2022-18:30:04] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:04] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:04] [TRT] [W] Weights [name=Conv_24 + Relu_25.weight] had the following issues when converted to FP16: [07/07/2022-18:30:04] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:04] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:04] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CaskConvolution) [07/07/2022-18:30:04] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:04] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:30:04] [TRT] [W] Weights [name=Conv_24 + Relu_25.weight] had the following issues when converted to FP16: [07/07/2022-18:30:04] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:04] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:04] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CudaDepthwiseConvolution) [07/07/2022-18:30:04] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:04] [TRT] [W] Weights [name=Conv_24 + Relu_25.weight] had the following issues when converted to FP16: [07/07/2022-18:30:04] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:04] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:04] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_24 + Relu_25 (CaskConvolution) [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.085696 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0312747 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0389641 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0468587 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0496091 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.048349 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.045948 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0349888 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.047484 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0304368 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0459773 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0297956 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0296444 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.0860133 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0325004 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0383253 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0328204 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0316509 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0260521 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0483124 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0318206 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0288107 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.0861093 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0484328 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0323937 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0298178 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.046628 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0321978 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.0481112 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0292231 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.037088 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.046028 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.084808 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0270769 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.0860187 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0272066 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0322861 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0236402 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.047472 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.047907 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0335808 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0462627 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0277366 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0266552 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0481737 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0234503 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0481051 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0329154 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0487924 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0284542 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0244411 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0330851 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0475 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.033216 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.031681 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0486796 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0480274 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.0855333 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0335179 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.03072 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0349184 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0346859 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0341813 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0331365 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.029936 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0325653 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.0462733 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0288178 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0325198 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0324441 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0254621 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0340107 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.0490011 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0323889 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0844747 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0320659 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0410311 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0465133 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0286809 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0267766 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.025847 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0456573 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0273739 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0373203 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0316499 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.038323 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0486659 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0484373 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0317944 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.0860747 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.048131 [07/07/2022-18:30:04] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0289973 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0234503 [07/07/2022-18:30:04] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:04] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:04] [TRT] [V] *************** Autotuning format combination: Float(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_26 (CudaDepthwiseConvolution) [07/07/2022-18:30:04] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_26 (FusedConvActConvolution) [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.196683 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00000000000affff Time: 0.187344 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00000000000effff Time: 0.161518 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.186699 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.147996 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00000000001affff Time: 0.156334 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.177381 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.1472 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.162972 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.163975 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.177605 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.220208 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00000000006effff Time: 0.152508 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.154443 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.172037 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.175136 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.164853 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.206736 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.152839 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.1464 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.143328 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x0000000000a4ffff Time: 0.143328 [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_26 (CudnnConvolution) [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.322939 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.377515 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.346229 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.126254 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.322107 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.384395 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000000003a Time: 0.344149 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x000000000000003e Time: 0.126091 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.126091 [07/07/2022-18:30:04] [TRT] [V] Setting workspace to 289669120enables more tactics for profiling [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_26 (CaskConvolution) [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.33792 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.108957 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.20992 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.326352 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.338741 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.19408 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.219819 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.3 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.223088 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.2148 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.218229 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.496309 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.216299 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.231189 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.37888 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.221163 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.712629 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.221355 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.108957 [07/07/2022-18:30:04] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:04] [TRT] [V] *************** Autotuning format combination: Float(369664,1,9728,256) -> Float(369664,1,9728,256) *************** [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_26 (CaskConvolution) [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.661109 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.327467 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.332459 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.220464 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.466912 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.208859 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.175963 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.325301 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.187733 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.213349 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.329248 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.178128 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.329115 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.209291 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.21936 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.335872 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.176347 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.213904 [07/07/2022-18:30:04] [TRT] [V] Conv_26 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.188763 [07/07/2022-18:30:04] [TRT] [V] Fastest Tactic: 0x48f8d75aa348d22f Time: 0.175963 [07/07/2022-18:30:04] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:04] [TRT] [V] *************** Autotuning format combination: Half(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:30:04] [TRT] [W] Weights [name=Conv_26.weight] had the following issues when converted to FP16: [07/07/2022-18:30:04] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:04] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:04] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:04] [TRT] [V] --------------- Timing Runner: Conv_26 (CudnnConvolution) [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.362251 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.380555 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.331221 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:04] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.152423 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.362357 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000000003a Time: 0.327637 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000000003e Time: 0.152228 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.152228 [07/07/2022-18:30:05] [TRT] [V] Setting workspace to 289669120enables more tactics for profiling [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_26.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_26 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Half(184832,1444:2,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_26.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_26 (FusedConvActConvolution) [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.101435 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00000000000affff Time: 0.0947813 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00000000000effff Time: 0.083784 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.094016 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.0762411 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00000000001affff Time: 0.0824853 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.095168 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.0763733 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.0839307 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.0841093 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.089976 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.116903 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00000000006effff Time: 0.079616 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.0795243 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.0885147 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.0906933 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.0901387 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.105912 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.0785024 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.0764608 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.0741141 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0x0000000000a4ffff Time: 0.0741141 [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_26.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_26 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.118937 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.116032 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.114876 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.101763 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.117134 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.185323 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.13013 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.100013 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.164935 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.139769 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.113618 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.164647 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.170843 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.167952 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.0552122 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.136757 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.110512 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.168005 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.170992 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.0552122 [07/07/2022-18:30:05] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_26.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_26 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_26.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_26 (CudaDepthwiseConvolution) [07/07/2022-18:30:05] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_26.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_26 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.163396 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0570578 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0737131 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.085976 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0908027 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0915573 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.0851253 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0619111 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.0864213 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0524084 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.085304 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0509501 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0533211 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.163808 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0558738 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0703787 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0573369 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0559396 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0444187 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0883387 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0564658 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0503939 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.164174 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0916293 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0604907 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0517486 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0858453 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0530392 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.089248 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.052323 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0702485 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0850827 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.1632 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0452467 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.16362 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0457693 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0558578 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0404539 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0877547 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0892773 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0601813 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0865173 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0460147 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0471227 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0871147 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0401837 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.088176 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0588836 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0928667 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.049091 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0421853 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0597102 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0866533 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.059008 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0575218 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0915653 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0900747 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.163332 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0592711 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0567236 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0601867 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0625422 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.05888 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0568196 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0515596 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.053408 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.085312 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0503543 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0539794 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0593724 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.044 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0604889 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.089512 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0585742 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.16256 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0580587 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0750123 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0853227 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0520914 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.044956 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0445133 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.08504 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0488305 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0704085 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0580516 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0699584 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0891733 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.090384 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0580373 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.164124 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.089136 [07/07/2022-18:30:05] [TRT] [V] Conv_26 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0519756 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0401837 [07/07/2022-18:30:05] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:05] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Float(739328,5776,76,1), Float(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CudaDepthwiseConvolution) [07/07/2022-18:30:05] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (FusedConvActConvolution) [07/07/2022-18:30:05] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CudnnConvolution) [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0390756 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0385363 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0887627 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0390471 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0386157 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000000003a Time: 0.08876 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0385363 [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0264402 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0269095 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0267143 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.0267036 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0193102 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0190519 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.0241844 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0196838 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.0291849 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0205697 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.0533303 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0210493 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0295769 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.0262178 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.0635076 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.0205522 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0x7e29bdfccd92c42c Time: 0.0190519 [07/07/2022-18:30:05] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Float(739328,1,9728,128), Float(369664,1,9728,256) -> Float(369664,1,9728,256) *************** [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.05608 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.024992 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.0192687 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.0168176 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.0249455 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.022182 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.018899 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.0247497 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x849891f3d1d80c55 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x849891f3d1d80c55 Time: 0.0247931 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.01692 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x90d45931b538d74f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x90d45931b538d74f Time: 0.0218473 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.0248716 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.0216647 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0207856 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0xb90177ab6d659acd [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb90177ab6d659acd Time: 0.0247375 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.0211373 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xf92663d88255134b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xf92663d88255134b Time: 0.01645 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.0224036 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0xf92663d88255134b Time: 0.01645 [07/07/2022-18:30:05] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf92663d88255134b [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Half(739328,5776,76,1), Half(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_27 + Add_28 + Relu_29.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CudnnConvolution) [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0504213 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0638364 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0669269 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0485928 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0665867 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0x0000000000000038 Time: 0.0485928 [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_27 + Add_28 + Relu_29.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000038 [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Half(369664,5776:2,76,1), Half(184832,1444:2,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_27 + Add_28 + Relu_29.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (FusedConvActConvolution) [07/07/2022-18:30:05] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_27 + Add_28 + Relu_29.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0122312 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0122244 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0119055 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0133338 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0132734 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0119154 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0153411 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.0157193 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.0117341 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0129621 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0152548 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.015745 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.0117536 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0153731 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0151174 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.015168 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.012832 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0152781 [07/07/2022-18:30:05] [TRT] [V] Fastest Tactic: 0x9ce6ebc390e62b01 Time: 0.0117341 [07/07/2022-18:30:05] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16), Float(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_27 + Add_28 + Relu_29.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16), Half(46208,1:8,1216,32) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_27 + Add_28 + Relu_29.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CudaDepthwiseConvolution) [07/07/2022-18:30:05] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:05] [TRT] [W] Weights [name=Conv_27 + Add_28 + Relu_29.weight] had the following issues when converted to FP16: [07/07/2022-18:30:05] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:05] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:05] [TRT] [V] --------------- Timing Runner: Conv_27 + Add_28 + Relu_29 (CaskConvolution) [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.00944 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0134327 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0115844 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0108834 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.010145 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0118418 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0112089 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.00891004 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0102723 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0108717 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0108707 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.0112853 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0102461 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0129149 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0109474 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0125061 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0100963 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.0178335 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0111172 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.00910847 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0129272 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.00866899 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.00993537 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.00875186 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.0095808 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.011338 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0125096 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.0106693 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.016451 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.00930904 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.0182136 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.00938459 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.00848907 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0127937 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.012283 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0093837 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0116064 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0086999 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.00849147 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0136333 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.012235 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0112679 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.00896225 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.00816286 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0107764 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0129358 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0131865 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.012013 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0131159 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0138938 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.00933008 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0179217 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.00954362 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0162596 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0141449 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0178302 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0138786 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.0180536 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.00878035 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.01022 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.00866051 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.00998557 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0099062 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0115108 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0108542 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.011787 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.01043 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0115583 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.00910213 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0116326 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:05] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0111563 [07/07/2022-18:30:05] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0111957 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.00983153 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0164333 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.0113785 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.010663 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0138261 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0123872 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.00912346 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.00890947 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0113668 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.00991059 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.00991718 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.00909146 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.00976396 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0130942 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.00993129 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.0122137 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.00827577 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0138933 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.00951911 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.0127131 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.0182832 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0142738 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.00994792 [07/07/2022-18:30:06] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0103121 [07/07/2022-18:30:06] [TRT] [V] Fastest Tactic: 0x784dcede905d06c0 Time: 0.00816286 [07/07/2022-18:30:06] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:06] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:06] [TRT] [V] *************** Autotuning format combination: Float(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CudaDepthwiseConvolution) [07/07/2022-18:30:06] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (FusedConvActConvolution) [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.197029 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000000affff Time: 0.188421 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000000effff Time: 0.161308 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.186299 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.1481 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000001affff Time: 0.156085 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.176848 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.146866 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.162944 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.163822 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.178091 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.220661 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000006effff Time: 0.152789 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.154599 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.171989 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.1748 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.164953 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.206907 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.153127 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.146027 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.143353 [07/07/2022-18:30:06] [TRT] [V] Fastest Tactic: 0x0000000000a4ffff Time: 0.143353 [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CudnnConvolution) [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.325669 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.387072 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.344331 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.129234 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.328523 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.387019 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000000003a Time: 0.346421 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000000003e Time: 0.129529 [07/07/2022-18:30:06] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.129234 [07/07/2022-18:30:06] [TRT] [V] Setting workspace to 289669120enables more tactics for profiling [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CaskConvolution) [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.334165 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.108789 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.210235 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.324235 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.338453 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.194133 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.220021 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.304981 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.222773 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.213125 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.218496 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.496437 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.215909 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.231157 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.380693 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.221168 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.712363 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.220997 [07/07/2022-18:30:06] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.108789 [07/07/2022-18:30:06] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:06] [TRT] [V] *************** Autotuning format combination: Float(369664,1,9728,256) -> Float(369664,1,9728,256) *************** [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CaskConvolution) [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.661269 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.331083 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.330891 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.220192 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.46768 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.208869 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.175099 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.324965 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.18776 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.213195 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.324987 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.178453 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.324736 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.209168 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.219248 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.331456 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.175696 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.213797 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.188427 [07/07/2022-18:30:06] [TRT] [V] Fastest Tactic: 0x48f8d75aa348d22f Time: 0.175099 [07/07/2022-18:30:06] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:06] [TRT] [V] *************** Autotuning format combination: Half(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:30:06] [TRT] [W] Weights [name=Conv_30 + Relu_31.weight] had the following issues when converted to FP16: [07/07/2022-18:30:06] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:06] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:06] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CudnnConvolution) [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.363925 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.387072 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.333824 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.155438 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.364384 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000000003a Time: 0.332853 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000000003e Time: 0.155218 [07/07/2022-18:30:06] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.155218 [07/07/2022-18:30:06] [TRT] [V] Setting workspace to 289669120enables more tactics for profiling [07/07/2022-18:30:06] [TRT] [W] Weights [name=Conv_30 + Relu_31.weight] had the following issues when converted to FP16: [07/07/2022-18:30:06] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:06] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:06] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CaskConvolution) [07/07/2022-18:30:06] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:06] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e [07/07/2022-18:30:06] [TRT] [V] *************** Autotuning format combination: Half(184832,1444:2,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:30:06] [TRT] [W] Weights [name=Conv_30 + Relu_31.weight] had the following issues when converted to FP16: [07/07/2022-18:30:06] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:06] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:06] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (FusedConvActConvolution) [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.101291 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000000affff Time: 0.0949867 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000000effff Time: 0.0836613 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.094416 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.0761237 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000001affff Time: 0.0824363 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.0955413 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.0763008 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.0837627 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.0837493 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.090144 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.117316 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000006effff Time: 0.0798037 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.07936 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.0885573 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.0907867 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.0903413 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.105659 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.0785685 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.0764565 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.0739989 [07/07/2022-18:30:06] [TRT] [V] Fastest Tactic: 0x0000000000a4ffff Time: 0.0739989 [07/07/2022-18:30:06] [TRT] [W] Weights [name=Conv_30 + Relu_31.weight] had the following issues when converted to FP16: [07/07/2022-18:30:06] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:06] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:06] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CaskConvolution) [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.118805 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.115918 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.115058 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.101912 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.117092 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.129479 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.130667 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.100037 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.164772 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.139253 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.113714 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.164533 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.171232 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.167936 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.0551985 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.136036 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.110128 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.167941 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.171195 [07/07/2022-18:30:06] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.0551985 [07/07/2022-18:30:06] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:06] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:06] [TRT] [W] Weights [name=Conv_30 + Relu_31.weight] had the following issues when converted to FP16: [07/07/2022-18:30:06] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:06] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:06] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CaskConvolution) [07/07/2022-18:30:06] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:06] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:30:06] [TRT] [W] Weights [name=Conv_30 + Relu_31.weight] had the following issues when converted to FP16: [07/07/2022-18:30:06] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:06] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:06] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CudaDepthwiseConvolution) [07/07/2022-18:30:06] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:06] [TRT] [W] Weights [name=Conv_30 + Relu_31.weight] had the following issues when converted to FP16: [07/07/2022-18:30:06] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:06] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:06] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:06] [TRT] [V] --------------- Timing Runner: Conv_30 + Relu_31 (CaskConvolution) [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.163396 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0569227 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0738731 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0858987 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0908933 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0915493 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.0851093 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0617724 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.086312 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0525211 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.08508 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0509851 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.053411 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.163684 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0558702 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0700885 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.057216 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0558329 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.044572 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.088248 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0563627 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0503741 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.164484 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0915973 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0607076 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0517821 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.08576 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0529676 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.089192 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0523566 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0702187 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0852853 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.163225 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.045232 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.163591 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.045836 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0559467 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0404859 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.087632 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0894027 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0600036 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0866613 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0459213 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.047204 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0869707 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0401529 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0884453 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0588338 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.092792 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0489966 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.042188 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0597689 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.086512 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.05888 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0575413 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0913467 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.0900987 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.1633 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0594702 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0567342 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0601476 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0625049 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0586791 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0568302 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0518491 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0536122 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.0853493 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0504076 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.054083 [07/07/2022-18:30:06] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:06] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0592658 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0440493 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0605813 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.0895947 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0585244 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.162652 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0581049 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0748949 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0854027 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0519406 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.044912 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0444973 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.085136 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0487314 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0705899 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0580373 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0699691 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.089384 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.090432 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0580782 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.164128 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0890907 [07/07/2022-18:30:07] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0518629 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0401529 [07/07/2022-18:30:07] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:07] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:07] [TRT] [V] *************** Autotuning format combination: Float(369664,1444,38,1), Float(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CudaDepthwiseConvolution) [07/07/2022-18:30:07] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (FusedConvActConvolution) [07/07/2022-18:30:07] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CudnnConvolution) [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.349525 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.399744 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.349728 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.134667 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.344395 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.399371 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003a Time: 0.350037 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003e Time: 0.134418 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.134418 [07/07/2022-18:30:07] [TRT] [V] Setting workspace to 289669120enables more tactics for profiling [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CaskConvolution) [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.337525 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.109432 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.214928 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.329387 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.338699 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.199739 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.22016 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.306501 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.224763 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.225232 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.228869 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.495616 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.229376 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.238859 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.384341 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.232357 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.713973 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.221168 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.109432 [07/07/2022-18:30:07] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:07] [TRT] [V] *************** Autotuning format combination: Float(369664,1,9728,256), Float(369664,1,9728,256) -> Float(369664,1,9728,256) *************** [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CaskConvolution) [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.668544 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.336459 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.328011 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.222459 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.457141 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.211632 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.179584 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.335168 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.19368 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.217317 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.335317 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.181957 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.333163 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.21168 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.221307 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.334368 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.179787 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.218101 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.194805 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0x48f8d75aa348d22f Time: 0.179584 [07/07/2022-18:30:07] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:07] [TRT] [V] *************** Autotuning format combination: Half(369664,1444,38,1), Half(369664,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:30:07] [TRT] [W] Weights [name=Conv_32 + Add_33 + Relu_34.weight] had the following issues when converted to FP16: [07/07/2022-18:30:07] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:07] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:07] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CudnnConvolution) [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.361984 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.389397 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.339776 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.159964 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.366592 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003a Time: 0.337237 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2225602560, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 289669120, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003e Time: 0.160107 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.159964 [07/07/2022-18:30:07] [TRT] [V] Setting workspace to 289669120enables more tactics for profiling [07/07/2022-18:30:07] [TRT] [W] Weights [name=Conv_32 + Add_33 + Relu_34.weight] had the following issues when converted to FP16: [07/07/2022-18:30:07] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:07] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:07] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CaskConvolution) [07/07/2022-18:30:07] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:07] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000006 [07/07/2022-18:30:07] [TRT] [V] *************** Autotuning format combination: Half(184832,1444:2,38,1), Half(184832,1444:2,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:30:07] [TRT] [W] Weights [name=Conv_32 + Add_33 + Relu_34.weight] had the following issues when converted to FP16: [07/07/2022-18:30:07] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:07] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:07] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (FusedConvActConvolution) [07/07/2022-18:30:07] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:07] [TRT] [W] Weights [name=Conv_32 + Add_33 + Relu_34.weight] had the following issues when converted to FP16: [07/07/2022-18:30:07] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:07] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:07] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CaskConvolution) [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.11942 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.116487 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.115303 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.102219 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.117461 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.185269 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.177723 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.100349 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.165344 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.185781 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.114002 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.164775 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.171355 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.168619 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.0554651 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.137728 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.110845 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.168331 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.171664 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.0554651 [07/07/2022-18:30:07] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:07] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32), Float(369664,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:07] [TRT] [W] Weights [name=Conv_32 + Add_33 + Relu_34.weight] had the following issues when converted to FP16: [07/07/2022-18:30:07] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:07] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:07] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CaskConvolution) [07/07/2022-18:30:07] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:07] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32), Half(46208,1:8,1216,32) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:30:07] [TRT] [W] Weights [name=Conv_32 + Add_33 + Relu_34.weight] had the following issues when converted to FP16: [07/07/2022-18:30:07] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:07] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:07] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CudaDepthwiseConvolution) [07/07/2022-18:30:07] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:07] [TRT] [W] Weights [name=Conv_32 + Add_33 + Relu_34.weight] had the following issues when converted to FP16: [07/07/2022-18:30:07] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:07] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:07] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_32 + Add_33 + Relu_34 (CaskConvolution) [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.164679 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0573316 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0739819 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0870453 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0917947 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0928693 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.085984 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.062192 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.0872853 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.053693 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0863067 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0522514 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0538362 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.165003 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0563093 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0707371 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0580427 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0566738 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0447733 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0894187 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0566916 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0516312 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.16539 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0923867 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0607804 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0525745 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0868507 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0535695 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.0904187 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0531688 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0706027 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0864027 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.164256 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0456813 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.165262 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0460653 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0560142 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0409707 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.088208 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.089976 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0604391 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0873867 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0461587 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0474333 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0875413 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0405132 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.089176 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0591947 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0937493 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0493806 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0424973 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0606169 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.087416 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.059584 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0578898 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0927413 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.091448 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.164565 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0597049 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0569244 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0605084 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0629938 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0594542 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.05776 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0525425 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0542202 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.086696 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0509394 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0546408 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0595449 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0444667 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0612356 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.0908 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0589049 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.163836 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0584871 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0752363 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0862747 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0522286 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0452173 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0446973 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.086056 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0496213 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0706709 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0583876 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0702955 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0903573 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0914453 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0585707 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.165422 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.090632 [07/07/2022-18:30:07] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0526979 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0405132 [07/07/2022-18:30:07] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:07] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:07] [TRT] [V] *************** Autotuning format combination: Float(369664,1444,38,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CudaDepthwiseConvolution) [07/07/2022-18:30:07] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (FusedConvActConvolution) [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000006ffff Time: 0.193835 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0x000000000006ffff Time: 0.193835 [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CudnnConvolution) [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.356576 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.13189 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.258971 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 577110016, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.354827 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.132007 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003a Time: 0.259093 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 577110016, available: 268435456 [07/07/2022-18:30:07] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.13189 [07/07/2022-18:30:07] [TRT] [V] Setting workspace to 577110016enables more tactics for profiling [07/07/2022-18:30:07] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CaskConvolution) [07/07/2022-18:30:07] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.326416 [07/07/2022-18:30:07] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.213829 [07/07/2022-18:30:07] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.320955 [07/07/2022-18:30:07] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:07] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.329253 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.198235 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.150151 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.225947 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.218395 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.219467 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.223483 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.490805 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.207072 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.261067 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.296885 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.212037 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.741237 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.150535 [07/07/2022-18:30:08] [TRT] [V] Fastest Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.150151 [07/07/2022-18:30:08] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 [07/07/2022-18:30:08] [TRT] [V] *************** Autotuning format combination: Float(369664,1,9728,256) -> Float(184832,1,9728,512) *************** [07/07/2022-18:30:08] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CaskConvolution) [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.675733 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.336043 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.330949 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.140331 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.459989 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.180587 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.172261 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.331136 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.095568 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.184176 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.328715 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.173707 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.326091 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.18224 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.140075 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.334768 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.172427 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.185771 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.0957947 [07/07/2022-18:30:08] [TRT] [V] Fastest Tactic: 0x516049bee7812ab0 Time: 0.095568 [07/07/2022-18:30:08] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:08] [TRT] [V] *************** Autotuning format combination: Half(369664,1444,38,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:30:08] [TRT] [W] Weights [name=Conv_35 + Relu_36.weight] had the following issues when converted to FP16: [07/07/2022-18:30:08] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:08] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:08] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:08] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CudnnConvolution) [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.355339 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.250117 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.252901 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 577110016, available: 268435456 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.355189 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x000000000000003a Time: 0.249744 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 577110016, available: 268435456 [07/07/2022-18:30:08] [TRT] [V] Fastest Tactic: 0x000000000000003a Time: 0.249744 [07/07/2022-18:30:08] [TRT] [V] Setting workspace to 577110016enables more tactics for profiling [07/07/2022-18:30:08] [TRT] [W] Weights [name=Conv_35 + Relu_36.weight] had the following issues when converted to FP16: [07/07/2022-18:30:08] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:08] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:08] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:08] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CaskConvolution) [07/07/2022-18:30:08] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:08] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003a [07/07/2022-18:30:08] [TRT] [V] *************** Autotuning format combination: Half(184832,1444:2,38,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:30:08] [TRT] [W] Weights [name=Conv_35 + Relu_36.weight] had the following issues when converted to FP16: [07/07/2022-18:30:08] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:08] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:08] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:08] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (FusedConvActConvolution) [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x000000000006ffff Time: 0.0832 [07/07/2022-18:30:08] [TRT] [V] Fastest Tactic: 0x000000000006ffff Time: 0.0832 [07/07/2022-18:30:08] [TRT] [W] Weights [name=Conv_35 + Relu_36.weight] had the following issues when converted to FP16: [07/07/2022-18:30:08] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:08] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:08] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:08] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CaskConvolution) [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.112523 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.111132 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.110136 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.100107 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.113621 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.12458 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.124071 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0983973 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.164423 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.136473 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.110288 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.164043 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.169984 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.166336 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.130716 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.108525 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.166123 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.170501 [07/07/2022-18:30:08] [TRT] [V] Fastest Tactic: 0x7498280d2c59e4aa Time: 0.0983973 [07/07/2022-18:30:08] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x000000000006ffff [07/07/2022-18:30:08] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:08] [TRT] [W] Weights [name=Conv_35 + Relu_36.weight] had the following issues when converted to FP16: [07/07/2022-18:30:08] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:08] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:08] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:08] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CaskConvolution) [07/07/2022-18:30:08] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:08] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:30:08] [TRT] [W] Weights [name=Conv_35 + Relu_36.weight] had the following issues when converted to FP16: [07/07/2022-18:30:08] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:08] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:08] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:08] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CudaDepthwiseConvolution) [07/07/2022-18:30:08] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:08] [TRT] [W] Weights [name=Conv_35 + Relu_36.weight] had the following issues when converted to FP16: [07/07/2022-18:30:08] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:08] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:08] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:08] [TRT] [V] --------------- Timing Runner: Conv_35 + Relu_36 (CaskConvolution) [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.163413 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0342347 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.046752 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.0862933 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0909493 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.0884213 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.0846293 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0614453 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.0866747 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0533105 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0848133 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.051971 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0366965 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.16395 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0493394 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0558667 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0534979 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.055936 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0375775 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0876213 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.0554011 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0502568 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.164164 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.091296 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0470093 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0513128 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0859867 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0528244 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.0881733 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0519909 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0435933 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.085152 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.16299 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0283724 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.163556 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.028744 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0487558 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0270457 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0864907 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0889067 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.048192 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.086024 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0393956 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0389796 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0871813 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0267766 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0875307 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0349291 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0921627 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0302862 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0285333 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0594027 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0866853 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.0587058 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0346187 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.088832 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.088064 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.163111 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0354251 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0399348 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0518751 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0372397 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0554011 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0529737 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0515444 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0533699 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.0855787 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0498926 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0537661 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0357003 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0380113 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0589191 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.088672 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0470893 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.162375 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0460413 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.0576587 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.08516 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0356704 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:08] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0387473 [07/07/2022-18:30:08] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0380764 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.084936 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0484983 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0438533 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0468933 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0551482 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0888693 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0887493 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0472173 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.1639 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0880747 [07/07/2022-18:30:09] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0515916 [07/07/2022-18:30:09] [TRT] [V] Fastest Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0267766 [07/07/2022-18:30:09] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:09] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:09] [TRT] [V] *************** Autotuning format combination: Float(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:09] [TRT] [V] --------------- Timing Runner: Conv_37 (CudaDepthwiseConvolution) [07/07/2022-18:30:09] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:09] [TRT] [V] --------------- Timing Runner: Conv_37 (FusedConvActConvolution) [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.319333 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x00000000000affff Time: 0.361867 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x00000000000effff Time: 0.178331 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.286549 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.193291 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x00000000001affff Time: 0.197973 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.204747 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.179003 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.251904 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.253557 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.185669 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.317552 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x00000000006effff Time: 0.188208 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.187387 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.212016 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.224128 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.236267 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.244469 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.171008 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.177957 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.19704 [07/07/2022-18:30:09] [TRT] [V] Fastest Tactic: 0x00000000009fffff Time: 0.171008 [07/07/2022-18:30:09] [TRT] [V] --------------- Timing Runner: Conv_37 (CudnnConvolution) [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.699712 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.234352 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.448459 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.267147 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.699637 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.234368 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000000003a Time: 0.450891 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x000000000000003e Time: 0.268704 [07/07/2022-18:30:09] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.234352 [07/07/2022-18:30:09] [TRT] [V] Setting workspace to 1145307136enables more tactics for profiling [07/07/2022-18:30:09] [TRT] [V] --------------- Timing Runner: Conv_37 (CaskConvolution) [07/07/2022-18:30:09] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.659584 [07/07/2022-18:30:09] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.208795 [07/07/2022-18:30:09] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.426176 [07/07/2022-18:30:09] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.639659 [07/07/2022-18:30:09] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.657045 [07/07/2022-18:30:09] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:09] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.391168 [07/07/2022-18:30:09] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.279296 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.432811 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.446283 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.426987 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.426475 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.968629 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.397995 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.490443 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.541365 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.411189 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 1.43291 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.27784 [07/07/2022-18:30:10] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.208795 [07/07/2022-18:30:10] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x00000000009fffff [07/07/2022-18:30:10] [TRT] [V] *************** Autotuning format combination: Float(184832,1,9728,512) -> Float(184832,1,9728,512) *************** [07/07/2022-18:30:10] [TRT] [V] --------------- Timing Runner: Conv_37 (CaskConvolution) [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 1.30879 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.659616 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.658091 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.26736 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.875179 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.349248 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.344085 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.647936 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.185003 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.349525 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.658165 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.342709 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.63568 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.351573 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.270859 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.667093 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.346699 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.352939 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.186064 [07/07/2022-18:30:10] [TRT] [V] Fastest Tactic: 0x516049bee7812ab0 Time: 0.185003 [07/07/2022-18:30:10] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:10] [TRT] [V] *************** Autotuning format combination: Half(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:30:10] [TRT] [W] Weights [name=Conv_37.weight] had the following issues when converted to FP16: [07/07/2022-18:30:10] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:10] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:10] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:10] [TRT] [V] --------------- Timing Runner: Conv_37 (CudnnConvolution) [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.679253 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.474496 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.496491 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.313728 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.678176 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000000003a Time: 0.503701 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000000003e Time: 0.312715 [07/07/2022-18:30:10] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.312715 [07/07/2022-18:30:10] [TRT] [V] Setting workspace to 1145307136enables more tactics for profiling [07/07/2022-18:30:10] [TRT] [W] Weights [name=Conv_37.weight] had the following issues when converted to FP16: [07/07/2022-18:30:10] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:10] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:10] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:10] [TRT] [V] --------------- Timing Runner: Conv_37 (CaskConvolution) [07/07/2022-18:30:10] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:10] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e [07/07/2022-18:30:10] [TRT] [V] *************** Autotuning format combination: Half(92416,361:2,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:30:10] [TRT] [W] Weights [name=Conv_37.weight] had the following issues when converted to FP16: [07/07/2022-18:30:10] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:10] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:10] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:10] [TRT] [V] --------------- Timing Runner: Conv_37 (FusedConvActConvolution) [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.126873 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x00000000000affff Time: 0.176784 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x00000000000effff Time: 0.0883013 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.124391 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.09232 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x00000000001affff Time: 0.102307 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.10656 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.08996 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.12395 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.124174 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.10108 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.162645 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x00000000006effff Time: 0.0922053 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.0917893 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.103555 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.110613 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.122322 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.112764 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.0815083 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.090648 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.0981893 [07/07/2022-18:30:10] [TRT] [V] Fastest Tactic: 0x00000000009fffff Time: 0.0815083 [07/07/2022-18:30:10] [TRT] [W] Weights [name=Conv_37.weight] had the following issues when converted to FP16: [07/07/2022-18:30:10] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:10] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:10] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:10] [TRT] [V] --------------- Timing Runner: Conv_37 (CaskConvolution) [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.234155 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.225909 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.224165 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.194213 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.231424 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.255291 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.253269 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.191003 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.326992 [07/07/2022-18:30:10] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:10] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.276213 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.211856 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.326741 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.345429 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.334501 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.104477 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.264907 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.202816 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.338549 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.345931 [07/07/2022-18:30:11] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.104477 [07/07/2022-18:30:11] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x00000000009fffff [07/07/2022-18:30:11] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:11] [TRT] [W] Weights [name=Conv_37.weight] had the following issues when converted to FP16: [07/07/2022-18:30:11] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:11] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:11] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:11] [TRT] [V] --------------- Timing Runner: Conv_37 (CaskConvolution) [07/07/2022-18:30:11] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:11] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,1216,64) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:30:11] [TRT] [W] Weights [name=Conv_37.weight] had the following issues when converted to FP16: [07/07/2022-18:30:11] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:11] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:11] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:11] [TRT] [V] --------------- Timing Runner: Conv_37 (CudaDepthwiseConvolution) [07/07/2022-18:30:11] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:11] [TRT] [W] Weights [name=Conv_37.weight] had the following issues when converted to FP16: [07/07/2022-18:30:11] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:11] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:11] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:11] [TRT] [V] --------------- Timing Runner: Conv_37 (CaskConvolution) [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.327307 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0634169 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.090112 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.164299 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.174981 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.174261 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.162521 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.113323 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.164441 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0977413 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.16357 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.094192 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0627147 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.323392 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0848773 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.100032 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.099936 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.102795 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0610791 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.167957 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.103528 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.093144 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.328896 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.177893 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0905413 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0956933 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.164039 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0967867 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.170309 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.0985733 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0809429 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.163186 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.327707 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0479299 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.323248 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0481143 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0826923 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.0449747 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.166247 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.171803 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0937947 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.167189 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.0659236 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0695403 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.165127 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0444693 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.168944 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0662151 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.179861 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.052387 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0485699 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.111975 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.164932 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.111662 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0638044 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.174576 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.172587 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.3268 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0670677 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0690752 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0897707 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0703147 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.102736 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0982 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0956907 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0970827 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.164178 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0927787 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0997733 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0664036 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0668075 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.110368 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.170389 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0909067 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.326368 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0877653 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.109563 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.163022 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0618791 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0646027 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0669013 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.163737 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.09124 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0813312 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0887147 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0978027 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.171781 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.172965 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0895547 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.327787 [07/07/2022-18:30:11] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:11] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.170384 [07/07/2022-18:30:12] [TRT] [V] Conv_37 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0977307 [07/07/2022-18:30:12] [TRT] [V] Fastest Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0444693 [07/07/2022-18:30:12] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:12] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:12] [TRT] [V] *************** Autotuning format combination: Float(369664,1444,38,1), Float(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CudaDepthwiseConvolution) [07/07/2022-18:30:12] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (FusedConvActConvolution) [07/07/2022-18:30:12] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CudnnConvolution) [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0335307 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0364064 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.099656 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0335211 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0364448 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0998347 [07/07/2022-18:30:12] [TRT] [V] Fastest Tactic: 0x0000000000000038 Time: 0.0335211 [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CaskConvolution) [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0434973 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0439627 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0345899 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.04372 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0284516 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0271106 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.0310992 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0297751 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.0354165 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0233017 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.0744021 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0283458 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0353301 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.0338453 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 0.0974773 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.023173 [07/07/2022-18:30:12] [TRT] [V] Fastest Tactic: 0xe40b38338a3a7d7e Time: 0.023173 [07/07/2022-18:30:12] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:12] [TRT] [V] *************** Autotuning format combination: Float(369664,1,9728,256), Float(184832,1,9728,512) -> Float(184832,1,9728,512) *************** [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CaskConvolution) [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.0916693 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.042424 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.0214193 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.0254088 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.0425267 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.017609 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0210727 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.0421693 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x849891f3d1d80c55 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x849891f3d1d80c55 Time: 0.042216 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.025619 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x90d45931b538d74f [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x90d45931b538d74f Time: 0.0173552 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.0423213 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.0300498 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0296613 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0xb90177ab6d659acd [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xb90177ab6d659acd Time: 0.0421053 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.0299387 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xf92663d88255134b [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xf92663d88255134b Time: 0.0247291 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.0176662 [07/07/2022-18:30:12] [TRT] [V] Fastest Tactic: 0x90d45931b538d74f Time: 0.0173552 [07/07/2022-18:30:12] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x90d45931b538d74f [07/07/2022-18:30:12] [TRT] [V] *************** Autotuning format combination: Half(369664,1444,38,1), Half(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:30:12] [TRT] [W] Weights [name=Conv_38 + Add_39 + Relu_40.weight] had the following issues when converted to FP16: [07/07/2022-18:30:12] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:12] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CudnnConvolution) [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0556551 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0897653 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0987973 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0538956 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x000000000000003a Time: 0.09868 [07/07/2022-18:30:12] [TRT] [V] Fastest Tactic: 0x0000000000000038 Time: 0.0538956 [07/07/2022-18:30:12] [TRT] [W] Weights [name=Conv_38 + Add_39 + Relu_40.weight] had the following issues when converted to FP16: [07/07/2022-18:30:12] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:12] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CaskConvolution) [07/07/2022-18:30:12] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:12] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000038 [07/07/2022-18:30:12] [TRT] [V] *************** Autotuning format combination: Half(184832,1444:2,38,1), Half(92416,361:2,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:30:12] [TRT] [W] Weights [name=Conv_38 + Add_39 + Relu_40.weight] had the following issues when converted to FP16: [07/07/2022-18:30:12] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:12] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (FusedConvActConvolution) [07/07/2022-18:30:12] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:12] [TRT] [W] Weights [name=Conv_38 + Add_39 + Relu_40.weight] had the following issues when converted to FP16: [07/07/2022-18:30:12] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:12] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CaskConvolution) [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0172715 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0171723 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0167131 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.019069 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0193493 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0165516 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0241242 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.016257 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.0160122 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0183119 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0241082 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.0163297 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.0160518 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0240869 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0239291 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0240754 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0182333 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0240899 [07/07/2022-18:30:12] [TRT] [V] Fastest Tactic: 0x9ce6ebc390e62b01 Time: 0.0160122 [07/07/2022-18:30:12] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:12] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32), Float(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:12] [TRT] [W] Weights [name=Conv_38 + Add_39 + Relu_40.weight] had the following issues when converted to FP16: [07/07/2022-18:30:12] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:12] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CaskConvolution) [07/07/2022-18:30:12] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:12] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32), Half(23104,1:8,1216,64) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:30:12] [TRT] [W] Weights [name=Conv_38 + Add_39 + Relu_40.weight] had the following issues when converted to FP16: [07/07/2022-18:30:12] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:12] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CudaDepthwiseConvolution) [07/07/2022-18:30:12] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:12] [TRT] [W] Weights [name=Conv_38 + Add_39 + Relu_40.weight] had the following issues when converted to FP16: [07/07/2022-18:30:12] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:12] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_38 + Add_39 + Relu_40 (CaskConvolution) [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.00980831 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.0181418 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.0134443 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.0137741 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.0121322 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.0163027 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.0137749 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.00924223 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0113266 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.0119543 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.0129169 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.0155336 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0123915 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0171883 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.012668 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0170592 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0114777 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.026592 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0158676 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0107333 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.0175072 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.0098378 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.0123587 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.00908656 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.0111612 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.0158264 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.0170379 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.0116061 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0250583 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.0112103 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.0267955 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.00889011 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.00852187 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.0170757 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0164612 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0110851 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0157261 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.00993537 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.00983623 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.0180474 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0162905 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0158313 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.00870291 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.00833413 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0128693 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0170677 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0175323 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.0162682 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.0175489 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0181564 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.00912346 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0263754 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0093357 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0248579 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.0185369 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0263262 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.01813 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.026528 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.00981547 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0096064 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.00911856 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0111243 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.00925521 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.0133393 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.012461 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0141489 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0122488 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0137626 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.00899734 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.0137139 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0132976 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0133026 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0112999 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.025005 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.0137749 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.011992 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0183164 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.0166796 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0106223 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0101514 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0155704 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0116399 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0100878 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.00871139 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.00986071 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0173456 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.0112334 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.0161839 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.00832937 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.0182501 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0111492 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.0169771 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.0267061 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.0185641 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.00943022 [07/07/2022-18:30:12] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0119829 [07/07/2022-18:30:12] [TRT] [V] Fastest Tactic: 0xe67db95e0c20b618 Time: 0.00832937 [07/07/2022-18:30:12] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:12] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:12] [TRT] [V] *************** Autotuning format combination: Float(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CudaDepthwiseConvolution) [07/07/2022-18:30:12] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:12] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (FusedConvActConvolution) [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.321637 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x00000000000affff Time: 0.362016 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x00000000000effff Time: 0.178421 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.289205 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.192528 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x00000000001affff Time: 0.196997 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.205509 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.178763 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.251909 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.254507 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.185344 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.316416 [07/07/2022-18:30:12] [TRT] [V] Tactic: 0x00000000006effff Time: 0.188117 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.187067 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.211371 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.223979 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.236 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.240667 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.170981 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.17832 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.197099 [07/07/2022-18:30:13] [TRT] [V] Fastest Tactic: 0x00000000009fffff Time: 0.170981 [07/07/2022-18:30:13] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CudnnConvolution) [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.694891 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.2372 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.456139 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.269381 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.686763 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.237243 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000000003a Time: 0.454101 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x000000000000003e Time: 0.269995 [07/07/2022-18:30:13] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.2372 [07/07/2022-18:30:13] [TRT] [V] Setting workspace to 1145307136enables more tactics for profiling [07/07/2022-18:30:13] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CaskConvolution) [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.660139 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.207776 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.428181 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.646485 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.656757 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.393376 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.28472 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.436341 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.444928 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.427669 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.432811 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.964608 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.398677 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.480437 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.541707 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.416427 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 1.43027 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.278549 [07/07/2022-18:30:13] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.207776 [07/07/2022-18:30:13] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x00000000009fffff [07/07/2022-18:30:13] [TRT] [V] *************** Autotuning format combination: Float(184832,1,9728,512) -> Float(184832,1,9728,512) *************** [07/07/2022-18:30:13] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CaskConvolution) [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 1.30788 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.65856 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.649195 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.267029 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.882741 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.355232 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.339072 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.656597 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.185115 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.356907 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.651915 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.340821 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.645035 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.351563 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.268091 [07/07/2022-18:30:13] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:13] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.659275 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.339755 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.359765 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.186331 [07/07/2022-18:30:14] [TRT] [V] Fastest Tactic: 0x516049bee7812ab0 Time: 0.185115 [07/07/2022-18:30:14] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:14] [TRT] [V] *************** Autotuning format combination: Half(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:30:14] [TRT] [W] Weights [name=Conv_41 + Relu_42.weight] had the following issues when converted to FP16: [07/07/2022-18:30:14] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:14] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:14] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:14] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CudnnConvolution) [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.674069 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.476992 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.498656 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.31472 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.679936 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000000003a Time: 0.500224 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000000003e Time: 0.315403 [07/07/2022-18:30:14] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.31472 [07/07/2022-18:30:14] [TRT] [V] Setting workspace to 1145307136enables more tactics for profiling [07/07/2022-18:30:14] [TRT] [W] Weights [name=Conv_41 + Relu_42.weight] had the following issues when converted to FP16: [07/07/2022-18:30:14] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:14] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:14] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:14] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CaskConvolution) [07/07/2022-18:30:14] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:14] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000006 [07/07/2022-18:30:14] [TRT] [V] *************** Autotuning format combination: Half(92416,361:2,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:30:14] [TRT] [W] Weights [name=Conv_41 + Relu_42.weight] had the following issues when converted to FP16: [07/07/2022-18:30:14] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:14] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:14] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:14] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (FusedConvActConvolution) [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.126695 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00000000000affff Time: 0.176859 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00000000000effff Time: 0.0884267 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.1247 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.09216 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00000000001affff Time: 0.102475 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.106427 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.0898907 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.123908 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.124284 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.101197 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.162859 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00000000006effff Time: 0.092128 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.0916373 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.103437 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.110853 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.122592 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.112996 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.0816789 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.090384 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.098128 [07/07/2022-18:30:14] [TRT] [V] Fastest Tactic: 0x00000000009fffff Time: 0.0816789 [07/07/2022-18:30:14] [TRT] [W] Weights [name=Conv_41 + Relu_42.weight] had the following issues when converted to FP16: [07/07/2022-18:30:14] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:14] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:14] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:14] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CaskConvolution) [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.234411 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.225947 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.224203 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.194171 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.231435 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.251451 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.259467 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.191131 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.331141 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.279877 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.211803 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.326635 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.345653 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.338773 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.104197 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.272309 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.201771 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.338453 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.346112 [07/07/2022-18:30:14] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.104197 [07/07/2022-18:30:14] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x00000000009fffff [07/07/2022-18:30:14] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,1216,64) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:14] [TRT] [W] Weights [name=Conv_41 + Relu_42.weight] had the following issues when converted to FP16: [07/07/2022-18:30:14] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:14] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:14] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:14] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CaskConvolution) [07/07/2022-18:30:14] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:14] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,1216,64) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:30:14] [TRT] [W] Weights [name=Conv_41 + Relu_42.weight] had the following issues when converted to FP16: [07/07/2022-18:30:14] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:14] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:14] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:14] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CudaDepthwiseConvolution) [07/07/2022-18:30:14] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:14] [TRT] [W] Weights [name=Conv_41 + Relu_42.weight] had the following issues when converted to FP16: [07/07/2022-18:30:14] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:14] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:14] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:14] [TRT] [V] --------------- Timing Runner: Conv_41 + Relu_42 (CaskConvolution) [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.327605 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0635449 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0901173 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.164121 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.175264 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.174235 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.162692 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.113394 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.164306 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.097576 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.163356 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.094032 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0627236 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.327712 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.084792 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.100283 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.099904 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.102499 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0612498 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.168235 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.103512 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.0930187 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.329045 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.177824 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.0906187 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0956213 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.164142 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.0965013 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.170389 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.098576 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0810688 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.163381 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.323691 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0479269 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.323541 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0482773 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0825813 [07/07/2022-18:30:14] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:14] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.044988 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.166318 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.171749 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.0938507 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.166981 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.066 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0694315 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.165312 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0445947 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.168885 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0663538 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.179952 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0523383 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0485379 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.111822 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.164903 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.111431 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0639947 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.174651 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.172928 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.326965 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0668523 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0691392 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.090072 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0705216 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.102704 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.0980773 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0955227 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0970213 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.164036 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.092968 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.0992587 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0667755 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.0670187 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.110299 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.170565 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0912267 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.326315 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0877547 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.109624 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.163143 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0619716 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0645049 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0668331 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.163772 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0914053 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0813589 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.0887147 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0978587 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.17112 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.172992 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.0894293 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.328005 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.170128 [07/07/2022-18:30:15] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.097688 [07/07/2022-18:30:15] [TRT] [V] Fastest Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0445947 [07/07/2022-18:30:15] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:15] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:15] [TRT] [V] *************** Autotuning format combination: Float(184832,361,19,1), Float(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:15] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CudaDepthwiseConvolution) [07/07/2022-18:30:15] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:15] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (FusedConvActConvolution) [07/07/2022-18:30:15] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:15] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CudnnConvolution) [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.688853 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.241077 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.457472 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.273861 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.698112 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.241184 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x000000000000003a Time: 0.456971 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x000000000000003e Time: 0.273749 [07/07/2022-18:30:15] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.241077 [07/07/2022-18:30:15] [TRT] [V] Setting workspace to 1145307136enables more tactics for profiling [07/07/2022-18:30:15] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CaskConvolution) [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.666283 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.208107 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.428715 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.647115 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.663093 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.391381 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.287925 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.437056 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.446464 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.423317 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:15] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.435093 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.968 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.403637 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.491467 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.540331 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.413205 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 1.43309 [07/07/2022-18:30:15] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:15] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.282197 [07/07/2022-18:30:15] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.208107 [07/07/2022-18:30:15] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:15] [TRT] [V] *************** Autotuning format combination: Float(184832,1,9728,512), Float(184832,1,9728,512) -> Float(184832,1,9728,512) *************** [07/07/2022-18:30:15] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CaskConvolution) [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 1.30207 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.653408 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.658773 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.271221 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.87792 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.359669 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.339179 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.655915 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.187104 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.361493 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.659456 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.350347 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.645803 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.354987 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.269131 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.660821 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.348725 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.357867 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.18856 [07/07/2022-18:30:16] [TRT] [V] Fastest Tactic: 0x516049bee7812ab0 Time: 0.187104 [07/07/2022-18:30:16] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:16] [TRT] [V] *************** Autotuning format combination: Half(184832,361,19,1), Half(184832,361,19,1) -> Half(184832,361,19,1) *************** [07/07/2022-18:30:16] [TRT] [W] Weights [name=Conv_43 + Add_44 + Relu_45.weight] had the following issues when converted to FP16: [07/07/2022-18:30:16] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:16] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:16] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:16] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CudnnConvolution) [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.717899 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.510315 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.520331 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.319445 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.717696 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x000000000000003a Time: 0.524288 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 2295595008, available: 268435456 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 1145307136, available: 268435456 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x000000000000003e Time: 0.31888 [07/07/2022-18:30:16] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.31888 [07/07/2022-18:30:16] [TRT] [V] Setting workspace to 1145307136enables more tactics for profiling [07/07/2022-18:30:16] [TRT] [W] Weights [name=Conv_43 + Add_44 + Relu_45.weight] had the following issues when converted to FP16: [07/07/2022-18:30:16] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:16] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:16] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:16] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CaskConvolution) [07/07/2022-18:30:16] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:16] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e [07/07/2022-18:30:16] [TRT] [V] *************** Autotuning format combination: Half(92416,361:2,19,1), Half(92416,361:2,19,1) -> Half(92416,361:2,19,1) *************** [07/07/2022-18:30:16] [TRT] [W] Weights [name=Conv_43 + Add_44 + Relu_45.weight] had the following issues when converted to FP16: [07/07/2022-18:30:16] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:16] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:16] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:16] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (FusedConvActConvolution) [07/07/2022-18:30:16] [TRT] [V] FusedConvActConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:16] [TRT] [W] Weights [name=Conv_43 + Add_44 + Relu_45.weight] had the following issues when converted to FP16: [07/07/2022-18:30:16] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:16] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:16] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:16] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CaskConvolution) [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.234965 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.226656 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.225131 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.196085 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.232112 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.259563 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.266192 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.195141 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.332517 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.29528 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.214901 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.323477 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.346795 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.338635 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.104589 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.271424 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.214277 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.335723 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.346795 [07/07/2022-18:30:16] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.104589 [07/07/2022-18:30:16] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:16] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,1216,64), Float(184832,361,19,1) -> Float(184832,361,19,1) *************** [07/07/2022-18:30:16] [TRT] [W] Weights [name=Conv_43 + Add_44 + Relu_45.weight] had the following issues when converted to FP16: [07/07/2022-18:30:16] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:16] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:16] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:16] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CaskConvolution) [07/07/2022-18:30:16] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:16] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,1216,64), Half(23104,1:8,1216,64) -> Half(23104,1:8,1216,64) *************** [07/07/2022-18:30:16] [TRT] [W] Weights [name=Conv_43 + Add_44 + Relu_45.weight] had the following issues when converted to FP16: [07/07/2022-18:30:16] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:16] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:16] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:16] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CudaDepthwiseConvolution) [07/07/2022-18:30:16] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:16] [TRT] [W] Weights [name=Conv_43 + Add_44 + Relu_45.weight] had the following issues when converted to FP16: [07/07/2022-18:30:16] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:16] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:16] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:16] [TRT] [V] --------------- Timing Runner: Conv_43 + Add_44 + Relu_45 (CaskConvolution) [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.331611 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.0640711 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.0923627 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.16586 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.178107 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.1772 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.166158 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.117447 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.165888 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.107811 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.166704 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.103496 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.0768875 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.327275 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.0871813 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.103632 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.109571 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.107203 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.0828331 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.169419 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.106917 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.101973 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.333125 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.178907 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.100125 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.0965787 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.16554 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.100555 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.173189 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.099696 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.0817067 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.165778 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.3292 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.0483352 [07/07/2022-18:30:16] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:16] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.328443 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.0485775 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.0845733 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.04572 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.168608 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.172725 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.100104 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.168251 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.084536 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.0883013 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.168811 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0452827 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.170005 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.0665813 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.181205 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.0527954 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.0491352 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.117404 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.166912 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.116519 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.0644569 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.177067 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.174763 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.326997 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.0670571 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.0805205 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.0908373 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.0706304 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.114482 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.109128 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0965627 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.0994587 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.168117 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0936293 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.100917 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.0670912 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.08596 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.114624 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.172011 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.0970587 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.323877 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.0953493 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.110747 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.16603 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.0749077 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.0833024 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.0864373 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.165166 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.092344 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.0818901 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.095912 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.0995093 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.173269 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.17592 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.098768 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.326315 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.173467 [07/07/2022-18:30:17] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0986453 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0x6cee4d9c86b4cdd5 Time: 0.0452827 [07/07/2022-18:30:17] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:17] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:17] [TRT] [V] *************** Autotuning format combination: Float(184832,361,19,1) -> Float(739328,1444,38,1) *************** [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Resize_46 (Resize) [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00955764 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00955764 [07/07/2022-18:30:17] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [07/07/2022-18:30:17] [TRT] [V] *************** Autotuning format combination: Half(184832,361,19,1) -> Half(739328,1444,38,1) *************** [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Resize_46 (Resize) [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00998463 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00998463 [07/07/2022-18:30:17] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [07/07/2022-18:30:17] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,1216,64) -> Half(92416,1:8,2432,64) *************** [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Resize_46 (Resize) [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.00546116 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.00546116 [07/07/2022-18:30:17] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000006 [07/07/2022-18:30:17] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:17] [TRT] [V] *************** Autotuning format combination: Float(1108992,1444,38,1) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [07/07/2022-18:30:17] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.271957 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000009ffff Time: 0.178219 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.124032 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000000cffff Time: 0.100117 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.090032 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.121369 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.142535 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.12693 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000002effff Time: 0.104821 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.106789 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.11994 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000003dffff Time: 0.097288 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.110403 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.118571 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.125376 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.084144 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000004affff Time: 0.126514 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000004effff Time: 0.102869 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.119662 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000055ffff Time: 0.0973333 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.0850427 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000005effff Time: 0.0950533 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.0901813 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000061ffff Time: 0.101368 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.146297 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000006affff Time: 0.127008 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.0835973 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.088696 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.09644 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.133675 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.0817429 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.203259 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.127815 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000007effff Time: 0.161536 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.147804 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000008affff Time: 0.128729 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.127257 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.111836 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.0828267 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.133319 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0x000000000075ffff Time: 0.0817429 [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CudnnConvolution) [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.13051 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0770965 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.21952 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 6670516224, available: 268435456 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.451712 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.130428 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0772928 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000000003a Time: 0.219979 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 6670516224, available: 268435456 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000000003d Time: 0.451957 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0770965 [07/07/2022-18:30:17] [TRT] [V] Setting workspace to 6670516224enables more tactics for profiling [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CublasConvolution) [07/07/2022-18:30:17] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.115534 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.116654 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.120331 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.116139 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5193693bc0732c65 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x5193693bc0732c65 Time: 0.0792491 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.075296 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0714347 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0790165 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa0dcf7c2b333d150 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa0dcf7c2b333d150 Time: 0.086928 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0784384 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.100619 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.13738 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0x7e29bdfccd92c42c Time: 0.0714347 [07/07/2022-18:30:17] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:17] [TRT] [V] *************** Autotuning format combination: Float(1108992,1,29184,768) -> Float(369664,1,9728,256) *************** [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CublasConvolution) [07/07/2022-18:30:17] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.125924 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.0711189 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.124964 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.0716672 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0825131 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.11899 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x849891f3d1d80c55 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x849891f3d1d80c55 Time: 0.117856 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.0712085 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x90d45931b538d74f [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x90d45931b538d74f Time: 0.0699221 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.119612 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0863147 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0xb90177ab6d659acd [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xb90177ab6d659acd Time: 0.122265 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xded29d328f8f7228 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xded29d328f8f7228 Time: 0.0814379 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xe957dcfcec24ec5d [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xe957dcfcec24ec5d Time: 0.0839067 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xf92663d88255134b [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xf92663d88255134b Time: 0.0649653 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.0716928 [07/07/2022-18:30:17] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfbba95cf52891795 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0xfbba95cf52891795 Time: 0.0860027 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0xf92663d88255134b Time: 0.0649653 [07/07/2022-18:30:17] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf92663d88255134b [07/07/2022-18:30:17] [TRT] [V] *************** Autotuning format combination: Half(1108992,1444,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:30:17] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:17] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:17] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:17] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CudnnConvolution) [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.131769 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.130496 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.174485 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 6670516224, available: 268435456 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.433493 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.131431 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000000003a Time: 0.175088 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 6670516224, available: 268435456 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000000003d Time: 0.428715 [07/07/2022-18:30:17] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.130496 [07/07/2022-18:30:17] [TRT] [V] Setting workspace to 6670516224enables more tactics for profiling [07/07/2022-18:30:17] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:17] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:17] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:17] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CublasConvolution) [07/07/2022-18:30:17] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:17] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:17] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:17] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:17] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/07/2022-18:30:17] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:17] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 [07/07/2022-18:30:17] [TRT] [V] *************** Autotuning format combination: Half(554496,1444:2,38,1) -> Half(369664,1444,38,1) *************** [07/07/2022-18:30:17] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:17] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:17] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:17] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/07/2022-18:30:17] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:17] [TRT] [V] *************** Autotuning format combination: Half(554496,1444:2,38,1) -> Half(184832,1444:2,38,1) *************** [07/07/2022-18:30:17] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:17] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:17] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:17] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:17] [TRT] [V] --------------- Timing Runner: Conv_48 (FusedConvActConvolution) [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0892347 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000009ffff Time: 0.0652995 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0635378 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000000cffff Time: 0.0521128 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.049091 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.064192 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.0746197 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0683029 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000002effff Time: 0.0498545 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.0516114 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.0630969 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000003dffff Time: 0.0511223 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0586933 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0635947 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0660196 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.0423187 [07/07/2022-18:30:17] [TRT] [V] Tactic: 0x00000000004affff Time: 0.0661618 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000004effff Time: 0.0551604 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.0648036 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000055ffff Time: 0.0508206 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.0436053 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000005effff Time: 0.049341 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.048989 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000061ffff Time: 0.0490941 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0779797 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0685483 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.0434333 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.0443067 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.0509196 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.0724565 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.0419213 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.107608 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.0666987 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0848053 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.087896 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0688427 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.0661636 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0587805 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.0416747 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0671829 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0x0000000000a3ffff Time: 0.0416747 [07/07/2022-18:30:18] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:18] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:18] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:18] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_48 (CublasConvolution) [07/07/2022-18:30:18] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:18] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:18] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:18] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:18] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0394181 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0392853 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0382388 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0645884 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.063792 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0376344 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0596267 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.0613013 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.0362389 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0432813 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0591556 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.061104 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.0355669 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0594382 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0588551 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0588249 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.04202 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0593867 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0xcc68d30459859090 Time: 0.0355669 [07/07/2022-18:30:18] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xcc68d30459859090 [07/07/2022-18:30:18] [TRT] [V] *************** Autotuning format combination: Half(138624,1:8,3648,96) -> Float(369664,1444,38,1) *************** [07/07/2022-18:30:18] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:18] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:18] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:18] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_48 (CublasConvolution) [07/07/2022-18:30:18] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:18] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:18] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:18] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:18] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/07/2022-18:30:18] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:18] [TRT] [V] *************** Autotuning format combination: Half(138624,1:8,3648,96) -> Half(46208,1:8,1216,32) *************** [07/07/2022-18:30:18] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:18] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:18] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:18] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_48 (CudaDepthwiseConvolution) [07/07/2022-18:30:18] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:18] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:18] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:18] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:18] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_48 (CublasConvolution) [07/07/2022-18:30:18] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:18] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:18] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:18] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:18] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_48 (CaskConvolution) [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x0129597ad9bbff14 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0129597ad9bbff14 Time: 0.0210553 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x017a89ce2d82b850 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x017a89ce2d82b850 Time: 0.0198802 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.0218393 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.0352373 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0229611 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0350976 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0242248 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x249110624ee04937 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x249110624ee04937 Time: 0.0192741 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x255200b1b31c45cd [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x255200b1b31c45cd Time: 0.0598844 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0329978 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0203006 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x2ae5fedb80fbd388 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x2ae5fedb80fbd388 Time: 0.0327001 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2c6739dc8daca583 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x2c6739dc8daca583 Time: 0.0239779 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0355392 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x3693535b668f43cb [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x3693535b668f43cb Time: 0.0226318 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.0189162 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.0236103 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.02125 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.024016 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.0359413 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.0280302 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0590916 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.023126 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0348725 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x62a22cfa1199e58e [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x62a22cfa1199e58e Time: 0.0175725 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0343456 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0349013 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0356544 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x7585679fc3cc2536 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x7585679fc3cc2536 Time: 0.0360939 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x77a26840a2ace0b3 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x77a26840a2ace0b3 Time: 0.0361973 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x77ef8bb029e1d4e0 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x77ef8bb029e1d4e0 Time: 0.0337259 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x7ca057c91d677737 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x7ca057c91d677737 Time: 0.0235342 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x7e665af4f37d210b [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x7e665af4f37d210b Time: 0.02303 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x81a7be09ad63581a [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x81a7be09ad63581a Time: 0.0243169 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.025229 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x83b35618df65874c [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x83b35618df65874c Time: 0.0277128 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0338912 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0343093 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.0328194 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0363413 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.0227712 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0599538 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0587733 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x911cdd8d308bed5c [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x911cdd8d308bed5c Time: 0.0265994 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0601991 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.0197233 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0224782 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.021874 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xb26ad7a19a3195cc [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xb26ad7a19a3195cc Time: 0.0237589 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xb3989f8802666c8a [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xb3989f8802666c8a Time: 0.0242636 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xb5342eac22cbe342 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xb5342eac22cbe342 Time: 0.0597973 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xb5fdd9dd73a52c67 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xb5fdd9dd73a52c67 Time: 0.0195959 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0236302 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0254484 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0589991 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.024525 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0364544 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0337877 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0207824 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.019894 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.0267988 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xdbe57b4edf7481d8 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xdbe57b4edf7481d8 Time: 0.023387 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0352821 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.0234937 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.0351819 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xe281d0b88acb38b8 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xe281d0b88acb38b8 Time: 0.0326992 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xe2866ff18c9049f9 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xe2866ff18c9049f9 Time: 0.0329406 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.0177095 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.0347669 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.0243086 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xfbff59172cce263c [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xfbff59172cce263c Time: 0.0249905 [07/07/2022-18:30:18] [TRT] [V] Conv_48 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0216913 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0x62a22cfa1199e58e Time: 0.0175725 [07/07/2022-18:30:18] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x62a22cfa1199e58e [07/07/2022-18:30:18] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:18] [TRT] [V] *************** Autotuning format combination: Float(369664,1444,38,1) -> Float(1478656,5776,76,1) *************** [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Resize_49 (Resize) [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0213507 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0213507 [07/07/2022-18:30:18] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [07/07/2022-18:30:18] [TRT] [V] *************** Autotuning format combination: Half(369664,1444,38,1) -> Half(1478656,5776,76,1) *************** [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Resize_49 (Resize) [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0166853 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0166853 [07/07/2022-18:30:18] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [07/07/2022-18:30:18] [TRT] [V] *************** Autotuning format combination: Half(46208,1:8,1216,32) -> Half(184832,1:8,2432,32) *************** [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Resize_49 (Resize) [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.00635613 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.00635613 [07/07/2022-18:30:18] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000006 [07/07/2022-18:30:18] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:18] [TRT] [V] *************** Autotuning format combination: Float(1478656,5776,76,1) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CudaDepthwiseConvolution) [07/07/2022-18:30:18] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (FusedConvActConvolution) [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.660192 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000000affff Time: 0.682763 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000000effff Time: 0.614208 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.698923 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.662507 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000001affff Time: 0.690784 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.701781 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.693589 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.659765 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.672459 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.632288 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.701472 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000006effff Time: 0.650389 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.669931 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.618891 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.605099 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.694816 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.689493 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.630101 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.688256 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.620469 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0x000000000089ffff Time: 0.605099 [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CudnnConvolution) [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000000 Time: 1.33333 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.848555 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000002 Time: 1.43855 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 10942218240, available: 268435456 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 361529344, available: 268435456 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.506133 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000038 Time: 1.33598 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.853184 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000000003a Time: 1.43974 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 10942218240, available: 268435456 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 361529344, available: 268435456 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x000000000000003e Time: 0.506837 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.506133 [07/07/2022-18:30:18] [TRT] [V] Setting workspace to 361529344enables more tactics for profiling [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CaskConvolution) [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.963968 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.428928 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.682656 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.966635 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.992597 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.704032 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.859477 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 1.02874 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.713931 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.809003 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.813653 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 1.24655 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.971435 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.78704 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.804181 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.978261 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 1.40827 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.848555 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.428928 [07/07/2022-18:30:18] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:18] [TRT] [V] *************** Autotuning format combination: Float(1478656,1,19456,256) -> Float(1848320,1,24320,320) *************** [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CaskConvolution) [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 1.34924 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.974037 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.971435 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.929589 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.763563 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.813557 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.688128 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.981909 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.67424 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.935872 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.961493 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.703701 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.971893 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.814485 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.935253 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.972117 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.694272 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.945877 [07/07/2022-18:30:18] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:18] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.668331 [07/07/2022-18:30:18] [TRT] [V] Fastest Tactic: 0xfa1e150a2da08265 Time: 0.668331 [07/07/2022-18:30:18] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:18] [TRT] [V] *************** Autotuning format combination: Half(1478656,5776,76,1) -> Half(1848320,5776,76,1) *************** [07/07/2022-18:30:18] [TRT] [W] Weights [name=Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164.weight] had the following issues when converted to FP16: [07/07/2022-18:30:18] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:18] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:18] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CudnnConvolution) [07/07/2022-18:30:18] [TRT] [V] Tactic: 0x0000000000000000 Time: 1.30103 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.788491 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000002 Time: 1.34209 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 10942218240, available: 268435456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000005 skipped. Scratch requested: 361529344, available: 268435456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.516683 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000038 Time: 1.30964 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003a Time: 1.34681 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 10942218240, available: 268435456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003d skipped. Scratch requested: 361529344, available: 268435456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003e Time: 0.517621 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.516683 [07/07/2022-18:30:19] [TRT] [V] Setting workspace to 361529344enables more tactics for profiling [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CaskConvolution) [07/07/2022-18:30:19] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000006 [07/07/2022-18:30:19] [TRT] [V] *************** Autotuning format combination: Half(739328,5776:2,76,1) -> Half(924160,5776:2,76,1) *************** [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (FusedConvActConvolution) [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.332261 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000000affff Time: 0.337664 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000000effff Time: 0.308997 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.342944 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.341109 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000001affff Time: 0.360096 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.382976 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.342133 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.334453 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.3332 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.328901 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.359765 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000006effff Time: 0.334507 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.33056 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.319429 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.310405 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.382837 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.342016 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.316987 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.349685 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.318704 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0x00000000000effff Time: 0.308997 [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CaskConvolution) [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.347541 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.34672 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.348843 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.342485 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.349141 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.392171 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.407648 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.341163 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.510496 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.418528 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.391947 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.494517 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.524779 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.505248 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.222208 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.401653 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.375115 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.512928 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.524651 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.222208 [07/07/2022-18:30:19] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:19] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,2432,32) -> Float(1848320,5776,76,1) *************** [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CaskConvolution) [07/07/2022-18:30:19] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,2432,32) -> Half(231040,1:8,3040,40) *************** [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CudaDepthwiseConvolution) [07/07/2022-18:30:19] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 (CaskConvolution) [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.340437 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.21944 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.30248 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.173968 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.286037 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.186635 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.2572 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.139993 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.257813 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.152633 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.261264 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.1473 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.218656 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.336939 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.213605 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.273168 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.177248 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.129557 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.150393 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.179413 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.127801 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.147406 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.334507 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.283659 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.258656 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.116903 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.254272 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.148238 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.194763 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.145163 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.285909 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.253045 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.336565 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.204448 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.341333 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.205141 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.211211 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.156761 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.185003 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.187899 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.228741 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.188368 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.159207 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.180544 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.253819 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.156608 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.186864 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.262384 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.283285 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.218181 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.164331 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.131492 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.175429 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.131332 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.220448 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.186827 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.188757 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.340576 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.26232 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.234475 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.227061 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.287227 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.175989 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.172336 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.116654 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.148665 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.253227 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.113191 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.160327 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.228571 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.175072 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.128953 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.181792 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.220357 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.335872 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.219845 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.277541 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.254277 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.217125 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.151865 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.175365 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.185243 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.141803 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.292363 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.253701 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.267888 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.180896 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.198576 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.250843 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.334507 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.197381 [07/07/2022-18:30:19] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.145049 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0xaf407014f2c7f1cb Time: 0.113191 [07/07/2022-18:30:19] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:19] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:19] [TRT] [V] *************** Autotuning format combination: Float(2217984,5776,76,1) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CudaDepthwiseConvolution) [07/07/2022-18:30:19] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (FusedConvActConvolution) [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.173045 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000009ffff Time: 0.11909 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.136935 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000000cffff Time: 0.101997 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.097592 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.125102 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.145796 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.12213 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000002effff Time: 0.110251 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.095712 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.132928 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000003dffff Time: 0.101637 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.118912 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.120149 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.11925 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.0908 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000004affff Time: 0.117358 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000004effff Time: 0.107456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.138937 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000055ffff Time: 0.101485 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.09272 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000005effff Time: 0.0972187 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.097784 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000061ffff Time: 0.113148 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.140555 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000006affff Time: 0.122151 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.0879947 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.095336 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.099712 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.133081 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.0884613 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.179984 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.119815 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000007effff Time: 0.147495 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.143175 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000008affff Time: 0.124228 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.11717 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.119022 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.08708 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.125337 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0x0000000000a3ffff Time: 0.08708 [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CudnnConvolution) [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.103683 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0731456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.213611 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 6594428928, available: 268435456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.33104 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.103477 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0732885 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003a Time: 0.212917 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 6594428928, available: 268435456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003d Time: 0.333963 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0731456 [07/07/2022-18:30:19] [TRT] [V] Setting workspace to 6594428928enables more tactics for profiling [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CublasConvolution) [07/07/2022-18:30:19] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CaskConvolution) [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0633547 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0641084 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0727296 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.0638542 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5193693bc0732c65 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x5193693bc0732c65 Time: 0.0680021 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0684459 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0643769 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0697792 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa0dcf7c2b333d150 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa0dcf7c2b333d150 Time: 0.0730816 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0681109 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0661084 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0752704 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0x18597bd4a7d0164d Time: 0.0633547 [07/07/2022-18:30:19] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:19] [TRT] [V] *************** Autotuning format combination: Float(2217984,1,29184,384) -> Float(739328,1,9728,128) *************** [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CublasConvolution) [07/07/2022-18:30:19] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CaskConvolution) [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.0735765 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.0794112 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.0725952 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.0618756 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0778581 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.0702784 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x849891f3d1d80c55 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x849891f3d1d80c55 Time: 0.0702443 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.0798955 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x90d45931b538d74f [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x90d45931b538d74f Time: 0.0608 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.070752 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0793685 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0xb90177ab6d659acd [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xb90177ab6d659acd Time: 0.0728597 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xded29d328f8f7228 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xded29d328f8f7228 Time: 0.0771051 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xe957dcfcec24ec5d [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xe957dcfcec24ec5d Time: 0.0760661 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xf92663d88255134b [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xf92663d88255134b Time: 0.072576 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.0621138 [07/07/2022-18:30:19] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfbba95cf52891795 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0xfbba95cf52891795 Time: 0.0793323 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0x90d45931b538d74f Time: 0.0608 [07/07/2022-18:30:19] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x90d45931b538d74f [07/07/2022-18:30:19] [TRT] [V] *************** Autotuning format combination: Half(2217984,5776,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CudnnConvolution) [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.106976 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0804651 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.201088 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 6594428928, available: 268435456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.316827 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.106952 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003a Time: 0.201659 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 6594428928, available: 268435456 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000000003d Time: 0.314027 [07/07/2022-18:30:19] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0804651 [07/07/2022-18:30:19] [TRT] [V] Setting workspace to 6594428928enables more tactics for profiling [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CublasConvolution) [07/07/2022-18:30:19] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CaskConvolution) [07/07/2022-18:30:19] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 [07/07/2022-18:30:19] [TRT] [V] *************** Autotuning format combination: Half(1108992,5776:2,76,1) -> Half(739328,5776,76,1) *************** [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (CaskConvolution) [07/07/2022-18:30:19] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:19] [TRT] [V] *************** Autotuning format combination: Half(1108992,5776:2,76,1) -> Half(369664,5776:2,76,1) *************** [07/07/2022-18:30:19] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:19] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:19] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:19] [TRT] [V] --------------- Timing Runner: Conv_51 (FusedConvActConvolution) [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.085664 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000009ffff Time: 0.0597316 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0730496 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000000cffff Time: 0.0563378 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.0540145 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0685547 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.0767403 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0683691 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000002effff Time: 0.051069 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.0497097 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.0713536 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000003dffff Time: 0.0537509 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0655627 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0647076 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0647307 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.0475507 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000004affff Time: 0.0628462 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x00000000004effff Time: 0.0568444 [07/07/2022-18:30:19] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.0736064 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000055ffff Time: 0.0536914 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.0481981 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000005effff Time: 0.0504031 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.0538865 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000061ffff Time: 0.0550598 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0753557 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0686059 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.0464733 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.0495832 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.0524495 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.071936 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.0445333 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.095464 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.0642702 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0780203 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.0797227 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0691008 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.062816 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0652142 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.0439853 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0666009 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x0000000000a3ffff Time: 0.0439853 [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_51 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_51 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0356875 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0358667 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0354091 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0374104 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0375336 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0353621 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0340171 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.0355147 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.0353312 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0363584 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0339488 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.0355883 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.0352021 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0340117 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0338613 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0339264 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0367392 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0341216 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0xdb5acaea7b0746d5 Time: 0.0338613 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(277248,1:8,3648,48) -> Float(739328,5776,76,1) *************** [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_51 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_51 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(277248,1:8,3648,48) -> Half(92416,1:8,1216,16) *************** [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_51 (CudaDepthwiseConvolution) [07/07/2022-18:30:20] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_51 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_51 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x0129597ad9bbff14 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0129597ad9bbff14 Time: 0.0223524 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x017a89ce2d82b850 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x017a89ce2d82b850 Time: 0.0221413 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.0173035 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.025168 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0192421 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0233088 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0272443 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x249110624ee04937 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x249110624ee04937 Time: 0.0202974 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x255200b1b31c45cd [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x255200b1b31c45cd Time: 0.0354507 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0222421 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0161961 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x2ae5fedb80fbd388 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x2ae5fedb80fbd388 Time: 0.02175 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2c6739dc8daca583 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x2c6739dc8daca583 Time: 0.027159 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0253577 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x3693535b668f43cb [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x3693535b668f43cb Time: 0.0217747 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.0205095 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.0188616 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.0224697 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.0233394 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.0251185 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.027703 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0357803 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.0239467 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0237212 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x62a22cfa1199e58e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x62a22cfa1199e58e Time: 0.0174117 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.025021 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0235243 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0252053 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x7585679fc3cc2536 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x7585679fc3cc2536 Time: 0.02544 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x77a26840a2ace0b3 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x77a26840a2ace0b3 Time: 0.0237611 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x77ef8bb029e1d4e0 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x77ef8bb029e1d4e0 Time: 0.023018 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x7ca057c91d677737 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x7ca057c91d677737 Time: 0.02321 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x7e665af4f37d210b [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x7e665af4f37d210b Time: 0.0238491 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x81a7be09ad63581a [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x81a7be09ad63581a Time: 0.026103 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0196919 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x83b35618df65874c [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x83b35618df65874c Time: 0.0274174 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0243749 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0248251 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.037555 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0257305 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.0219627 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0357472 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0357653 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x911cdd8d308bed5c [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x911cdd8d308bed5c Time: 0.0265912 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0359445 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.0195354 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0178291 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.017582 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xb26ad7a19a3195cc [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xb26ad7a19a3195cc Time: 0.02335 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xb3989f8802666c8a [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xb3989f8802666c8a Time: 0.0184236 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xb5342eac22cbe342 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xb5342eac22cbe342 Time: 0.0348896 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xb5fdd9dd73a52c67 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xb5fdd9dd73a52c67 Time: 0.0194441 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0203194 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0221507 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0360267 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.0185339 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0238895 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0248289 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.01667 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.0223275 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.0268193 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xdbe57b4edf7481d8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdbe57b4edf7481d8 Time: 0.0200772 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0234041 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.0240282 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.0235705 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xe281d0b88acb38b8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xe281d0b88acb38b8 Time: 0.0377162 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xe2866ff18c9049f9 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xe2866ff18c9049f9 Time: 0.0238987 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.0175938 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.023077 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.0262285 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xfbff59172cce263c [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xfbff59172cce263c Time: 0.0219293 [07/07/2022-18:30:20] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0170341 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x2a3615ad33745f0b Time: 0.0161961 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:20] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Float(739328,5776,76,1) -> Float(2957312,23104,152,1) *************** [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Resize_52 (Resize) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0392676 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0392676 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(739328,5776,76,1) -> Half(2957312,23104,152,1) *************** [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Resize_52 (Resize) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0374436 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0374436 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000001 [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(92416,1:8,1216,16) -> Half(369664,1:8,2432,16) *************** [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Resize_52 (Resize) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.0166821 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.0166821 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000006 [07/07/2022-18:30:20] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Float(1848320,5776,76,1) -> Float(17328,5776,76,1) *************** [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CudaDepthwiseConvolution) [07/07/2022-18:30:20] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (FusedConvActConvolution) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0180149 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0108129 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.01048 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.00999467 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0107868 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.00987921 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.00978438 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.00968167 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.00957044 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000004affff Time: 0.00977371 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0102148 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0108239 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.00957257 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0104087 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.00967619 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007effff Time: 0.00979688 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.00947378 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0107582 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.00969417 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.00959573 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.00965851 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x000000000083ffff Time: 0.00947378 [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CudnnConvolution) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.010358 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0103415 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0370406 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.34328 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.10784 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0103318 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0103421 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0369973 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003c Time: 0.364309 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003d Time: 0.107592 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x0000000000000038 Time: 0.0103318 [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0164993 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0167392 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0126985 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.0165917 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.012325 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0120411 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0126463 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0118418 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0106517 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0128146 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0106517 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x000000000083ffff [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Float(1848320,1,24320,320) -> Float(17328,1,228,3) *************** [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0115925 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0184567 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x704db0897ce9340d Time: 0.0115925 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x704db0897ce9340d [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(1848320,5776,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CudnnConvolution) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.031615 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0328659 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0426227 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.334928 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.087496 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0317023 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003a Time: 0.043016 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003c Time: 0.363861 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003d Time: 0.088064 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.031615 [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000000 [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(11552,5776:2,76,1) *************** [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (FusedConvActConvolution) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0133145 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0084096 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.00858366 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.00814595 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.00956282 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.0079236 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0086999 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.00797003 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.00781445 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000004affff Time: 0.00768097 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.00804851 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000006affff Time: 0.00958263 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.00758521 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.00778369 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.00767855 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0078725 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.00756077 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0095424 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.00769891 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.00775758 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.00866106 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x000000000083ffff Time: 0.00756077 [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.00933481 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.00930666 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.00886933 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.00956495 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.00954789 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.00886007 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0105657 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.00925088 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.00923849 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.00901726 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0106367 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.00919524 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.00931081 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0108449 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0105443 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0104763 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.00892969 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0108659 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x7498280d2c59e4aa Time: 0.00886007 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x000000000083ffff [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Float(17328,5776,76,1) *************** [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CudaDepthwiseConvolution) [07/07/2022-18:30:20] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:20] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:20] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_57 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.00837706 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.00823727 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.00784198 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.00980423 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0130343 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.00975908 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.00848507 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.00867884 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.00837893 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.008348 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.00611006 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.00808178 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.00923474 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.00824039 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0107726 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.00904014 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.00966491 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.00906263 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0092797 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.00907359 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.00827525 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0103596 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.010912 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.0148925 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0107623 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.00814101 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0121848 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.010262 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0120575 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.0073811 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.00875651 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.00829008 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.00881095 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.00925665 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0104587 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.00978255 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0108329 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.00869032 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.00791169 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.00628859 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.00626054 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0100185 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.00791293 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.00970514 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.00730829 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.00992941 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.00657234 [07/07/2022-18:30:20] [TRT] [V] Conv_57 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.00831376 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x41e8a431d0137286 Time: 0.00611006 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:20] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Float(1848320,5776,76,1) -> Float(11552,5776,76,1) *************** [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_84 (CudaDepthwiseConvolution) [07/07/2022-18:30:20] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_84 (FusedConvActConvolution) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0179138 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0104393 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.0108563 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0104129 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.00983467 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0107127 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.010698 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.00980328 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.00968289 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.00962682 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.00959299 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.0117992 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000004affff Time: 0.00965181 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000004effff Time: 0.0112512 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.0134229 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.0117918 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000005effff Time: 0.0104019 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.0109058 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0100725 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0106373 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.009856 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.0120583 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.0115917 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.009456 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.0101107 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0103483 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.00966979 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0096704 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.00957318 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000008affff Time: 0.010691 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.009728 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0095744 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.0103192 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0098971 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x000000000073ffff Time: 0.009456 [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_84 (CudnnConvolution) [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0101353 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0101634 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0367253 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.285163 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.107627 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0101844 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0101453 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0367723 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003c Time: 0.274011 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x000000000000003d Time: 0.107584 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0101353 [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_84 (CublasConvolution) [07/07/2022-18:30:20] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:20] [TRT] [V] --------------- Timing Runner: Conv_84 (CaskConvolution) [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0165663 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0167253 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0126661 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.0166896 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0122872 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0119806 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:20] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0125519 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0118323 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0104943 [07/07/2022-18:30:20] [TRT] [V] Conv_84 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:20] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0127573 [07/07/2022-18:30:20] [TRT] [V] Fastest Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0104943 [07/07/2022-18:30:20] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x000000000073ffff [07/07/2022-18:30:20] [TRT] [V] *************** Autotuning format combination: Float(1848320,1,24320,320) -> Float(11552,1,152,2) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0115958 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0183663 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x704db0897ce9340d Time: 0.0115958 [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x704db0897ce9340d [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(1848320,5776,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CudnnConvolution) [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0323113 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0323811 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0435947 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.285445 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.0882907 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0324005 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0437067 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003c Time: 0.281947 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003d Time: 0.0889973 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0323113 [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000000 [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(5776,5776:2,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (FusedConvActConvolution) [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0119836 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.00773624 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.00862386 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0085376 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.00749037 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.00911971 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.00829893 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.00756314 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.00829997 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.00754915 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.00740883 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.00962225 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000004affff Time: 0.00746027 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000004effff Time: 0.00921225 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.00980612 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.00960152 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000005effff Time: 0.00798959 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.00889853 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.00781073 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000006affff Time: 0.00912605 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.0075693 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.00961067 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.00933274 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.00735768 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.00794108 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.00764897 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.00724403 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007effff Time: 0.00745363 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.00719228 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000008affff Time: 0.00899986 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.00742566 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.00757745 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.00790474 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.00761503 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x000000000083ffff Time: 0.00719228 [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0092957 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.00936533 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.00883312 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0096 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.00958476 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.00886372 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.010538 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.00916641 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.00926874 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.00904591 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.010545 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.00921139 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.00922263 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0107768 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.010504 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0104663 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.00883032 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0110421 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0xe3dc8e986f0522d1 Time: 0.00883032 [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x000000000083ffff [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Float(11552,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CudaDepthwiseConvolution) [07/07/2022-18:30:21] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_84 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.0082789 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.00816546 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.00780849 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.00974141 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0130425 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.00979566 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0083464 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.00860609 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.00834373 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.00823779 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.00613023 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.00807136 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.00919409 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.00818446 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0108167 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.00904908 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.00960579 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.00901132 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.00922811 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.00903582 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0083226 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.010346 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0107823 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.0149496 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.010683 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.00818185 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0121973 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0102875 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0120568 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.00741565 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.00875569 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.00830127 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.00882723 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.00927318 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.010501 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.00971093 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0108508 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.00869197 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.00791665 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.00630601 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.00633419 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.00998274 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.00794419 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.00967924 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.00729298 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.00987984 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.00642379 [07/07/2022-18:30:21] [TRT] [V] Conv_84 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0083816 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x41e8a431d0137286 Time: 0.00613023 [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:21] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Float(1848320,5776,76,1) -> Float(11552,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Float(1848320,1,24320,320) -> Float(11552,1,152,2) *************** [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(1848320,5776,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(11552,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_111 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(5776,5776:2,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Float(11552,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_111 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_111 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Float(1848320,5776,76,1) -> Float(5776,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CudaDepthwiseConvolution) [07/07/2022-18:30:21] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (FusedConvActConvolution) [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0179127 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0105017 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0103748 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.00981208 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0106333 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.00971642 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.00969173 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.00963108 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.00954087 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000004affff Time: 0.0096899 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.00998086 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0106413 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.00993381 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0103331 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.00963688 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007effff Time: 0.00985161 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.00961859 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0106587 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.00971063 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0095808 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.00964145 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x000000000045ffff Time: 0.00954087 [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CudnnConvolution) [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.010096 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0100292 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0259865 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.239968 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.104379 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0101275 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0100493 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0258453 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003c Time: 0.237253 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003d Time: 0.104629 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0100292 [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0165389 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0166992 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0127273 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.0166784 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0123036 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.012013 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0126333 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0117532 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0105753 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0127806 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0105753 [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x000000000045ffff [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Float(1848320,1,24320,320) -> Float(5776,1,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0115759 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0184135 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x704db0897ce9340d Time: 0.0115759 [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x704db0897ce9340d [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(1848320,5776,76,1) -> Half(5776,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CudnnConvolution) [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0286044 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0288276 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0266142 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.232363 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.07712 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0286409 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0265247 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003c Time: 0.237621 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000000003d Time: 0.0779371 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x000000000000003a Time: 0.0265247 [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003a [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(5776,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(5776,5776:2,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (FusedConvActConvolution) [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0132308 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0084128 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.00872096 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.00817509 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.00950548 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.00775564 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.00860362 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.00782313 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.00765454 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000004affff Time: 0.00764921 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.00793426 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000006affff Time: 0.009472 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.00771976 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.00771782 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.00745126 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0078209 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.00757452 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000008affff Time: 0.00954849 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.00767273 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.00778047 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.00853973 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x00000000007dffff Time: 0.00745126 [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.00922955 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.00928563 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.00882667 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0095488 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.00962651 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.00884295 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0105957 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.00916382 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.00928533 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.00898189 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0105747 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.00915546 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.00921225 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0106863 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0104847 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.01048 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0088713 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0107263 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x3bee4a098b4f8914 Time: 0.00882667 [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 0x00000000007dffff [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Float(5776,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CudaDepthwiseConvolution) [07/07/2022-18:30:21] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_138 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.00877839 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.00849253 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.00773261 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.00941689 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0130622 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.00977097 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0083504 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.00866817 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.0084152 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.00818003 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.00614012 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.00804089 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.00925924 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.0081087 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0108914 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.00902775 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.00959756 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.00889319 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.00918717 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.00904966 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.00826381 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0103793 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0109282 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.0149278 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0107467 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.00821333 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0122008 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.010284 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0120827 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.00741472 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.00875214 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0082521 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.00881881 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.00925607 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0104453 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.00973318 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0108112 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.00856643 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.00801346 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.00633379 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.00637243 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0100329 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.00790003 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.00971124 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.00754536 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.00996173 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.00658761 [07/07/2022-18:30:21] [TRT] [V] Conv_138 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.00829919 [07/07/2022-18:30:21] [TRT] [V] Fastest Tactic: 0x41e8a431d0137286 Time: 0.00614012 [07/07/2022-18:30:21] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:21] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Float(1848320,5776,76,1) -> Float(17328,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Float(1848320,1,24320,320) -> Float(17328,1,228,3) *************** [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(1848320,5776,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(17328,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_165 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(924160,5776:2,76,1) -> Half(11552,5776:2,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Float(17328,5776,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_165 (CublasConvolution) [07/07/2022-18:30:21] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_165 (CaskConvolution) [07/07/2022-18:30:21] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Half(231040,1:8,3040,40) -> Half(5776,1:8,76,1) *************** [07/07/2022-18:30:21] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:21] [TRT] [V] *************** Autotuning format combination: Float(2957312,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CudaDepthwiseConvolution) [07/07/2022-18:30:21] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:21] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (FusedConvActConvolution) [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000007ffff Time: 1.22621 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000000affff Time: 1.23971 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000000effff Time: 1.1633 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000000fffff Time: 1.26967 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000019ffff Time: 1.30046 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000001affff Time: 1.46506 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000024ffff Time: 1.49217 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000027ffff Time: 1.35254 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000002dffff Time: 1.26293 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000036ffff Time: 1.26278 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000004cffff Time: 1.26099 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000062ffff Time: 1.25338 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x00000000006effff Time: 1.32027 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000077ffff Time: 1.36038 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000086ffff Time: 1.35441 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000089ffff Time: 1.26993 [07/07/2022-18:30:21] [TRT] [V] Tactic: 0x000000000097ffff Time: 1.42879 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000098ffff Time: 1.27249 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000009fffff Time: 1.27173 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 1.3296 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 1.2173 [07/07/2022-18:30:22] [TRT] [V] Fastest Tactic: 0x00000000000effff Time: 1.1633 [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CudnnConvolution) [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000000 Time: 2.40436 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000001 Time: 1.5621 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000002 Time: 2.66501 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000005 Time: 15.1276 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000006 Time: 1.07188 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000038 Time: 2.3511 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000039 Time: 1.53553 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000000003a Time: 2.63373 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000000003d Time: 15.1785 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000000003e Time: 1.06249 [07/07/2022-18:30:22] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 1.06249 [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CaskConvolution) [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 1.31353 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.834816 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 1.1821 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 1.30384 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x597d29027694c20b Time: 1.36224 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 1.19581 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 1.60832 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 1.88847 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 1.22081 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 1.48877 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 1.51211 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 1.60017 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 1.60548 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 1.50227 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 1.3455 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 1.62947 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 2.26729 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 1.62953 [07/07/2022-18:30:22] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.834816 [07/07/2022-18:30:22] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:22] [TRT] [V] *************** Autotuning format combination: Float(2957312,1,19456,128) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CaskConvolution) [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 1.80571 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 1.32691 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 1.32007 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 1.78925 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 1.52591 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 1.40718 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 1.22401 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 1.32985 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 1.33213 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 1.56727 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 1.31413 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 1.22496 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 1.31425 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 1.39337 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 1.80226 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 1.35245 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 1.22609 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 1.59306 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 1.36039 [07/07/2022-18:30:22] [TRT] [V] Fastest Tactic: 0x48f8d75aa348d22f Time: 1.22401 [07/07/2022-18:30:22] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:22] [TRT] [V] *************** Autotuning format combination: Half(2957312,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:30:22] [TRT] [W] Weights [name=Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174.weight] had the following issues when converted to FP16: [07/07/2022-18:30:22] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:22] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CudnnConvolution) [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000000 Time: 2.27826 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000001 Time: 1.4669 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000002 Time: 2.375 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000005 Time: 15.0213 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000006 Time: 1.10071 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000000038 Time: 2.26295 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000000003a Time: 2.37217 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000000003d Time: 15.0521 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000000003e Time: 1.10046 [07/07/2022-18:30:22] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 1.10046 [07/07/2022-18:30:22] [TRT] [W] Weights [name=Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174.weight] had the following issues when converted to FP16: [07/07/2022-18:30:22] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:22] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CaskConvolution) [07/07/2022-18:30:22] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:22] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e [07/07/2022-18:30:22] [TRT] [V] *************** Autotuning format combination: Half(1478656,23104:2,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:30:22] [TRT] [W] Weights [name=Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174.weight] had the following issues when converted to FP16: [07/07/2022-18:30:22] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:22] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (FusedConvActConvolution) [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.614464 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000000affff Time: 0.602112 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000000effff Time: 0.586411 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.618005 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.612693 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000001affff Time: 0.786123 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.821461 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.660053 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.606752 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.619861 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.630752 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.668875 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000006effff Time: 0.675104 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.7168 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.686443 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.651243 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.838997 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.646261 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.639179 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.688587 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.611947 [07/07/2022-18:30:22] [TRT] [V] Fastest Tactic: 0x00000000000effff Time: 0.586411 [07/07/2022-18:30:22] [TRT] [W] Weights [name=Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174.weight] had the following issues when converted to FP16: [07/07/2022-18:30:22] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:22] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CaskConvolution) [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.626976 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.620544 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.620747 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.623787 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.614517 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.651093 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.641579 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.596651 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.689611 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.653909 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.640437 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.686901 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.704672 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.692224 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.445781 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.662144 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.634027 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.689536 [07/07/2022-18:30:22] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:22] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.703957 [07/07/2022-18:30:22] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.445781 [07/07/2022-18:30:22] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:22] [TRT] [V] *************** Autotuning format combination: Half(369664,1:8,2432,16) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:30:22] [TRT] [W] Weights [name=Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174.weight] had the following issues when converted to FP16: [07/07/2022-18:30:22] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:22] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CaskConvolution) [07/07/2022-18:30:22] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:22] [TRT] [V] *************** Autotuning format combination: Half(369664,1:8,2432,16) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:30:22] [TRT] [W] Weights [name=Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174.weight] had the following issues when converted to FP16: [07/07/2022-18:30:22] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:22] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:22] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CudaDepthwiseConvolution) [07/07/2022-18:30:22] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:22] [TRT] [W] Weights [name=Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174.weight] had the following issues when converted to FP16: [07/07/2022-18:30:22] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:22] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 (CaskConvolution) [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.517269 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.430752 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.606059 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.309952 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.411509 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.274315 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.496853 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.252235 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.342912 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.231371 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.492203 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.221781 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.430464 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.443392 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.374635 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.471723 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.341867 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.236203 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.285797 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.25896 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.226469 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.22072 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.5184 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.411648 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.441984 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.227067 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.344256 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.222565 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.306496 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.209419 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.552821 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.343979 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.448629 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.40448 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.527787 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.4144 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.379253 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.305141 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.328832 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.352384 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.402581 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.349493 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.302693 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.328784 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.343371 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.307392 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.344064 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.522581 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.399691 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.431989 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.320197 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.237483 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.313744 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.2368 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.427349 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.270464 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.27536 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.443669 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.518933 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.456299 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.416448 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.551371 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.336907 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.334528 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.226405 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.22336 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.340437 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.221067 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.268491 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.445696 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.318736 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.227845 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.257024 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.395264 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.449195 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.393056 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.512 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.492928 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.425643 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.285397 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.316341 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.344117 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.205808 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.551851 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.431445 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.470421 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.254683 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.313051 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.432117 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.447147 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.310101 [07/07/2022-18:30:23] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.209077 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0xd47a5fce3824e4a4 Time: 0.205808 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(17328,5776,76,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_64 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0166784 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0166784 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(17328,5776,76,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_64 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0168069 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0168069 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(5776,1:8,76,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_64 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.0168235 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000004 Time: 0.0168235 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000004 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(11552,5776,76,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_91 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0167563 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0167563 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(11552,5776,76,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_91 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0142533 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0142533 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(5776,1:8,76,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_91 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.0149867 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000004 Time: 0.0149867 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000004 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(11552,5776,76,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_118 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0136239 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0136239 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(11552,5776,76,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_118 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0143644 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0143644 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(5776,1:8,76,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_118 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.0145939 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000004 Time: 0.0145939 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000004 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(5776,5776,76,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_145 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0140302 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0140302 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(5776,5776,76,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_145 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0145169 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0145169 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(5776,1:8,76,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_145 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.0143489 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000004 Time: 0.0143489 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000004 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(17328,5776,76,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_172 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0141756 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0141756 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(17328,5776,76,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_172 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0140871 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.0140871 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(5776,1:8,76,1) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Resize_172 (Resize) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.0146166 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000004 Time: 0.0146166 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Resize Tactic: 0x0000000000000004 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(4435968,23104,152,1) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CudaDepthwiseConvolution) [07/07/2022-18:30:23] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (FusedConvActConvolution) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.207696 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000009ffff Time: 0.153408 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.148772 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000000cffff Time: 0.169675 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.119339 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.145874 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.158357 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.143609 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000002effff Time: 0.152071 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.11126 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.146002 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000003dffff Time: 0.163435 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.136007 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.136036 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.137589 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.119428 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000004affff Time: 0.137223 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000004effff Time: 0.143698 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.176155 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000055ffff Time: 0.166981 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.119051 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000005effff Time: 0.118432 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.122532 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000061ffff Time: 0.160427 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.164085 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000006affff Time: 0.147744 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.110923 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.124811 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.125682 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.146112 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.118457 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.182464 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.146002 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000007effff Time: 0.167525 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.172619 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000008affff Time: 0.156124 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.137216 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.138994 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.114123 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.143431 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x00000000006bffff Time: 0.110923 [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CudnnConvolution) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.162848 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0767019 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.262779 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 6594281472, available: 268435456 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.409568 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.162514 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0765141 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000000003a Time: 0.258379 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 6594281472, available: 268435456 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000000003d Time: 0.425984 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000039 Time: 0.0765141 [07/07/2022-18:30:23] [TRT] [V] Setting workspace to 6594281472enables more tactics for profiling [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CublasConvolution) [07/07/2022-18:30:23] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CaskConvolution) [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.092928 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0937333 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.071136 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.093272 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0x5193693bc0732c65 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x5193693bc0732c65 Time: 0.0719787 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.058256 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.05592 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0588782 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xa0dcf7c2b333d150 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa0dcf7c2b333d150 Time: 0.137436 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0720576 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0751552 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0765461 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x7e29bdfccd92c42c Time: 0.05592 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(4435968,1,29184,192) -> Float(1478656,1,9728,64) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CublasConvolution) [07/07/2022-18:30:23] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CaskConvolution) [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.103269 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.0737216 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.103352 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.0773013 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.086104 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.0990213 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x849891f3d1d80c55 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x849891f3d1d80c55 Time: 0.0984773 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.0733611 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0x90d45931b538d74f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x90d45931b538d74f Time: 0.0754027 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.0992667 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.116654 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x128_relu_exp_interior_nhwc_tn_v1 Tactic: 0xb90177ab6d659acd [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb90177ab6d659acd Time: 0.102085 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xded29d328f8f7228 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xded29d328f8f7228 Time: 0.0851867 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xe957dcfcec24ec5d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xe957dcfcec24ec5d Time: 0.0824149 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 0xf92663d88255134b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xf92663d88255134b Time: 0.0722859 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.0773376 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_simple_t1r1s1_aligna4_alignc4 Tactic: 0xfbba95cf52891795 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xfbba95cf52891795 Time: 0.117504 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0xf92663d88255134b Time: 0.0722859 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xf92663d88255134b [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(4435968,23104,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CudnnConvolution) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.154588 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0683755 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.240016 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 6594281472, available: 268435456 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.40768 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.154279 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000000003a Time: 0.239968 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 6594281472, available: 268435456 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000000003d Time: 0.399392 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0683755 [07/07/2022-18:30:23] [TRT] [V] Setting workspace to 6594281472enables more tactics for profiling [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CublasConvolution) [07/07/2022-18:30:23] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CaskConvolution) [07/07/2022-18:30:23] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000001 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(2217984,23104:2,152,1) -> Half(1478656,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CaskConvolution) [07/07/2022-18:30:23] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(2217984,23104:2,152,1) -> Half(739328,23104:2,152,1) *************** [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (FusedConvActConvolution) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.105899 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000009ffff Time: 0.0768533 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0784576 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000000cffff Time: 0.095048 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.0647804 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0816768 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.0834907 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.084736 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000002effff Time: 0.0790016 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.0581582 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.0805355 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000003dffff Time: 0.0908507 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0779883 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0736683 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0738731 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.0631093 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000004affff Time: 0.0737323 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000004effff Time: 0.0754901 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.093712 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000055ffff Time: 0.091912 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.0647982 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000005effff Time: 0.0604089 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.0653476 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000061ffff Time: 0.0808384 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.086168 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000006affff Time: 0.085832 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.0574116 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.0672939 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.0670101 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.0774315 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.0591076 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0941707 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.0788416 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000007effff Time: 0.086384 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.0899387 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0903467 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.0745237 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.077312 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.0584676 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0733099 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x00000000006bffff Time: 0.0574116 [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CublasConvolution) [07/07/2022-18:30:23] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CaskConvolution) [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0323258 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0322405 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0317013 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0346773 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0348789 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0321532 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0558062 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.0382483 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.031648 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0342933 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0559556 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.0381464 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.0315675 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0560124 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0507764 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0508617 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0341077 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0559893 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0xcc68d30459859090 Time: 0.0315675 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xcc68d30459859090 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(554496,1:8,3648,24) -> Float(1478656,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CublasConvolution) [07/07/2022-18:30:23] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CaskConvolution) [07/07/2022-18:30:23] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(554496,1:8,3648,24) -> Half(184832,1:8,1216,8) *************** [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CudaDepthwiseConvolution) [07/07/2022-18:30:23] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CublasConvolution) [07/07/2022-18:30:23] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:23] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:23] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_54 (CaskConvolution) [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x0129597ad9bbff14 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0129597ad9bbff14 Time: 0.0310187 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x017a89ce2d82b850 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x017a89ce2d82b850 Time: 0.0282436 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.03336 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.0366837 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0321503 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0377873 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0511619 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x249110624ee04937 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x249110624ee04937 Time: 0.0321348 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x255200b1b31c45cd [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x255200b1b31c45cd Time: 0.0604498 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0438707 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0333493 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x2ae5fedb80fbd388 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x2ae5fedb80fbd388 Time: 0.0434787 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x2c6739dc8daca583 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x2c6739dc8daca583 Time: 0.0505371 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.041888 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x3693535b668f43cb [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x3693535b668f43cb Time: 0.0293627 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.0320708 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.0319874 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.031072 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.0310991 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.0409671 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.0335712 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0448947 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.035904 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0374696 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x62a22cfa1199e58e [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x62a22cfa1199e58e Time: 0.028216 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0367243 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0374566 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.041504 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x7585679fc3cc2536 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x7585679fc3cc2536 Time: 0.0386892 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x77a26840a2ace0b3 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x77a26840a2ace0b3 Time: 0.041924 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x77ef8bb029e1d4e0 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x77ef8bb029e1d4e0 Time: 0.046368 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x7ca057c91d677737 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x7ca057c91d677737 Time: 0.0309304 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x7e665af4f37d210b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x7e665af4f37d210b Time: 0.0360597 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x81a7be09ad63581a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x81a7be09ad63581a Time: 0.0311273 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.03232 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x83b35618df65874c [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x83b35618df65874c Time: 0.032833 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0347605 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0490956 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.066784 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0399194 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.0294578 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0616676 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0442333 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0x911cdd8d308bed5c [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x911cdd8d308bed5c Time: 0.0323588 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.046156 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.029832 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0337536 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0335851 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xb26ad7a19a3195cc [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb26ad7a19a3195cc Time: 0.0309392 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xb3989f8802666c8a [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb3989f8802666c8a Time: 0.0382957 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xb5342eac22cbe342 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb5342eac22cbe342 Time: 0.0453467 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xb5fdd9dd73a52c67 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb5fdd9dd73a52c67 Time: 0.0295253 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0331055 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0320999 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.04456 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.0399621 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.043284 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0364832 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0341909 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.0283716 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.0327525 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xdbe57b4edf7481d8 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xdbe57b4edf7481d8 Time: 0.0328514 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0377576 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.0316063 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.0367243 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xe281d0b88acb38b8 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xe281d0b88acb38b8 Time: 0.0658898 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_simple_t1r1s1 Tactic: 0xe2866ff18c9049f9 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xe2866ff18c9049f9 Time: 0.0345728 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.0283573 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.0372409 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.0313949 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0xfbff59172cce263c [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xfbff59172cce263c Time: 0.0317789 [07/07/2022-18:30:23] [TRT] [V] Conv_54 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0337771 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x62a22cfa1199e58e Time: 0.028216 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x62a22cfa1199e58e [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(69312,23104,152,1) -> Float(69312,23104,152,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_72 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00452267 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0564551 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00452267 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(69312,1,456,3) -> Float(69312,23104,1,152,152) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_72 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00579145 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0257042 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00579145 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(2280,760,152:32,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_72 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00791045 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0254187 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00791045 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(69312,23104,152,1) -> Half(69312,23104,152,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_72 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00437721 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0183068 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00437721 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(46208,23104:2,152,1) -> Half(34656,11552,152:2,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_72 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00432314 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0222364 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00432314 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(8664,2888,1:8,19,19) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_72 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00606095 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.021846 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00606095 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(46208,23104,152,1) -> Float(46208,23104,152,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_99 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00433635 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0409695 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00433635 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(46208,1,304,2) -> Float(46208,23104,1,152,152) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_99 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00497584 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0253417 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00497584 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(1520,760,152:32,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_99 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00610114 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0254034 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00610114 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(46208,23104,152,1) -> Half(46208,23104,152,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_99 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00430988 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0153425 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00430988 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(23104,11552,152:2,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_99 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00428622 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.02211 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00428622 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(5776,2888,1:8,19,19) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_99 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00544 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0213747 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00544 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(46208,23104,152,1) -> Float(46208,23104,152,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(46208,1,304,2) -> Float(46208,23104,1,152,152) *************** [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(1520,760,152:32,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(46208,23104,152,1) -> Half(46208,23104,152,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(23104,11552,152:2,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(5776,2888,1:8,19,19) *************** [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(23104,23104,152,1) -> Float(23104,23104,152,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_153 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00432561 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0263114 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00432561 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(23104,1,152,1) -> Float(23104,23104,1,152,152) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_153 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00450617 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0194364 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00450617 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(760,760,152:32,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_153 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00464089 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0259323 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00464089 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(23104,23104,152,1) -> Half(23104,23104,152,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_153 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00430974 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0156291 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00430974 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(11552,11552,152:2,1,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_153 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00424844 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0218527 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00424844 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(2888,2888,1:8,19,19) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Unsqueeze_153 (Shuffle) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.00440014 [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.019549 [07/07/2022-18:30:23] [TRT] [V] Fastest Tactic: 0x0000000000000000 Time: 0.00440014 [07/07/2022-18:30:23] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0x0000000000000000 [07/07/2022-18:30:23] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:23] [TRT] [V] *************** Autotuning format combination: Float(1478656,23104,152,1) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CudaDepthwiseConvolution) [07/07/2022-18:30:23] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:23] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (FusedConvActConvolution) [07/07/2022-18:30:23] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.663211 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000000affff Time: 0.652949 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000000effff Time: 0.616448 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.657589 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.661056 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000001affff Time: 0.801451 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.853429 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.714752 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.667669 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.669429 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.644597 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.661611 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000006effff Time: 0.754923 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.742059 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.744811 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.673451 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.867232 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.664267 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.665888 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.725824 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.642464 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0x00000000000effff Time: 0.616448 [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CudnnConvolution) [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000000 Time: 1.35321 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.866251 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000002 Time: 1.48765 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 10855858176, available: 268435456 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000005 Time: 9.35391 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.744864 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000038 Time: 1.31755 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.841045 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000000003a Time: 1.45543 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 10855858176, available: 268435456 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000000003d Time: 9.20499 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000000003e Time: 0.752277 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0x0000000000000006 Time: 0.744864 [07/07/2022-18:30:24] [TRT] [V] Setting workspace to 10855858176enables more tactics for profiling [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CaskConvolution) [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.669696 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x268494f0a1c83de3 Time: 0.523477 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x64_relu_xregs_large_nn_v1 Tactic: 0x27728c886a448c5a [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x27728c886a448c5a Time: 0.591424 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.660139 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_relu_xregs_large_nn_v1 Tactic: 0x597d29027694c20b [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x597d29027694c20b Time: 0.709152 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.611573 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x62b2ffd9a5c0cfb5 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x62b2ffd9a5c0cfb5 Time: 0.831253 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x8d5c64a52fab02c9 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x8d5c64a52fab02c9 Time: 0.972235 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.609141 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x93a1176336e5b9f6 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x93a1176336e5b9f6 Time: 0.823232 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x994f5b723e2d80da [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x994f5b723e2d80da Time: 0.847989 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x128x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0xac49795b871b0d29 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xac49795b871b0d29 Time: 0.887499 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb6717e61503d5e9b [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xb6717e61503d5e9b Time: 0.851968 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.755275 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.692011 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd1338f4b38d341e2 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd1338f4b38d341e2 Time: 0.856715 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize128x256x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xd2aa21bfe2167c0c [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd2aa21bfe2167c0c Time: 1.23838 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xe40b38338a3a7d7e [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xe40b38338a3a7d7e Time: 0.836267 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0x268494f0a1c83de3 Time: 0.523477 [07/07/2022-18:30:24] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x268494f0a1c83de3 [07/07/2022-18:30:24] [TRT] [V] *************** Autotuning format combination: Float(1478656,1,9728,64) -> Float(7393280,1,48640,320) *************** [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CaskConvolution) [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x128x8_stage1_warpsize2x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x0447933cc2be855a [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0447933cc2be855a Time: 0.991755 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_relu_exp_medium_nhwc_tn_v1 Tactic: 0x0bf55a7b77a6ff98 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0bf55a7b77a6ff98 Time: 0.690165 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0x0e2033f7517a807f [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0e2033f7517a807f Time: 0.682293 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0x2595402367cdee5c [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x2595402367cdee5c Time: 0.912235 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize256x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x3eba442f4c9c4f50 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x3eba442f4c9c4f50 Time: 0.835253 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x43334a9c8840c773 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x43334a9c8840c773 Time: 0.70992 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x48f8d75aa348d22f [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x48f8d75aa348d22f Time: 0.631467 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_relu_exp_small_nhwc_tn_v1 Tactic: 0x50ca8db54378cbac [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x50ca8db54378cbac Time: 0.684032 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x516049bee7812ab0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x516049bee7812ab0 Time: 0.738677 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0x66e3239eee98201e [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x66e3239eee98201e Time: 0.797941 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x810bd80d0531c0a0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x810bd80d0531c0a0 Time: 0.670272 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0x852b455de4263ff7 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x852b455de4263ff7 Time: 0.629685 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: 0x946eca69f99ddcb4 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x946eca69f99ddcb4 Time: 0.677515 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize128x64x8_stage1_warpsize2x2x1_g1_ffma_aligna4_alignc4 Tactic: 0x963db12d24e61b80 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x963db12d24e61b80 Time: 0.716715 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r3s3_aligna4_alignc4 Tactic: 0xb132670a7750e065 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xb132670a7750e065 Time: 0.905909 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x128_relu_exp_large_nhwc_tn_v1 Tactic: 0xca84742beb9f9767 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xca84742beb9f9767 Time: 0.692907 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x64_sliced1x2_ldg4_relu_exp_large_nhwc_tn_v1 Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd2b62ec40baf8ee4 Time: 0.623947 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_aligna4_alignc4 Tactic: 0xde4165142218dab8 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xde4165142218dab8 Time: 0.799947 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_scudnn_128x32_sliced1x4_ldg4_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfa1e150a2da08265 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xfa1e150a2da08265 Time: 0.742155 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0xd2b62ec40baf8ee4 Time: 0.623947 [07/07/2022-18:30:24] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd2b62ec40baf8ee4 [07/07/2022-18:30:24] [TRT] [V] *************** Autotuning format combination: Half(1478656,23104,152,1) -> Half(7393280,23104,152,1) *************** [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.weight] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.bias] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CudnnConvolution) [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000000 Time: 1.20772 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.802069 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000002 Time: 1.2648 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000004 skipped. Scratch requested: 10855858176, available: 268435456 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000005 Time: 9.0341 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000006 Time: 0.775744 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000000038 Time: 1.20359 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000000003a Time: 1.26176 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000000003c skipped. Scratch requested: 10855858176, available: 268435456 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000000003d Time: 9.12928 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000000003e Time: 0.762197 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0x000000000000003e Time: 0.762197 [07/07/2022-18:30:24] [TRT] [V] Setting workspace to 10855858176enables more tactics for profiling [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.weight] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.bias] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CaskConvolution) [07/07/2022-18:30:24] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:24] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x000000000000003e [07/07/2022-18:30:24] [TRT] [V] *************** Autotuning format combination: Half(739328,23104:2,152,1) -> Half(3696640,23104:2,152,1) *************** [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.weight] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.bias] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (FusedConvActConvolution) [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000007ffff Time: 0.327765 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000000affff Time: 0.314907 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000000effff Time: 0.30816 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000000fffff Time: 0.326075 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000019ffff Time: 0.327733 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000001affff Time: 0.477771 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000024ffff Time: 0.525771 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000027ffff Time: 0.364277 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000002dffff Time: 0.322597 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000036ffff Time: 0.319488 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000004cffff Time: 0.324373 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000062ffff Time: 0.332907 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000006effff Time: 0.382293 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000077ffff Time: 0.39984 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000086ffff Time: 0.380715 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000089ffff Time: 0.3308 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000097ffff Time: 0.520875 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000098ffff Time: 0.347925 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000009fffff Time: 0.352043 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000a2ffff Time: 0.394688 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000a4ffff Time: 0.334139 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0x00000000000effff Time: 0.30816 [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.weight] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.bias] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CaskConvolution) [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x0fe4a9cce7ed878b [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0fe4a9cce7ed878b Time: 0.328672 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.320416 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.320779 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.317419 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: 0x4092cbc840fbea35 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x4092cbc840fbea35 Time: 0.320581 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.337237 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.337792 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.312331 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.366187 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0x98a00f59a4b141f0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x98a00f59a4b141f0 Time: 0.354304 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.332965 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.374443 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xcbe3f30275b04323 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xcbe3f30275b04323 Time: 0.382859 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.375253 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd46b3ee2b59f893c Time: 0.263813 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 0xd7d66d5d03a72c4e [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd7d66d5d03a72c4e Time: 0.340651 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.333723 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.374816 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: 0xfc994367fd14b2d9 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xfc994367fd14b2d9 Time: 0.382805 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0xd46b3ee2b59f893c Time: 0.263813 [07/07/2022-18:30:24] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd46b3ee2b59f893c [07/07/2022-18:30:24] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8) -> Float(7393280,23104,152,1) *************** [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.weight] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.bias] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CaskConvolution) [07/07/2022-18:30:24] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:24] [TRT] [V] *************** Autotuning format combination: Half(184832,1:8,1216,8) -> Half(924160,1:8,6080,40) *************** [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.weight] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.bias] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CudaDepthwiseConvolution) [07/07/2022-18:30:24] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.weight] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.bias] had the following issues when converted to FP16: [07/07/2022-18:30:24] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:24] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 (CaskConvolution) [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x00a425145e84482b [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00a425145e84482b Time: 0.282272 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x03512591e8ea2977 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x03512591e8ea2977 Time: 0.227648 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x0559d1d2893a8768 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0559d1d2893a8768 Time: 0.308363 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x095000b22a78f234 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x095000b22a78f234 Time: 0.167904 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x0b906efbde4dc01a [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0b906efbde4dc01a Time: 0.233131 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x0c0088d5808566d2 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0c0088d5808566d2 Time: 0.15307 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x0caa5410b61e6cc5 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0caa5410b61e6cc5 Time: 0.273253 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x0e0f7f10867063ba [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0e0f7f10867063ba Time: 0.135623 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x0e131ddbafdfe235 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0e131ddbafdfe235 Time: 0.189392 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x0ecf8dc91198fd5e [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0ecf8dc91198fd5e Time: 0.127883 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0x159236c6c22f62ce [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x159236c6c22f62ce Time: 0.270683 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x15ecbd82c22a023f [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x15ecbd82c22a023f Time: 0.122887 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x18ef97651ad5379a [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x18ef97651ad5379a Time: 0.226837 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x1981adfb6b6fd8b9 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x1981adfb6b6fd8b9 Time: 0.23776 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0x1b099f7ac29a2a6a [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x1b099f7ac29a2a6a Time: 0.201115 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x1b9cb8d78519a728 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x1b9cb8d78519a728 Time: 0.255349 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0x1c23f4a19fbcb518 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x1c23f4a19fbcb518 Time: 0.194741 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.132103 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x1de724868edf11b0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x1de724868edf11b0 Time: 0.153422 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.144587 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x30150d05024bc911 Time: 0.125358 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x32789ed2e6c7b43b [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x32789ed2e6c7b43b Time: 0.122325 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x33fc6102b341eb5d [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x33fc6102b341eb5d Time: 0.283259 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.219504 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x348653930e0a64e2 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x348653930e0a64e2 Time: 0.235573 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x350e898a5a20ad00 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x350e898a5a20ad00 Time: 0.139765 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x36662b4d547eefc7 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x36662b4d547eefc7 Time: 0.185365 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x490a097d77573bff [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x490a097d77573bff Time: 0.126809 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x4c6a6da741444412 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x4c6a6da741444412 Time: 0.172448 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x4e34a65090c3b86f [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x4e34a65090c3b86f Time: 0.119307 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0x504f864880743a14 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x504f864880743a14 Time: 0.290789 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x5128cdf162fe56b6 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x5128cdf162fe56b6 Time: 0.184128 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.234816 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r3s3 Tactic: 0x5252dc6c9c5f3aff [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x5252dc6c9c5f3aff Time: 0.218219 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4 Tactic: 0x54b287be85c1522c [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x54b287be85c1522c Time: 0.27792 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x55fb34a08663e5ae [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x55fb34a08663e5ae Time: 0.218261 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x56c66ffbce24b635 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x56c66ffbce24b635 Time: 0.198645 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x58eea09dffe038fd [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x58eea09dffe038fd Time: 0.164661 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x5bec1fbd955eb827 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x5bec1fbd955eb827 Time: 0.175216 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.198341 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x62bb371b230a886d [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x62bb371b230a886d Time: 0.212304 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.194784 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x69a5b2ac9c5bac16 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x69a5b2ac9c5bac16 Time: 0.16154 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x6b44e6396887bed9 Time: 0.174645 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x6cde8847e8cd796b [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x6cde8847e8cd796b Time: 0.190437 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x6cee4d9c86b4cdd5 Time: 0.164185 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.196635 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r3s3 Tactic: 0x721049a39aae27ff [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x721049a39aae27ff Time: 0.277888 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.217808 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8 Tactic: 0x75585ae3e9dedb93 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x75585ae3e9dedb93 Time: 0.235595 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x784dcede905d06c0 Time: 0.173408 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.134162 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0x86903737887c556d [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x86903737887c556d Time: 0.168683 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0x8781623566dac7f0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x8781623566dac7f0 Time: 0.133355 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0x8b86a8bb857fff79 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x8b86a8bb857fff79 Time: 0.226677 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x8d73ddfc444be692 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x8d73ddfc444be692 Time: 0.154091 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8 Tactic: 0x9650edb797f919f3 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x9650edb797f919f3 Time: 0.157102 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0x969b1abbb567ac47 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x969b1abbb567ac47 Time: 0.23856 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0x9a0f43b4d1dc46d4 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x9a0f43b4d1dc46d4 Time: 0.278005 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa13cdf70a9d99d45 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xa13cdf70a9d99d45 Time: 0.242181 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xa2dad76f719680b5 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xa2dad76f719680b5 Time: 0.21792 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4 Tactic: 0xa3e778b253a14ca9 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xa3e778b253a14ca9 Time: 0.297189 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8 Tactic: 0xa5f0bcb42cb01fc7 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xa5f0bcb42cb01fc7 Time: 0.194251 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r3s3 Tactic: 0xa84824f86c61d2d8 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xa84824f86c61d2d8 Time: 0.188965 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.13973 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xab9c5449bde6902c [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xab9c5449bde6902c Time: 0.127083 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xac4736b5b00e1531 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xac4736b5b00e1531 Time: 0.182219 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.136082 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xb0bf64026e546f4d [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xb0bf64026e546f4d Time: 0.155026 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xb26e93bd0702f504 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xb26e93bd0702f504 Time: 0.236709 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xb307bc772518d3d7 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xb307bc772518d3d7 Time: 0.168064 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8 Tactic: 0xb7dc3705357cc965 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xb7dc3705357cc965 Time: 0.125703 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_large_nhwc_tn_v1 Tactic: 0xbb3d6545e4864f26 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xbb3d6545e4864f26 Time: 0.144992 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xbfc71f913e286527 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xbfc71f913e286527 Time: 0.204128 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.234608 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xc684285f13ba11d0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xc684285f13ba11d0 Time: 0.20232 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xc6e0905d983b4a62 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xc6e0905d983b4a62 Time: 0.266336 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4 Tactic: 0xc8ee1e4cdf0d8f84 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xc8ee1e4cdf0d8f84 Time: 0.270805 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0xcb7b50f35a87094b [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xcb7b50f35a87094b Time: 0.224123 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd076fab92f5706c9 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd076fab92f5706c9 Time: 0.152629 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0xd297ae2cdb8b1406 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd297ae2cdb8b1406 Time: 0.168981 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.190507 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.115605 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4 Tactic: 0xd825f95894186a22 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd825f95894186a22 Time: 0.289045 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xd9d1d89fceeca81a [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xd9d1d89fceeca81a Time: 0.227408 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r3s3 Tactic: 0xdb70c5e9779254fb [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xdb70c5e9779254fb Time: 0.248165 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.143972 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xe84b9aaa289245c0 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xe84b9aaa289245c0 Time: 0.174496 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4 Tactic: 0xe9fa7b19132889a8 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xe9fa7b19132889a8 Time: 0.228011 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4 Tactic: 0xf1d5fc0783e71536 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xf1d5fc0783e71536 Time: 0.244475 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8 Tactic: 0xf368aae1fb20baa1 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xf368aae1fb20baa1 Time: 0.172757 [07/07/2022-18:30:24] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.117643 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0xd47a5fce3824e4a4 Time: 0.115605 [07/07/2022-18:30:24] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:24] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:24] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_67 (CudaDepthwiseConvolution) [07/07/2022-18:30:24] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_67 (FusedConvActConvolution) [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0332878 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0286018 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0291689 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.0304456 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0309779 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.0280862 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0291102 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0256689 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0255307 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000004affff Time: 0.02592 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0297253 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0311835 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.0273854 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0320572 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.0274215 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0303758 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.0324024 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0325876 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.0258494 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0278053 [07/07/2022-18:30:24] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0265912 [07/07/2022-18:30:24] [TRT] [V] Fastest Tactic: 0x000000000045ffff Time: 0.0255307 [07/07/2022-18:30:24] [TRT] [V] --------------- Timing Runner: Conv_67 (CudnnConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021872 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0219627 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0838667 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.986368 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.263947 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0218033 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0220013 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003a Time: 0.08392 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003c Time: 0.980469 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003d Time: 0.263717 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x0000000000000038 Time: 0.0218033 [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.038989 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0393244 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0206958 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.039136 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.024669 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0239025 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0250682 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0299956 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0178173 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.020539 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0178173 [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(69312,1,456,3) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0309285 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0492084 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x704db0897ce9340d Time: 0.0309285 [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x704db0897ce9340d [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CudnnConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.029376 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.03008 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0790464 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000004 Time: 1.01143 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.111109 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0290916 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003a Time: 0.078784 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003c Time: 0.991936 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003d Time: 0.112978 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x0000000000000038 Time: 0.0290916 [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000038 [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (FusedConvActConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0182097 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0182552 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.020224 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.019411 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0237852 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.0192444 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0216113 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0170544 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0184994 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000004affff Time: 0.0180671 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0194163 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0237788 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.017184 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0194625 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.018478 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0189108 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.0193505 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0238865 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.0181238 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0191959 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0164932 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x0000000000a6ffff Time: 0.0164932 [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0141596 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0142049 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0139653 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0112971 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0112405 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.013888 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0269465 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.0108951 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.0139862 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0110245 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0271869 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.0108852 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.0140124 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0271138 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0226773 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.02256 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0110796 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0272148 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0xc72182f0fce13bb0 Time: 0.0108852 [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CudaDepthwiseConvolution) [07/07/2022-18:30:25] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_67 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.0144853 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.0149273 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0102697 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0172453 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0331724 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0189659 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0141182 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0195253 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.0134874 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.0102355 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.00887102 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.0113732 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.0193849 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.0105393 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0195787 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.0171915 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0167909 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0151612 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0167125 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.019685 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0107193 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0132238 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0229163 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.03856 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0185239 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.012563 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0320863 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0195905 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0231189 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.010596 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0149412 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0148661 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0132763 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0114578 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0194335 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.0176051 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0253006 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0150238 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0144213 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.0102035 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.00975878 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.017408 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.00949511 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.0164871 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.0112956 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.0169093 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.0110455 [07/07/2022-18:30:25] [TRT] [V] Conv_67 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0145925 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x41e8a431d0137286 Time: 0.00887102 [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:25] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CudaDepthwiseConvolution) [07/07/2022-18:30:25] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (FusedConvActConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0324625 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0277547 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.0334837 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0285369 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.0297031 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0301947 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.0293369 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.0275348 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0283413 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0253166 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0250491 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.0348917 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000004affff Time: 0.0252518 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000004effff Time: 0.0367712 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.0450827 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.0352085 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000005effff Time: 0.0300027 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.0333931 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0291893 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0302338 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.0276669 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.0364299 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.0335691 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.026272 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.0295644 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0315665 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.0267528 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0300276 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.0318342 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0315539 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.0252152 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0271204 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.0286996 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0265313 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x000000000045ffff Time: 0.0250491 [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CudnnConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0213587 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0207837 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.083136 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.770048 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.266779 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0212453 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0208364 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0833813 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003c Time: 0.773643 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003d Time: 0.263648 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0207837 [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0388646 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0393351 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.019867 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.0389973 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0245379 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.023552 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0247947 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0298329 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0168784 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0200471 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0168784 [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(46208,1,304,2) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.0306628 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.049117 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x704db0897ce9340d Time: 0.0306628 [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x704db0897ce9340d [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CudnnConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0296302 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0302089 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0780032 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.770048 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.108296 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.029384 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003a Time: 0.078208 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003c Time: 0.785067 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000000003d Time: 0.108269 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x0000000000000038 Time: 0.029384 [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000038 [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (FusedConvActConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0164023 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.016936 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000011ffff Time: 0.0223381 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0191917 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.0179587 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0218873 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000035ffff Time: 0.0182288 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.01797 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0201336 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0159858 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0168277 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000046ffff Time: 0.0237874 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000004affff Time: 0.016608 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000004effff Time: 0.0238766 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000051ffff Time: 0.0273895 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000059ffff Time: 0.023749 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000005effff Time: 0.0189001 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000005fffff Time: 0.0223068 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0181721 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000006affff Time: 0.02194 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000006bffff Time: 0.0173189 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000006fffff Time: 0.0240678 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000070ffff Time: 0.0222393 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.0160005 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000075ffff Time: 0.0181738 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0185292 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.0172101 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0178038 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.0186281 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0221233 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.0166278 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.018144 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000a3ffff Time: 0.0177718 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0151448 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x0000000000a6ffff Time: 0.0151448 [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.0141187 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0142182 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0139387 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0111904 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0112206 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0139742 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0270523 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.0108852 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.0139476 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.0110548 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0272 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.0108883 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.0140436 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0270933 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0226105 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0225813 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0109977 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0272328 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x97afba3735828021 Time: 0.0108852 [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x97afba3735828021 [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CudaDepthwiseConvolution) [07/07/2022-18:30:25] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_94 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.0145452 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.0147409 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0102982 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0173104 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.0332121 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0191834 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0141262 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.0194542 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.0135642 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.0101893 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.00881965 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.0113604 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.0193387 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.0104673 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.0195236 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.0171909 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0168123 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.01504 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0166273 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0196323 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0107247 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0131811 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.0227342 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.0388551 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0183972 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.0126408 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0320679 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0191093 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.022762 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.0105767 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0149454 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0148095 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0132258 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0114037 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0194542 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.0179391 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0252175 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0149236 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0144431 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.0102229 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.00965486 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0174971 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.00953417 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.0165247 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.011073 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.0168907 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.0111897 [07/07/2022-18:30:25] [TRT] [V] Conv_94 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0149018 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x41e8a431d0137286 Time: 0.00881965 [07/07/2022-18:30:25] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:25] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(46208,1,304,2) *************** [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_121.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_121.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_121 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_121.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_121.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_121 (CublasConvolution) [07/07/2022-18:30:25] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_121.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_121 (CaskConvolution) [07/07/2022-18:30:25] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:25] [TRT] [W] Weights [name=Conv_121.weight] had the following issues when converted to FP16: [07/07/2022-18:30:25] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:25] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:25] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:25] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_148 (CudaDepthwiseConvolution) [07/07/2022-18:30:25] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_148 (FusedConvActConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0314754 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0274962 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0281493 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.0293858 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.029832 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.0271409 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0280364 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0248785 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0246674 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000004affff Time: 0.0249844 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0287058 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000006affff Time: 0.0297653 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.0257149 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.031231 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.0262646 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0297644 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.0316945 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0313425 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.0249402 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0265904 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0260029 [07/07/2022-18:30:25] [TRT] [V] Fastest Tactic: 0x000000000045ffff Time: 0.0246674 [07/07/2022-18:30:25] [TRT] [V] --------------- Timing Runner: Conv_148 (CudnnConvolution) [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.021052 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0207429 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0355104 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.57248 [07/07/2022-18:30:25] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.262064 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0208038 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000039 Time: 0.0206971 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0351531 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000000003c Time: 0.579787 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000000003d Time: 0.268629 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000039 Time: 0.0206971 [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x128_relu_interior_nn_v1 Tactic: 0x18597bd4a7d0164d [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x18597bd4a7d0164d Time: 0.0388444 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x128_relu_medium_nn_v1 Tactic: 0x195431d38ba5af88 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x195431d38ba5af88 Time: 0.0392249 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x32_relu_interior_nn_v1 Tactic: 0x25eed4cfa195d49d [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x25eed4cfa195d49d Time: 0.0197892 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x128_relu_small_nn_v1 Tactic: 0x365602d0613d4c36 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x365602d0613d4c36 Time: 0.0389867 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x64_relu_small_nn_v1 Tactic: 0x5e7d1125e7896624 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x5e7d1125e7896624 Time: 0.0245143 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x64_relu_interior_nn_v1 Tactic: 0x7e29bdfccd92c42c [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x7e29bdfccd92c42c Time: 0.0236075 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x64_relu_medium_nn_v1 Tactic: 0x90238daf8750ddb0 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x90238daf8750ddb0 Time: 0.0247154 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nchwkcrs_nchw_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa3cd285aae791bdd [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xa3cd285aae791bdd Time: 0.0299129 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x32_relu_medium_nn_v1 Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0168443 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_scudnn_128x32_relu_small_nn_v1 Tactic: 0xc939b7b0a4d5a05f [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xc939b7b0a4d5a05f Time: 0.0199799 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0xc2a5fc6b5e7cef5e Time: 0.0168443 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0xc2a5fc6b5e7cef5e [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(23104,1,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x64x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0x704db0897ce9340d [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x704db0897ce9340d Time: 0.030432 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f32f32_f32f32_f32_nhwckrsc_nhwc_tilesize64x128x8_stage1_warpsize1x4x1_g1_ffma_t1r1s1_aligna4_alignc4 Tactic: 0xa79cf41de521f476 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xa79cf41de521f476 Time: 0.0488198 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x704db0897ce9340d Time: 0.030432 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x704db0897ce9340d [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CudnnConvolution) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000000 Time: 0.0284284 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0292373 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.0268193 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.570336 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000005 Time: 0.100379 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000038 Time: 0.0288089 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000000003a Time: 0.0269063 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000000003c Time: 0.585643 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000000003d Time: 0.0991627 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000002 Time: 0.0268193 [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0x0000000000000002 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (FusedConvActConvolution) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000008ffff Time: 0.0178616 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000bffff Time: 0.0179509 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000018ffff Time: 0.0198758 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000001bffff Time: 0.01912 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000001fffff Time: 0.0234169 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000003cffff Time: 0.01888 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000040ffff Time: 0.0213913 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000041ffff Time: 0.0168256 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000045ffff Time: 0.0181243 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000004affff Time: 0.0177493 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000066ffff Time: 0.0190139 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000006affff Time: 0.023446 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000073ffff Time: 0.0167989 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000007cffff Time: 0.0190175 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000007dffff Time: 0.0180525 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000007effff Time: 0.0185215 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000083ffff Time: 0.0187342 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000008affff Time: 0.0236366 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x000000000091ffff Time: 0.0177622 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000009dffff Time: 0.0189973 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000a6ffff Time: 0.0162006 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000a6ffff Time: 0.0162006 [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x16eafdbc5869b184 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x16eafdbc5869b184 Time: 0.014144 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 0x21904dd9d0cd407e [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x21904dd9d0cd407e Time: 0.0505971 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x3bee4a098b4f8914 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x3bee4a098b4f8914 Time: 0.0140058 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x446c8c788145836a [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x446c8c788145836a Time: 0.0112565 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 0x73163c1d09e17290 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x73163c1d09e17290 Time: 0.0111993 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: 0x7498280d2c59e4aa [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x7498280d2c59e4aa Time: 0.0139396 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0x87e5c2a636a0d1f8 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x87e5c2a636a0d1f8 Time: 0.0271253 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0x97afba3735828021 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x97afba3735828021 Time: 0.0108597 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0x9ce6ebc390e62b01 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x9ce6ebc390e62b01 Time: 0.0139662 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xacaaec9cc8134f6f [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xacaaec9cc8134f6f Time: 0.01104 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: 0xb09f72c3be042002 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xb09f72c3be042002 Time: 0.0271623 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 0xc72182f0fce13bb0 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xc72182f0fce13bb0 Time: 0.0108893 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 0xcc68d30459859090 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xcc68d30459859090 Time: 0.014004 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xccca8c966967f8f8 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xccca8c966967f8f8 Time: 0.0271483 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdb5acaea7b0746d5 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xdb5acaea7b0746d5 Time: 0.0226311 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: 0xdcd3fec139dd130a [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xdcd3fec139dd130a Time: 0.0225906 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 0xe3dc8e986f0522d1 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xe3dc8e986f0522d1 Time: 0.0109822 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: 0xe4aed86f94a0620c [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xe4aed86f94a0620c Time: 0.0271984 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x97afba3735828021 Time: 0.0108597 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x97afba3735828021 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CudaDepthwiseConvolution) [07/07/2022-18:30:26] [TRT] [V] CudaDepthwiseConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_148 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x105f56cf03ee5549 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x105f56cf03ee5549 Time: 0.0144276 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x1d38ef2fc1ec5804 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x1d38ef2fc1ec5804 Time: 0.0146931 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x1dcf9babce3d9b3b Time: 0.0104473 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x21739cdb4c6113ed [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x21739cdb4c6113ed Time: 0.0170523 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor16x8x8_t1r1s1 Tactic: 0x22dbd03ae6f5a915 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x22dbd03ae6f5a915 Time: 0.033344 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x26d4c2773a9a6efc [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x26d4c2773a9a6efc Time: 0.0194329 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x2a3615ad33745f0b Time: 0.0140778 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x34192289eb1f5427 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x34192289eb1f5427 Time: 0.019379 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x399448b5af8ca81a [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x399448b5af8ca81a Time: 0.0135168 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x3f3840edab5c9d44 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x3f3840edab5c9d44 Time: 0.0103855 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x41e8a431d0137286 Time: 0.0088887 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x4c17dc9d992e6a1d [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x4c17dc9d992e6a1d Time: 0.0113333 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x4ea23ec81add686f [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x4ea23ec81add686f Time: 0.0193079 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x51e3312bfd062f36 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x51e3312bfd062f36 Time: 0.010674 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x523aca1fca7ef548 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x523aca1fca7ef548 Time: 0.019536 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x53422c5d4478d3d7 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x53422c5d4478d3d7 Time: 0.0171477 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x5cb7625ea24db701 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x5cb7625ea24db701 Time: 0.0165217 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x63566dea68ccc247 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x63566dea68ccc247 Time: 0.0149978 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x6d1428d5257a3dc9 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x6d1428d5257a3dc9 Time: 0.0165338 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x72f623a1c870d417 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x72f623a1c870d417 Time: 0.0195591 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0x833510adbbf772c4 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x833510adbbf772c4 Time: 0.0108119 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x83c3f470a0ec89f9 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x83c3f470a0ec89f9 Time: 0.0131446 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8480e919254b99f8 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x8480e919254b99f8 Time: 0.022939 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x256x64_stage1_warpsize1x4x2_g1_tensor8x8x4_t1r1s1 Tactic: 0x8639a0d23c8a1708 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x8639a0d23c8a1708 Time: 0.0387188 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x86937c170a111d1f [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x86937c170a111d1f Time: 0.0184129 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x89c2d153627e52ba [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x89c2d153627e52ba Time: 0.0126214 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x8a37d1d6d41033e6 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x8a37d1d6d41033e6 Time: 0.0320669 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x8b8a7a5cef8d932b [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x8b8a7a5cef8d932b Time: 0.0190945 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x128x32_stage1_warpsize4x2x1_g1_tensor8x8x4_t1r1s1 Tactic: 0x93125939e1fba374 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x93125939e1fba374 Time: 0.0226745 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x64x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x9774d044044b6a7d [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x9774d044044b6a7d Time: 0.0105907 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xa8f10051cbdaaa96 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xa8f10051cbdaaa96 Time: 0.0147228 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xaf407014f2c7f1cb Time: 0.0147172 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xb8eb6a106c53cff6 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xb8eb6a106c53cff6 Time: 0.0132185 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xba86f9c788dfb2dc [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xba86f9c788dfb2dc Time: 0.0114276 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xc110e19c9f5aa36e [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xc110e19c9f5aa36e Time: 0.0193025 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x128x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc399fdbffdc34032 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xc399fdbffdc34032 Time: 0.0181283 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x256x32_stage1_warpsize2x4x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xc6f99965cbd03fdf [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xc6f99965cbd03fdf Time: 0.0251718 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd313af1c92b241c4 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xd313af1c92b241c4 Time: 0.0148294 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xd47a5fce3824e4a4 Time: 0.0143413 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor16x8x8_t1r1s1 Tactic: 0xd8c128ae16cb4132 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xd8c128ae16cb4132 Time: 0.0102122 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor8x8x4_t1r1s1 Tactic: 0xdadc728a0ae041d9 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xdadc728a0ae041d9 Time: 0.00980419 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xdc1c841ef1cd3e8e [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xdc1c841ef1cd3e8e Time: 0.0172651 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xdc559b3944b0cdf8 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xdc559b3944b0cdf8 Time: 0.00955246 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: volta_h884cudnn_256x64_sliced1x2_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xde62c240f3a7d930 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xde62c240f3a7d930 Time: 0.016285 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xe67db95e0c20b618 Time: 0.0111648 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_256x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0xef1e5139c624a44f [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xef1e5139c624a44f Time: 0.0167387 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: sm70_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x32x64_stage1_warpsize2x1x2_g1_tensor8x8x4_t1r1s1 Tactic: 0xf883bd61103a5c32 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xf883bd61103a5c32 Time: 0.0112366 [07/07/2022-18:30:26] [TRT] [V] Conv_148 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_medium_nhwc_tn_v1 Tactic: 0xfcd06da0f3c31fd1 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0xfcd06da0f3c31fd1 Time: 0.0148257 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x41e8a431d0137286 Time: 0.0088887 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,23104,152,1) -> Float(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1,456,3) -> Float(69312,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(2280,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,23104,152,1) -> Half(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104:2,152,1) -> Half(34656,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(8664,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(46208,23104,152,1) -> Float(46208,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(46208,1,304,2) -> Float(46208,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(1520,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104,152,1) -> Half(46208,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(23104,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(5776,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(46208,23104,152,1) -> Float(46208,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(46208,1,304,2) -> Float(46208,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(1520,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104,152,1) -> Half(46208,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(23104,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(5776,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104,152,1) -> Float(23104,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,1,152,1) -> Float(23104,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(760,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,23104,152,1) -> Half(23104,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(11552,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(2888,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(69312,1,456,3) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_70 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_70 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_70 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(46208,1,304,2) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_97.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_97.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_97 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_97.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_97.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_97 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_97.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_97 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_97.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(46208,1,304,2) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_124 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_124 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_124 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(23104,1,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_151.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_151.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_151 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(23104,23104:2,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_151.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_151.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_151 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_151.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_151 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_151.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,23104,152,1) -> Float(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1,456,3) -> Float(69312,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(2280,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,23104,152,1) -> Half(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104:2,152,1) -> Half(34656,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(8664,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(46208,23104,152,1) -> Float(46208,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(46208,1,304,2) -> Float(46208,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(1520,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104,152,1) -> Half(46208,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(23104,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(5776,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(46208,23104,152,1) -> Float(46208,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(46208,1,304,2) -> Float(46208,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(1520,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104,152,1) -> Half(46208,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(23104,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(5776,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104,152,1) -> Float(23104,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,1,152,1) -> Float(23104,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(760,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,23104,152,1) -> Half(23104,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,23104:2,152,1) -> Half(11552,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(2888,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_78 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.579563 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003e9 Time: 0.0624391 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x00000000000003e9 Time: 0.0624391 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 0x00000000000003e9 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_78 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.589749 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003e9 Time: 0.06224 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x00000000000003e9 Time: 0.06224 [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_78 (CaskSoftMax) [07/07/2022-18:30:26] [TRT] [V] Softmax_78 Set Tactic Name: cutlass_softmax_fwd_scalar_fp16_accurate_channel Tactic: 0x0cf7b28fb5e72618 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0cf7b28fb5e72618 Time: 0.635445 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0cf7b28fb5e72618 Time: 0.635445 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 0x00000000000003e9 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(103968,34656,456:2,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_78 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] CudaSoftMax has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_105 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.390037 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003e9 Time: 0.042116 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x00000000000003e9 Time: 0.042116 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 0x00000000000003e9 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_105 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.397013 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003e9 Time: 0.041888 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x00000000000003e9 Time: 0.041888 [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_105 (CaskSoftMax) [07/07/2022-18:30:26] [TRT] [V] Softmax_105 Set Tactic Name: cutlass_softmax_fwd_scalar_fp16_accurate_channel Tactic: 0x0cf7b28fb5e72618 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0cf7b28fb5e72618 Time: 0.428032 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0cf7b28fb5e72618 Time: 0.428032 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 0x00000000000003e9 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,34656,456:2,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_105 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] CudaSoftMax has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,34656,456:2,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_132 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] CudaSoftMax has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,69312,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_159 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.192656 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003e9 Time: 0.0220773 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x00000000000003e9 Time: 0.0220773 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 0x00000000000003e9 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,69312,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_159 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003ea Time: 0.196048 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x00000000000003e9 Time: 0.0218913 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x00000000000003e9 Time: 0.0218913 [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_159 (CaskSoftMax) [07/07/2022-18:30:26] [TRT] [V] Softmax_159 Set Tactic Name: cutlass_softmax_fwd_scalar_fp16_accurate_channel Tactic: 0x0cf7b28fb5e72618 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0cf7b28fb5e72618 Time: 0.212208 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0cf7b28fb5e72618 Time: 0.212208 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: CudaSoftMax Tactic: 0x00000000000003e9 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(34656,34656,456:2,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_159 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] CudaSoftMax has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(207936,69312,456,3,1), Float(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_79 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00472113 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00472113 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(6840,2280,456:32,3,1), Float(6840,2280,456:32,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_79 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00521867 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00521867 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1:4,456,3,1), Float(69312,1:4,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_79 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00473149 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.00756267 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00473149 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(207936,69312,456,3,1), Half(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_79 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00402596 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00402596 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(103968,34656,456:2,3,1), Half(103968,34656,456:2,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_79 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00400279 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00400279 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(25992,8664,1:8,57,19), Half(25992,8664,1:8,57,19) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_79 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00403778 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00403778 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,1:8,456,3,1), Half(69312,1:8,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_79 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00477882 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00477882 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(138624,69312,456,3,1), Float(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_106 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00400025 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00400025 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(4560,2280,456:32,3,1), Float(4560,2280,456:32,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_106 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00455813 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00455813 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1:4,456,3,1), Float(69312,1:4,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_106 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00467792 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.00755413 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00467792 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(138624,69312,456,3,1), Half(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_106 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00387882 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00387882 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,34656,456:2,3,1), Half(69312,34656,456:2,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_106 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.003992 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.003992 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(17328,8664,1:8,57,19), Half(17328,8664,1:8,57,19) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_106 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00397105 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00397105 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,1:8,456,3,1), Half(69312,1:8,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_106 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0048371 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0048371 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(138624,69312,456,3,1), Float(138624,69312,456,3,1) -> Float(138624,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_133 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00404536 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00404536 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(4560,2280,456:32,3,1), Float(4560,2280,456:32,3,1) -> Float(4560,2280,456:32,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_133 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00460449 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00460449 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1:4,456,3,1), Float(69312,1:4,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_133 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00468341 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.00760873 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00468341 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(138624,69312,456,3,1), Half(138624,69312,456,3,1) -> Half(138624,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_133 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00396311 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00396311 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,34656,456:2,3,1), Half(69312,34656,456:2,3,1) -> Half(69312,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_133 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00398781 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00398781 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(17328,8664,1:8,57,19), Half(17328,8664,1:8,57,19) -> Half(17328,8664,1:8,57,19) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_133 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00398959 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00398959 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,1:8,456,3,1), Half(69312,1:8,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_133 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00480457 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00480457 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,69312,456,3,1), Float(69312,69312,456,3,1) -> Float(69312,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_160 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00393713 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00393713 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(2280,2280,456:32,3,1), Float(2280,2280,456:32,3,1) -> Float(2280,2280,456:32,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_160 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0039621 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0039621 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1:4,456,3,1), Float(69312,1:4,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_160 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00472729 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.00759709 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00472729 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,69312,456,3,1), Half(69312,69312,456,3,1) -> Half(69312,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_160 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00393412 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00393412 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(34656,34656,456:2,3,1), Half(34656,34656,456:2,3,1) -> Half(34656,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_160 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.0039821 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.0039821 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(8664,8664,1:8,57,19), Half(8664,8664,1:8,57,19) -> Half(8664,8664,1:8,57,19) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_160 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00394516 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00394516 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,1:8,456,3,1), Half(69312,1:8,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_160 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00484607 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00484607 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(207936,69312,456,3,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_81 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.969632 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00459134 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00453506 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00467511 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00469724 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000004 Time: 0.00453506 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000004 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(207936,69312,456,3,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_81 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.98016 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00455769 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00458345 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00469619 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00475177 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000003 Time: 0.00455769 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000003 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(138624,69312,456,3,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_108 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.647755 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00447417 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00448071 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00446435 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00452973 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000007 Time: 0.00446435 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000007 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(138624,69312,456,3,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_108 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.662731 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00452166 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00447502 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00447289 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00453117 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000007 Time: 0.00447289 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000007 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(138624,69312,456,3,1) -> Float(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_135 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.655893 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00456043 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00451315 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00451618 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00450796 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000008 Time: 0.00450796 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000008 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(138624,69312,456,3,1) -> Half(46208,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_135 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.653995 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00452858 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00451777 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00450652 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00455207 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000007 Time: 0.00450652 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000007 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,69312,456,3,1) -> Float(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_162 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.325792 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00441628 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00443481 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00442877 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00445938 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000003 Time: 0.00441628 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000003 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,69312,456,3,1) -> Half(23104,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_162 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.329045 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00441389 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00449067 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00447644 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00444942 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000003 Time: 0.00441389 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000003 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(69312,1,456,3) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_175.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_175.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_175 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_175.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_175.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_175 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_175.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_175 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_175.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,23104,152,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(7393280,1,48640,320) -> Float(69312,1,456,3) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(7393280,23104,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_178.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_178.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_178 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(3696640,23104:2,152,1) -> Half(46208,23104:2,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_178.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_178.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_178 (CublasConvolution) [07/07/2022-18:30:26] [TRT] [V] CublasConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_178.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Conv_178 (CaskConvolution) [07/07/2022-18:30:26] [TRT] [V] CaskConvolution has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(924160,1:8,6080,40) -> Half(23104,1:8,152,1) *************** [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_178.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,23104,152,1) -> Float(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1,456,3) -> Float(69312,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(2280,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,23104,152,1) -> Half(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104:2,152,1) -> Half(34656,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(8664,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,23104,152,1) -> Float(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1,456,3) -> Float(69312,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(2280,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,23104,152,1) -> Half(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104:2,152,1) -> Half(34656,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(8664,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,23104,152,1) -> Float(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1,456,3) -> Float(69312,23104,1,152,152) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(23104,23104:32,152,1) -> Float(2280,760,152:32,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,23104,152,1) -> Half(69312,23104,152,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(46208,23104:2,152,1) -> Half(34656,11552,152:2,1,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(23104,1:8,152,1) -> Half(8664,2888,1:8,19,19) *************** [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(103968,34656,456:2,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Softmax_186 (CudaSoftMax) [07/07/2022-18:30:26] [TRT] [V] CudaSoftMax has no valid tactics for this config, skipping [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(207936,69312,456,3,1), Float(207936,69312,456,3,1) -> Float(207936,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_187 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00453751 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00453751 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(6840,2280,456:32,3,1), Float(6840,2280,456:32,3,1) -> Float(6840,2280,456:32,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_187 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00527017 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00527017 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(69312,1:4,456,3,1), Float(69312,1:4,456,3,1) -> Float(69312,1:4,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_187 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00467393 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000002 Time: 0.00756717 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00467393 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(207936,69312,456,3,1), Half(207936,69312,456,3,1) -> Half(207936,69312,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_187 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00403817 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00403817 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(103968,34656,456:2,3,1), Half(103968,34656,456:2,3,1) -> Half(103968,34656,456:2,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_187 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00405269 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00405269 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(25992,8664,1:8,57,19), Half(25992,8664,1:8,57,19) -> Half(25992,8664,1:8,57,19) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_187 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00406927 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00406927 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(69312,1:8,456,3,1), Half(69312,1:8,456,3,1) -> Half(69312,1:8,456,3,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: Mul_187 (ElementWise) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.00478385 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000001 Time: 0.00478385 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: ElementWise Tactic: 0x0000000000000001 [07/07/2022-18:30:26] [TRT] [V] =============== Computing costs for [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Float(207936,69312,456,3,1) -> Float(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_189 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.978144 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00468948 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00461458 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00478248 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00466889 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000004 Time: 0.00461458 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000004 [07/07/2022-18:30:26] [TRT] [V] *************** Autotuning format combination: Half(207936,69312,456,3,1) -> Half(69312,23104,152,1) *************** [07/07/2022-18:30:26] [TRT] [V] --------------- Timing Runner: ReduceSum_189 (Reduce) [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000001 Time: 0.979733 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000003 Time: 0.00454414 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000004 Time: 0.00454414 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000007 Time: 0.00471136 [07/07/2022-18:30:26] [TRT] [V] Tactic: 0x0000000000000008 Time: 0.00468178 [07/07/2022-18:30:26] [TRT] [V] Fastest Tactic: 0x0000000000000003 Time: 0.00454414 [07/07/2022-18:30:26] [TRT] [V] >>>>>>>>>>>>>>> Chose Runner Type: Reduce Tactic: 0x0000000000000003 [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Conv_0 + Relu_1 (images) from Float(1108992,369664,608,1) to Half(369664,1:4,608,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Conv_48 (260) from Half(554496,1444:2,38,1) to Half(138624,1:8,3648,96) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Resize_64 (278) from Half(5776,1:8,76,1) to Half(17328,5776,76,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Resize_91 (313) from Half(5776,1:8,76,1) to Half(11552,5776,76,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Resize_118 (348) from Half(5776,1:8,76,1) to Float(11552,5776,76,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Resize_172 (418) from Half(5776,1:8,76,1) to Half(17328,5776,76,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_153 (398) from Half(23104,1:8,152,1) to Float(23104,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_74 (296) from Half(23104,1:8,152,1) to Half(69312,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_101 (331) from Half(23104,1:8,152,1) to Float(46208,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_128 (366) from Half(23104,1:8,152,1) to Float(46208,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_155 (401) from Half(23104,1:8,152,1) to Float(23104,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_76 (299) from Half(23104,1:8,152,1) to Half(69312,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_103 (334) from Half(23104,1:8,152,1) to Float(46208,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_130 (369) from Half(23104,1:8,152,1) to Float(46208,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_157 (404) from Half(23104,1:8,152,1) to Float(23104,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_182 (436) from Half(23104,1:8,152,1) to Half(69312,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Adding reformat layer: Reformatted Input Tensor 0 to Unsqueeze_184 (439) from Half(23104,1:8,152,1) to Half(69312,23104,152,1) [07/07/2022-18:30:26] [TRT] [V] Formats and tactics selection completed in 36.011 seconds. [07/07/2022-18:30:26] [TRT] [V] After reformat layers: 118 layers [07/07/2022-18:30:26] [TRT] [V] Pre-optimized block assignment. [07/07/2022-18:30:26] [TRT] [V] Block size 11829248 [07/07/2022-18:30:26] [TRT] [V] Block size 2957312 [07/07/2022-18:30:26] [TRT] [V] Block size 2957312 [07/07/2022-18:30:26] [TRT] [V] Block size 2957312 [07/07/2022-18:30:26] [TRT] [V] Block size 2957312 [07/07/2022-18:30:26] [TRT] [V] Block size 2957312 [07/07/2022-18:30:26] [TRT] [V] Block size 1478656 [07/07/2022-18:30:26] [TRT] [V] Block size 1478656 [07/07/2022-18:30:26] [TRT] [V] Block size 1478656 [07/07/2022-18:30:26] [TRT] [V] Block size 1478656 [07/07/2022-18:30:26] [TRT] [V] Block size 1478656 [07/07/2022-18:30:26] [TRT] [V] Block size 739328 [07/07/2022-18:30:26] [TRT] [V] Block size 739328 [07/07/2022-18:30:26] [TRT] [V] Block size 739328 [07/07/2022-18:30:26] [TRT] [V] Block size 739328 [07/07/2022-18:30:26] [TRT] [V] Block size 739328 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 1478656 [07/07/2022-18:30:26] [TRT] [V] Block size 2217984 [07/07/2022-18:30:26] [TRT] [V] Block size 739328 [07/07/2022-18:30:26] [TRT] [V] Block size 2957312 [07/07/2022-18:30:26] [TRT] [V] Block size 4435968 [07/07/2022-18:30:26] [TRT] [V] Block size 1478656 [07/07/2022-18:30:26] [TRT] [V] Block size 5914624 [07/07/2022-18:30:26] [TRT] [V] Block size 8871936 [07/07/2022-18:30:26] [TRT] [V] Block size 2957312 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 138752 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 832000 [07/07/2022-18:30:26] [TRT] [V] Block size 832000 [07/07/2022-18:30:26] [TRT] [V] Block size 832000 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 554496 [07/07/2022-18:30:26] [TRT] [V] Block size 554496 [07/07/2022-18:30:26] [TRT] [V] Block size 554496 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 184832 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 554496 [07/07/2022-18:30:26] [TRT] [V] Block size 554496 [07/07/2022-18:30:26] [TRT] [V] Block size 554496 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 277504 [07/07/2022-18:30:26] [TRT] [V] Block size 277504 [07/07/2022-18:30:26] [TRT] [V] Block size 277504 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 138752 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 369664 [07/07/2022-18:30:26] [TRT] [V] Block size 832000 [07/07/2022-18:30:26] [TRT] [V] Block size 832000 [07/07/2022-18:30:26] [TRT] [V] Block size 832000 [07/07/2022-18:30:26] [TRT] [V] Block size 3696640 [07/07/2022-18:30:26] [TRT] [V] Block size 14786560 [07/07/2022-18:30:26] [TRT] [V] Block size 14786560 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 4 [07/07/2022-18:30:26] [TRT] [V] Block size 2957312 [07/07/2022-18:30:26] [TRT] [V] Block size 2217984 [07/07/2022-18:30:26] [TRT] [V] Block size 34816 [07/07/2022-18:30:26] [TRT] [V] Block size 23552 [07/07/2022-18:30:26] [TRT] [V] Block size 46592 [07/07/2022-18:30:26] [TRT] [V] Block size 34816 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 138752 [07/07/2022-18:30:26] [TRT] [V] Block size 184832 [07/07/2022-18:30:26] [TRT] [V] Block size 184832 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 138752 [07/07/2022-18:30:26] [TRT] [V] Block size 184832 [07/07/2022-18:30:26] [TRT] [V] Block size 184832 [07/07/2022-18:30:26] [TRT] [V] Block size 92672 [07/07/2022-18:30:26] [TRT] [V] Block size 138752 [07/07/2022-18:30:26] [TRT] [V] Block size 138752 [07/07/2022-18:30:26] [TRT] [V] Block size 268435456 [07/07/2022-18:30:26] [TRT] [V] Total Activation Memory: 393434684 [07/07/2022-18:30:26] [TRT] [I] Detected 1 inputs and 5 output network tensors. [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_0 + Relu_1.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_0 + Relu_1.bias] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_0 + Relu_1 Set Tactic Name: trt_turing_cutlass_image_network_first_layer_hmma_fprop_f16f16f32_nhwc_nhwc_k64r7s7c4_stride2x2 Tactic: 0xe2222883a6602489 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_3 + Relu_4.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_3 + Relu_4 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_5 + Add_6 + Relu_7.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_5 + Add_6 + Relu_7 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_8 + Relu_9.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_8 + Relu_9 Set Tactic Name: turing_h1688cudnn_256x64_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0x1dcf9babce3d9b3b [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_10 + Add_11 + Relu_12.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_10 + Add_11 + Relu_12 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize256x64x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x30150d05024bc911 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_13 + Relu_14.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_13 + Relu_14 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_15.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_15 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_16 + Add_17 + Relu_18.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_16 + Add_17 + Relu_18 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x128x32_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x6b44e6396887bed9 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_19 + Relu_20.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_19 + Relu_20 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_21 + Add_22 + Relu_23.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_21 + Add_22 + Relu_23 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_24 + Relu_25.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_24 + Relu_25 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_26.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_26 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_27 + Add_28 + Relu_29.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_27 + Add_28 + Relu_29 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_indexed_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8 Tactic: 0x784dcede905d06c0 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_30 + Relu_31.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_30 + Relu_31 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_32 + Add_33 + Relu_34.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_32 + Add_33 + Relu_34 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_35 + Relu_36.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:26] [TRT] [V] Conv_35 + Relu_36 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:26] [TRT] [W] Weights [name=Conv_37.weight] had the following issues when converted to FP16: [07/07/2022-18:30:26] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:26] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:26] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_37 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_38 + Add_39 + Relu_40.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_38 + Add_39 + Relu_40 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r1s1 Tactic: 0xe67db95e0c20b618 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_41 + Relu_42.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_41 + Relu_42 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_43 + Add_44 + Relu_45.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_43 + Add_44 + Relu_45 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_t1r3s3 Tactic: 0x6cee4d9c86b4cdd5 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_48.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_48 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x62a22cfa1199e58e [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Set Tactic Name: turing_h1688cudnn_256x64_sliced1x2_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xaf407014f2c7f1cb [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_51.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_51 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_interior_nhwc_tn_v1 Tactic: 0x2a3615ad33745f0b [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_57.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_57 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [V] Conv_84 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [V] Conv_111 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [V] Conv_138 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [V] Conv_165 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_54.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_54 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize64x64x64_stage1_warpsize2x2x1_g1_tensor16x8x8_simple_t1r1s1 Tactic: 0x62a22cfa1199e58e [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177.bias] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Set Tactic Name: turing_h1688cudnn_128x128_ldg8_relu_exp_small_nhwc_tn_v1 Tactic: 0xd47a5fce3824e4a4 [07/07/2022-18:30:27] [TRT] [V] Conv_67 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_94.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_94 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_121.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_121 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [V] Conv_148 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [V] Conv_70 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_97.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_97 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [V] Conv_124 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_151.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_151 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_175.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_175 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [W] Weights [name=Conv_178.weight] had the following issues when converted to FP16: [07/07/2022-18:30:27] [TRT] [W] - Subnormal FP16 values detected. [07/07/2022-18:30:27] [TRT] [W] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [07/07/2022-18:30:27] [TRT] [V] Conv_178 Set Tactic Name: sm75_xmma_fprop_implicit_gemm_f16f16_f16f16_f16_nhwckrsc_nhwc_tilesize128x32x32_stage1_warpsize4x1x1_g1_tensor16x8x8_t1r1s1 Tactic: 0x41e8a431d0137286 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Conv_0 + Relu_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_0 + Relu_1 Host Persistent: 768 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: MaxPool_2 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_3 + Relu_4 Host Persistent: 1664 Device Persistent: 138752 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_5 + Add_6 + Relu_7 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_8 + Relu_9 Host Persistent: 1664 Device Persistent: 138752 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_10 + Add_11 + Relu_12 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_13 + Relu_14 Host Persistent: 1664 Device Persistent: 34816 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_15 Host Persistent: 1664 Device Persistent: 34816 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_16 + Add_17 + Relu_18 Host Persistent: 1984 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_19 + Relu_20 Host Persistent: 1664 Device Persistent: 34816 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_21 + Add_22 + Relu_23 Host Persistent: 1664 Device Persistent: 34816 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_24 + Relu_25 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_26 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_27 + Add_28 + Relu_29 Host Persistent: 1984 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_30 + Relu_31 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_32 + Add_33 + Relu_34 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_35 + Relu_36 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_37 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_38 + Add_39 + Relu_40 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_41 + Relu_42 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_43 + Add_44 + Relu_45 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Resize_46 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: 259 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: 238 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Conv_48 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_48 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Resize_49 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: 266 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: 222 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164 Host Persistent: 1664 Device Persistent: 34816 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_51 Host Persistent: 3200 Device Persistent: 34816 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Resize_52 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_57 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_84 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_111 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_138 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_165 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: 273 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: 206 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174 Host Persistent: 1664 Device Persistent: 138752 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Resize_64 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Resize_64 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Resize_91 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Resize_91 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Resize_118 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Resize_118 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Resize_145 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Resize_172 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Resize_172 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_54 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_72 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_72_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_99 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_99_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_126 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_126_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_153 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_153 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_153_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177 Host Persistent: 1664 Device Persistent: 138752 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_67 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_94 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_121 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_148 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_74 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_74 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_74_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_101 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_101 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_101_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_128 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_128 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_128_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_155 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_155 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_155_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_70 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_97 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_124 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_151 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_76 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_76 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_76_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_103 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_103 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_103_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_130 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_130 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_130_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_157 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_157 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_157_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Softmax_78 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Softmax_105 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Softmax_132 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Softmax_159 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Mul_79 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Mul_106 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Mul_133 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Mul_160 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: ReduceSum_81 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: ReduceSum_108 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: ReduceSum_135 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: ReduceSum_162 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_175 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Conv_178 Host Persistent: 2784 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_180 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_180_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_182 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_182 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_182_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Reformatting CopyNode for Input Tensor 0 to Unsqueeze_184 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_184 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Unsqueeze_184_copy_output Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Softmax_186 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: Mul_187 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [V] Layer: ReduceSum_189 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [I] Total Host Persistent Memory: 100864 [07/07/2022-18:30:27] [TRT] [I] Total Device Persistent Memory: 763904 [07/07/2022-18:30:27] [TRT] [I] Total Scratch Memory: 0 [07/07/2022-18:30:27] [TRT] [I] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 30 MiB, GPU 216 MiB [07/07/2022-18:30:27] [TRT] [I] [BlockAssignment] Algorithm ShiftNTopDown took 12.93ms to assign 12 blocks to 100 nodes requiring 42188800 bytes. [07/07/2022-18:30:27] [TRT] [V] Optimized block assignment. [07/07/2022-18:30:27] [TRT] [V] Block size 14786560 [07/07/2022-18:30:27] [TRT] [V] Block size 5914624 [07/07/2022-18:30:27] [TRT] [V] Block size 14786560 [07/07/2022-18:30:27] [TRT] [V] Block size 2957312 [07/07/2022-18:30:27] [TRT] [V] Block size 832000 [07/07/2022-18:30:27] [TRT] [V] Block size 554496 [07/07/2022-18:30:27] [TRT] [V] Block size 554496 [07/07/2022-18:30:27] [TRT] [V] Block size 554496 [07/07/2022-18:30:27] [TRT] [V] Block size 554496 [07/07/2022-18:30:27] [TRT] [V] Block size 277504 [07/07/2022-18:30:27] [TRT] [V] Block size 277504 [07/07/2022-18:30:27] [TRT] [V] Block size 138752 [07/07/2022-18:30:27] [TRT] [I] Total Activation Memory: 42188800 [07/07/2022-18:30:27] [TRT] [V] Disabling unused tactic source: CUDNN [07/07/2022-18:30:27] [TRT] [V] Disabling unused tactic source: CUBLAS, CUBLAS_LT [07/07/2022-18:30:27] [TRT] [V] Engine generation completed in 37.221 seconds. [07/07/2022-18:30:27] [TRT] [V] Deleting timing cache: 1085 entries, served 2337 hits since creation. [07/07/2022-18:30:27] [TRT] [V] Engine Layer Information: Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Conv_0 + Relu_1, Tactic: 0x00000000000003ea, images[Float(1,3,608,608)] -> Reformatted Input Tensor 0 to Conv_0 + Relu_1[Half(1,3,608,608)] Layer(CaskConvolution): Conv_0 + Relu_1, Tactic: 0xe2222883a6602489, Reformatted Input Tensor 0 to Conv_0 + Relu_1[Half(1,3,608,608)] -> 191[Half(1,64,304,304)] Layer(CudaPooling): MaxPool_2, Tactic: 0xfffffffffffffffe, 191[Half(1,64,304,304)] -> 192[Half(1,64,152,152)] Layer(CaskConvolution): Conv_3 + Relu_4, Tactic: 0x1dcf9babce3d9b3b, 192[Half(1,64,152,152)] -> 195[Half(1,64,152,152)] Layer(CaskConvolution): Conv_5 + Add_6 + Relu_7, Tactic: 0x30150d05024bc911, 195[Half(1,64,152,152)], 192[Half(1,64,152,152)] -> 199[Half(1,64,152,152)] Layer(CaskConvolution): Conv_8 + Relu_9, Tactic: 0x1dcf9babce3d9b3b, 199[Half(1,64,152,152)] -> 202[Half(1,64,152,152)] Layer(CaskConvolution): Conv_10 + Add_11 + Relu_12, Tactic: 0x30150d05024bc911, 202[Half(1,64,152,152)], 199[Half(1,64,152,152)] -> 206[Half(1,64,152,152)] Layer(CaskConvolution): Conv_13 + Relu_14, Tactic: 0xd47a5fce3824e4a4, 206[Half(1,64,152,152)] -> 209[Half(1,128,76,76)] Layer(CaskConvolution): Conv_15, Tactic: 0xd47a5fce3824e4a4, 209[Half(1,128,76,76)] -> 469[Half(1,128,76,76)] Layer(CaskConvolution): Conv_16 + Add_17 + Relu_18, Tactic: 0x6b44e6396887bed9, 206[Half(1,64,152,152)], 469[Half(1,128,76,76)] -> 215[Half(1,128,76,76)] Layer(CaskConvolution): Conv_19 + Relu_20, Tactic: 0xd47a5fce3824e4a4, 215[Half(1,128,76,76)] -> 218[Half(1,128,76,76)] Layer(CaskConvolution): Conv_21 + Add_22 + Relu_23, Tactic: 0xd47a5fce3824e4a4, 218[Half(1,128,76,76)], 215[Half(1,128,76,76)] -> 222[Half(1,128,76,76)] Layer(CaskConvolution): Conv_24 + Relu_25, Tactic: 0x6cee4d9c86b4cdd5, 222[Half(1,128,76,76)] -> 225[Half(1,256,38,38)] Layer(CaskConvolution): Conv_26, Tactic: 0x6cee4d9c86b4cdd5, 225[Half(1,256,38,38)] -> 484[Half(1,256,38,38)] Layer(CaskConvolution): Conv_27 + Add_28 + Relu_29, Tactic: 0x784dcede905d06c0, 222[Half(1,128,76,76)], 484[Half(1,256,38,38)] -> 231[Half(1,256,38,38)] Layer(CaskConvolution): Conv_30 + Relu_31, Tactic: 0x6cee4d9c86b4cdd5, 231[Half(1,256,38,38)] -> 234[Half(1,256,38,38)] Layer(CaskConvolution): Conv_32 + Add_33 + Relu_34, Tactic: 0x6cee4d9c86b4cdd5, 234[Half(1,256,38,38)], 231[Half(1,256,38,38)] -> 238[Half(1,256,38,38)] Layer(CaskConvolution): Conv_35 + Relu_36, Tactic: 0x6cee4d9c86b4cdd5, 238[Half(1,256,38,38)] -> 241[Half(1,512,19,19)] Layer(CaskConvolution): Conv_37, Tactic: 0x6cee4d9c86b4cdd5, 241[Half(1,512,19,19)] -> 499[Half(1,512,19,19)] Layer(CaskConvolution): Conv_38 + Add_39 + Relu_40, Tactic: 0xe67db95e0c20b618, 238[Half(1,256,38,38)], 499[Half(1,512,19,19)] -> 247[Half(1,512,19,19)] Layer(CaskConvolution): Conv_41 + Relu_42, Tactic: 0x6cee4d9c86b4cdd5, 247[Half(1,512,19,19)] -> 250[Half(1,512,19,19)] Layer(CaskConvolution): Conv_43 + Add_44 + Relu_45, Tactic: 0x6cee4d9c86b4cdd5, 250[Half(1,512,19,19)], 247[Half(1,512,19,19)] -> 254[Half(1,512,19,19)] Layer(Resize): Resize_46, Tactic: 0x0000000000000006, 254[Half(1,512,19,19)] -> 259[Half(1,512,38,38)] Layer(Reformat): 259 copy, Tactic: 0x0000000000000000, 259[Half(1,512,38,38)] -> 260[Half(1,512,38,38)] Layer(Reformat): 238 copy, Tactic: 0x0000000000000000, 238[Half(1,256,38,38)] -> 260[Half(1,256,38,38)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Conv_48, Tactic: 0x0000000000000000, 260[Half(1,768,38,38)] -> Reformatted Input Tensor 0 to Conv_48[Half(1,768,38,38)] Layer(CaskConvolution): Conv_48, Tactic: 0x62a22cfa1199e58e, Reformatted Input Tensor 0 to Conv_48[Half(1,768,38,38)] -> 261[Half(1,256,38,38)] Layer(Resize): Resize_49, Tactic: 0x0000000000000006, 261[Half(1,256,38,38)] -> 266[Half(1,256,76,76)] Layer(Reformat): 266 copy, Tactic: 0x00000000000003ea, 266[Half(1,256,76,76)] -> 267[Half(1,256,76,76)] Layer(Reformat): 222 copy, Tactic: 0x0000000000000000, 222[Half(1,128,76,76)] -> 267[Half(1,128,76,76)] Layer(CaskConvolution): Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164, Tactic: 0xaf407014f2c7f1cb, 266[Half(1,256,76,76)] -> Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164[Half(1,320,76,76)] Layer(CaskConvolution): Conv_51, Tactic: 0x2a3615ad33745f0b, 267[Half(1,384,76,76)] -> 268[Half(1,128,76,76)] Layer(Resize): Resize_52, Tactic: 0x0000000000000006, 268[Half(1,128,76,76)] -> 273[Half(1,128,152,152)] Layer(CaskConvolution): Conv_57, Tactic: 0x41e8a431d0137286, Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164[Half(1,64,76,76)] -> 278[Half(1,3,76,76)] Layer(CaskConvolution): Conv_84, Tactic: 0x41e8a431d0137286, Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164[Half(1,64,76,76)] -> 313[Half(1,2,76,76)] Layer(CaskConvolution): Conv_111, Tactic: 0x41e8a431d0137286, Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164[Half(1,64,76,76)] -> 348[Half(1,2,76,76)] Layer(CaskConvolution): Conv_138, Tactic: 0x41e8a431d0137286, Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164[Half(1,64,76,76)] -> 383[Half(1,1,76,76)] Layer(CaskConvolution): Conv_165, Tactic: 0x41e8a431d0137286, Conv_55 + Relu_56 || Conv_82 + Relu_83 || Conv_109 + Relu_110 || Conv_136 + Relu_137 || Conv_163 + Relu_164[Half(1,64,76,76)] -> 418[Half(1,3,76,76)] Layer(Reformat): 273 copy, Tactic: 0x00000000000003ea, 273[Half(1,128,152,152)] -> 274[Half(1,128,152,152)] Layer(Reformat): 206 copy, Tactic: 0x00000000000003ea, 206[Half(1,64,152,152)] -> 274[Half(1,64,152,152)] Layer(CaskConvolution): Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174, Tactic: 0xd47a5fce3824e4a4, 273[Half(1,128,152,152)] -> Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174[Half(1,320,152,152)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Resize_64, Tactic: 0x00000000000003e8, 278[Half(1,3,76,76)] -> Reformatted Input Tensor 0 to Resize_64[Half(1,3,76,76)] Layer(Resize): Resize_64, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Resize_64[Half(1,3,76,76)] -> 293[Half(1,3,152,152)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Resize_91, Tactic: 0x0000000000000000, 313[Half(1,2,76,76)] -> Reformatted Input Tensor 0 to Resize_91[Half(1,2,76,76)] Layer(Resize): Resize_91, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Resize_91[Half(1,2,76,76)] -> 328[Half(1,2,152,152)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Resize_118, Tactic: 0x0000000000000000, 348[Half(1,2,76,76)] -> Reformatted Input Tensor 0 to Resize_118[Float(1,2,76,76)] Layer(Resize): Resize_118, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Resize_118[Float(1,2,76,76)] -> 363[Float(1,2,152,152)] Layer(Resize): Resize_145, Tactic: 0x0000000000000004, 383[Half(1,1,76,76)] -> 398[Half(1,1,152,152)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Resize_172, Tactic: 0x00000000000003e8, 418[Half(1,3,76,76)] -> Reformatted Input Tensor 0 to Resize_172[Half(1,3,76,76)] Layer(Resize): Resize_172, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Resize_172[Half(1,3,76,76)] -> 433[Half(1,3,152,152)] Layer(CaskConvolution): Conv_54, Tactic: 0x62a22cfa1199e58e, 274[Half(1,192,152,152)] -> 275[Half(1,64,152,152)] Layer(NoOp): Unsqueeze_72, Tactic: 0x0000000000000000, 293[Half(1,3,152,152)] -> Unsqueeze_72_copy_output[Half(1,3,152,152,1)] Layer(Reformat): Unsqueeze_72_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_72_copy_output[Half(1,3,152,152,1)] -> 306[Float(1,3,152,152,1)] Layer(NoOp): Unsqueeze_99, Tactic: 0x0000000000000000, 328[Half(1,2,152,152)] -> Unsqueeze_99_copy_output[Half(1,2,152,152,1)] Layer(Reformat): Unsqueeze_99_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_99_copy_output[Half(1,2,152,152,1)] -> 341[Float(1,2,152,152,1)] Layer(NoOp): Unsqueeze_126, Tactic: 0x0000000000000000, 363[Float(1,2,152,152)] -> Unsqueeze_126_copy_output[Float(1,2,152,152,1)] Layer(Reformat): Unsqueeze_126_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_126_copy_output[Float(1,2,152,152,1)] -> 376[Float(1,2,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_153, Tactic: 0x0000000000000000, 398[Half(1,1,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_153[Float(1,1,152,152)] Layer(NoOp): Unsqueeze_153, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_153[Float(1,1,152,152)] -> Unsqueeze_153_copy_output[Float(1,1,152,152,1)] Layer(Reformat): Unsqueeze_153_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_153_copy_output[Float(1,1,152,152,1)] -> 411[Float(1,1,152,152,1)] Layer(CaskConvolution): Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177, Tactic: 0xd47a5fce3824e4a4, 275[Half(1,64,152,152)] -> Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177[Half(1,320,152,152)] Layer(CaskConvolution): Conv_67, Tactic: 0x41e8a431d0137286, Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174[Half(1,64,152,152)] -> 296[Half(1,3,152,152)] Layer(CaskConvolution): Conv_94, Tactic: 0x41e8a431d0137286, Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174[Half(1,64,152,152)] -> 331[Half(1,2,152,152)] Layer(CaskConvolution): Conv_121, Tactic: 0x41e8a431d0137286, Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174[Half(1,64,152,152)] -> 366[Half(1,2,152,152)] Layer(CaskConvolution): Conv_148, Tactic: 0x41e8a431d0137286, Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174[Half(1,64,152,152)] -> 401[Half(1,1,152,152)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_74, Tactic: 0x00000000000003e8, 296[Half(1,3,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_74[Half(1,3,152,152)] Layer(NoOp): Unsqueeze_74, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_74[Half(1,3,152,152)] -> Unsqueeze_74_copy_output[Half(1,3,152,152,1)] Layer(Reformat): Unsqueeze_74_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_74_copy_output[Half(1,3,152,152,1)] -> 306[Float(1,3,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_101, Tactic: 0x0000000000000000, 331[Half(1,2,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_101[Float(1,2,152,152)] Layer(NoOp): Unsqueeze_101, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_101[Float(1,2,152,152)] -> Unsqueeze_101_copy_output[Float(1,2,152,152,1)] Layer(Reformat): Unsqueeze_101_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_101_copy_output[Float(1,2,152,152,1)] -> 341[Float(1,2,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_128, Tactic: 0x0000000000000000, 366[Half(1,2,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_128[Float(1,2,152,152)] Layer(NoOp): Unsqueeze_128, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_128[Float(1,2,152,152)] -> Unsqueeze_128_copy_output[Float(1,2,152,152,1)] Layer(Reformat): Unsqueeze_128_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_128_copy_output[Float(1,2,152,152,1)] -> 376[Float(1,2,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_155, Tactic: 0x0000000000000000, 401[Half(1,1,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_155[Float(1,1,152,152)] Layer(NoOp): Unsqueeze_155, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_155[Float(1,1,152,152)] -> Unsqueeze_155_copy_output[Float(1,1,152,152,1)] Layer(Reformat): Unsqueeze_155_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_155_copy_output[Float(1,1,152,152,1)] -> 411[Float(1,1,152,152,1)] Layer(CaskConvolution): Conv_70, Tactic: 0x41e8a431d0137286, Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177[Half(1,64,152,152)] -> 299[Half(1,3,152,152)] Layer(CaskConvolution): Conv_97, Tactic: 0x41e8a431d0137286, Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177[Half(1,64,152,152)] -> 334[Half(1,2,152,152)] Layer(CaskConvolution): Conv_124, Tactic: 0x41e8a431d0137286, Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177[Half(1,64,152,152)] -> 369[Half(1,2,152,152)] Layer(CaskConvolution): Conv_151, Tactic: 0x41e8a431d0137286, Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177[Half(1,64,152,152)] -> 404[Half(1,1,152,152)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_76, Tactic: 0x00000000000003e8, 299[Half(1,3,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_76[Half(1,3,152,152)] Layer(NoOp): Unsqueeze_76, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_76[Half(1,3,152,152)] -> Unsqueeze_76_copy_output[Half(1,3,152,152,1)] Layer(Reformat): Unsqueeze_76_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_76_copy_output[Half(1,3,152,152,1)] -> 306[Float(1,3,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_103, Tactic: 0x0000000000000000, 334[Half(1,2,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_103[Float(1,2,152,152)] Layer(NoOp): Unsqueeze_103, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_103[Float(1,2,152,152)] -> Unsqueeze_103_copy_output[Float(1,2,152,152,1)] Layer(Reformat): Unsqueeze_103_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_103_copy_output[Float(1,2,152,152,1)] -> 341[Float(1,2,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_130, Tactic: 0x0000000000000000, 369[Half(1,2,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_130[Float(1,2,152,152)] Layer(NoOp): Unsqueeze_130, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_130[Float(1,2,152,152)] -> Unsqueeze_130_copy_output[Float(1,2,152,152,1)] Layer(Reformat): Unsqueeze_130_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_130_copy_output[Float(1,2,152,152,1)] -> 376[Float(1,2,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_157, Tactic: 0x0000000000000000, 404[Half(1,1,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_157[Float(1,1,152,152)] Layer(NoOp): Unsqueeze_157, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_157[Float(1,1,152,152)] -> Unsqueeze_157_copy_output[Float(1,1,152,152,1)] Layer(Reformat): Unsqueeze_157_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_157_copy_output[Float(1,1,152,152,1)] -> 411[Float(1,1,152,152,1)] Layer(CudaSoftMax): Softmax_78, Tactic: 0x00000000000003e9, 306[Float(1,3,152,152,3)] -> (Unnamed Layer* 70) [Softmax]_output[Float(1,3,152,152,3)] Layer(CudaSoftMax): Softmax_105, Tactic: 0x00000000000003e9, 341[Float(1,2,152,152,3)] -> (Unnamed Layer* 89) [Softmax]_output[Float(1,2,152,152,3)] Layer(CudaSoftMax): Softmax_132, Tactic: 0x00000000000003e9, 376[Float(1,2,152,152,3)] -> (Unnamed Layer* 108) [Softmax]_output[Float(1,2,152,152,3)] Layer(CudaSoftMax): Softmax_159, Tactic: 0x00000000000003e9, 411[Float(1,1,152,152,3)] -> (Unnamed Layer* 127) [Softmax]_output[Float(1,1,152,152,3)] Layer(ElementWise): Mul_79, Tactic: 0x0000000000000001, 306[Float(1,3,152,152,3)], (Unnamed Layer* 70) [Softmax]_output[Float(1,3,152,152,3)] -> 308[Float(1,3,152,152,3)] Layer(ElementWise): Mul_106, Tactic: 0x0000000000000001, 341[Float(1,2,152,152,3)], (Unnamed Layer* 89) [Softmax]_output[Float(1,2,152,152,3)] -> 343[Float(1,2,152,152,3)] Layer(ElementWise): Mul_133, Tactic: 0x0000000000000001, 376[Float(1,2,152,152,3)], (Unnamed Layer* 108) [Softmax]_output[Float(1,2,152,152,3)] -> 378[Float(1,2,152,152,3)] Layer(ElementWise): Mul_160, Tactic: 0x0000000000000001, 411[Float(1,1,152,152,3)], (Unnamed Layer* 127) [Softmax]_output[Float(1,1,152,152,3)] -> 413[Float(1,1,152,152,3)] Layer(Reduce): ReduceSum_81, Tactic: 0x0000000000000004, 308[Float(1,3,152,152,3)] -> output[Float(1,3,152,152)] Layer(Reduce): ReduceSum_108, Tactic: 0x0000000000000007, 343[Float(1,2,152,152,3)] -> 345[Float(1,2,152,152)] Layer(Reduce): ReduceSum_135, Tactic: 0x0000000000000008, 378[Float(1,2,152,152,3)] -> 380[Float(1,2,152,152)] Layer(Reduce): ReduceSum_162, Tactic: 0x0000000000000003, 413[Float(1,1,152,152,3)] -> 415[Float(1,1,152,152)] Layer(CaskConvolution): Conv_175, Tactic: 0x41e8a431d0137286, Conv_65 + Relu_66 || Conv_92 + Relu_93 || Conv_119 + Relu_120 || Conv_146 + Relu_147 || Conv_173 + Relu_174[Half(1,64,152,152)] -> 436[Half(1,3,152,152)] Layer(CaskConvolution): Conv_178, Tactic: 0x41e8a431d0137286, Conv_68 + Relu_69 || Conv_95 + Relu_96 || Conv_122 + Relu_123 || Conv_149 + Relu_150 || Conv_176 + Relu_177[Half(1,64,152,152)] -> 439[Half(1,3,152,152)] Layer(NoOp): Unsqueeze_180, Tactic: 0x0000000000000000, 433[Half(1,3,152,152)] -> Unsqueeze_180_copy_output[Half(1,3,152,152,1)] Layer(Reformat): Unsqueeze_180_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_180_copy_output[Half(1,3,152,152,1)] -> 446[Float(1,3,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_182, Tactic: 0x00000000000003e8, 436[Half(1,3,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_182[Half(1,3,152,152)] Layer(NoOp): Unsqueeze_182, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_182[Half(1,3,152,152)] -> Unsqueeze_182_copy_output[Half(1,3,152,152,1)] Layer(Reformat): Unsqueeze_182_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_182_copy_output[Half(1,3,152,152,1)] -> 446[Float(1,3,152,152,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to Unsqueeze_184, Tactic: 0x00000000000003e8, 439[Half(1,3,152,152)] -> Reformatted Input Tensor 0 to Unsqueeze_184[Half(1,3,152,152)] Layer(NoOp): Unsqueeze_184, Tactic: 0x0000000000000000, Reformatted Input Tensor 0 to Unsqueeze_184[Half(1,3,152,152)] -> Unsqueeze_184_copy_output[Half(1,3,152,152,1)] Layer(Reformat): Unsqueeze_184_copy_output, Tactic: 0x00000000000003e8, Unsqueeze_184_copy_output[Half(1,3,152,152,1)] -> 446[Float(1,3,152,152,1)] Layer(CudaSoftMax): Softmax_186, Tactic: 0x00000000000003e9, 446[Float(1,3,152,152,3)] -> (Unnamed Layer* 146) [Softmax]_output[Float(1,3,152,152,3)] Layer(ElementWise): Mul_187, Tactic: 0x0000000000000001, 446[Float(1,3,152,152,3)], (Unnamed Layer* 146) [Softmax]_output[Float(1,3,152,152,3)] -> 448[Float(1,3,152,152,3)] Layer(Reduce): ReduceSum_189, Tactic: 0x0000000000000004, 448[Float(1,3,152,152,3)] -> 450[Float(1,3,152,152)] [07/07/2022-18:30:27] [TRT] [I] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +24, GPU +25, now: CPU 24, GPU 25 (MiB) [07/07/2022-18:30:27] [TRT] [W] The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1. [07/07/2022-18:30:27] [TRT] [W] The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1. using ResNet architecture with feature pyramid -*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*=-*= Loaded weights from ../checkpoints/fpn_resnet_18/Model_fpn_resnet_18_epoch_200.pth Converting to ONNX... Model already exists. Converting to TensorRT... [INFO] Setting fp16 to true. [INFO] Engine serialized and saved !